Humans don't need to learn from 1 trillion words to reach human intelligence.
— Yann LeCun (@ylecun) March 28, 2023
What are LLMs missing? https://t.co/JysSIvegX4
The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
— Yann LeCun (@ylecun) March 28, 2023
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
Tech
Social, Open, Security, Crowdsourcing, Development, s60, Business, Collaboration, Automobile, MacOS, RSS, Data, Audio, OS, Mobile, WRX, Storage, Wearables, Energy, Hardware, Shopping, Medical, a11y, Visual, Net, barcamp, Android, Web, Javascript, Web analytics, Product Management, AI, PIM
Other
Transportation, Minnesota, CrowdFlower, Games, Housing, Friday, Podcasts, Law, Bicycling, Boston, Sports, Quizzes, Geography, NYC, Travel, Video, Clothes, Statistics, Berlin, Life hacks, Feminism, San Francisco, L.A., History, Toys, Personal care, Activism, Politik, California, Surfing, Food & Drink, Agriculture
Music
Boston, Lyrics, Booking, Mailing lists, Good tracks, House, Videos, Business, Making, History, Musicians, Shopping, Streams, L.A., Hip-hop, Events, Mp3s, Mixes, Labels, Reviews
People
Languages, MOTAS, Exercise, Buddhism, Meditation, Subcultures, Life hacks, Enemies, Me, Family, Heroes, Vocations, Gossip, Stories, Health, Friends, Working with, Weblogs, ADD
Arts
Desktop wallpaper bait, Events, Comix, Spoken Word, Burning Man, Poetry, Animation, iPad bait, Outlets, Literature, Visual, Sculpture, Movies, Rhetoric, Humor
Commerce
Taxes, Web, Shopping, Macroeconomics, Non-profit, International Development, Marketing and CRM, Microfinance, IP Law, Real Estate, Personal finance, Insurance, Personal services, Management consulting, Investing
Design
Type, Data visualization, Architecture, Furniture, Process, Algorithmic, Tools, IA, User experience, Web, Presentations, Cool
Science
Cognition, Physics, Networks, Zoology, Environment, Statistics and Data, Psychology
Travel
Uganda, Kenya, Kingdom of Siam, Vagabond '08