Humans don't need to learn from 1 trillion words to reach human intelligence.
— Yann LeCun (@ylecun) March 28, 2023
What are LLMs missing? https://t.co/JysSIvegX4
The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
— Yann LeCun (@ylecun) March 28, 2023
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
Tech
Data, Business, Web, RSS, Open, Android, Audio, Product Management, Wearables, Automobile, AI, Net, WRX, Storage, Medical, Web analytics, Social, Security, a11y, MacOS, Development, Mobile, Hardware, Crowdsourcing, OS, Energy, Collaboration, Shopping, Javascript, PIM, barcamp, Visual, s60
Other
Food & Drink, Clothes, Personal care, Bicycling, Travel, Surfing, Minnesota, Politik, California, Agriculture, Boston, Statistics, Sports, Feminism, L.A., San Francisco, Quizzes, Law, CrowdFlower, History, Life hacks, Geography, Housing, NYC, Activism, Friday, Podcasts, Toys, Games, Video, Transportation, Berlin
Music
Boston, Mailing lists, Labels, Events, Musicians, Mixes, Good tracks, Mp3s, Lyrics, Reviews, Streams, Making, Business, History, Hip-hop, L.A., House, Videos, Booking, Shopping
People
Stories, Subcultures, Languages, Exercise, Working with, Friends, Heroes, Health, Family, Gossip, Enemies, Meditation, Buddhism, Vocations, ADD, Me, Life hacks, Weblogs, MOTAS
Arts
Visual, Movies, Desktop wallpaper bait, Rhetoric, Comix, Burning Man, Literature, Humor, iPad bait, Outlets, Sculpture, Events, Poetry, Animation, Spoken Word
Commerce
International Development, Management consulting, Investing, Web, Macroeconomics, Shopping, Microfinance, Non-profit, Insurance, IP Law, Marketing and CRM, Real Estate, Personal services, Taxes, Personal finance
Design
Type, Furniture, User experience, Presentations, Web, Cool, Algorithmic, IA, Architecture, Data visualization, Process, Tools
Science
Statistics and Data, Networks, Psychology, Physics, Cognition, Environment, Zoology
Travel
Kenya, Vagabond '08, Kingdom of Siam, Uganda