Humans don't need to learn from 1 trillion words to reach human intelligence.
— Yann LeCun (@ylecun) March 28, 2023
What are LLMs missing? https://t.co/JysSIvegX4
The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
— Yann LeCun (@ylecun) March 28, 2023
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
This is Lukas Bergstrom's weblog. You can also find me on Twitter and LinkedIn.
Tech
Automobile, Collaboration, Audio, OS, Net, Storage, MacOS, Data, Web analytics, Social, a11y, Visual, Javascript, PIM, Wearables, barcamp, s60, Android, Security, Web, Product Management, Medical, Crowdsourcing, Energy, Mobile, Hardware, Business, Shopping, AI, RSS, Development, Open, WRX
Other
Transportation, Geography, L.A., Housing, Bicycling, Feminism, Food & Drink, Podcasts, Statistics, Quizzes, Toys, Life hacks, Friday, NYC, Law, San Francisco, Travel, Personal care, Surfing, History, Berlin, Politik, Clothes, Sports, California, CrowdFlower, Activism, Video, Games, Agriculture, Boston, Minnesota
Music
Shopping, Musicians, Making, Reviews, Booking, Business, Streams, Mixes, Labels, House, Mailing lists, Videos, L.A., Events, Hip-hop, Boston, Lyrics, Mp3s, Good tracks, History
People
Health, Family, Enemies, Vocations, Me, Life hacks, Working with, Languages, Exercise, Subcultures, MOTAS, Meditation, Friends, Gossip, ADD, Buddhism, Heroes, Stories, Weblogs
Commerce
Web, Management consulting, Real Estate, Marketing and CRM, Taxes, Non-profit, International Development, Investing, Shopping, Insurance, Macroeconomics, Microfinance, IP Law, Personal finance, Personal services
Arts
Animation, Sculpture, Rhetoric, Humor, Burning Man, Movies, Outlets, Literature, iPad bait, Spoken Word, Desktop wallpaper bait, Comix, Events, Poetry, Visual
Design
Tools, Architecture, Cool, Data visualization, Furniture, Algorithmic, Process, Type, IA, Web, User experience, Presentations
Science
Physics, Cognition, Statistics and Data, Environment, Networks, Zoology, Psychology
Travel
Kenya, Vagabond '08, Uganda, Kingdom of Siam