Sunny Madra and Elon Musk Flag Intelligence Per Joule
Sunny Madra and Elon Musk comment on AI intelligence per joule efficiency.
Sunny Madra posted that intelligence per joule is key. Elon Musk replied that intelligence per joule will keep improving. Azalia Mirhoseini noted that intelligence per joule is increasing quickly because models and chips are improving and gains compound, though demand for inference grows faster, and linked an arXiv paper on measuring intelligence efficiency of local AI. Brad Gerstner replied about electrons into tokens. Beff Jezos replied to Musk that there are at least four OOMs to go.
Combined views
5.9M
6 posts, first seen 14d ago
Reactions
6 postsSM EM 
Elon Musk@elonmuskIntelligence/Joule will keep improving
- likes: 13K
- replies: 1.4K
- bookmarks: 1.1K
- reposts: 2K
B( Beff (e/acc)@beffjezos@elonmusk there's at least 4 OOMs to go
- likes: 16
- replies: 1
- bookmarks: 0
- reposts: 3
AM Azalia Mirhoseini@AzaliamirhIntelligence-per-joule is increasing quickly because models and chips are improving and the gains compound. Though demand for inference is growing even faster. @Avanika15 @JonSaadFalcon @HazyResearch
- likes: 141
- replies: 5
- bookmarks: 74
- reposts: 12
BG BP Boris Power@BorisMPowerThis is likely to be the new Moore’s law, and the right thing to measure. So far it seems to be much more aggressively growing than Moore’s law, as it combines hardware and software improvements in a multiplicative way!
- likes: 91
- replies: 7
- bookmarks: 27
- reposts: 9
