▶️ Visit to get a 30-day free trial 20% off your annual subscription
The tech industry’s obsession with AI is hitting a major limitation - power consumption. Training and using AI models is proving to be extremely energy intensive. A single GPT-4 request consumes as much energy as charging 60 iPhones, 1000x more than a traditional Google search. By 2027, global AI processing could consume as much energy as the entire country of Sweden. In contrast, the human brain is far more efficient, with 17 hours of intense thought using the same energy as one GPT-4 request. This has spurred a race to develop AI that more closely mimics biological neural systems.
The high power usage stems from how artificial neural networks (ANNs) are structured with input, hidden, and output layers of interconnected nodes. Information flows forward through the network, which is trained using backpropagation to adjust weights and biases to minimize output errors. ANNs require massive computation, with the GPT-3 language model having 175 billion parameters. Training GPT-3 consumed 220 MWh of energy.
To improve efficiency, research is shifting to spiking neural networks (SNNs) that communicate through discrete spikes like biological neurons. SNNs only generate spikes when needed, greatly reducing energy use compared to ANNs constantly recalculating. SNN neurons have membrane potentials that trigger spikes when a threshold is exceeded, with refractory periods between spikes. This allows SNNs to produce dynamic, event-driven outputs. However, SNNs are difficult to train with standard ANN methods.
SNNs perform poorly on traditional computer architectures. Instead, neuromorphic computing devices are being developed that recreate biological neuron properties in hardware. These use analog processing in components like memristors and spintronic devices to achieve neuron-like behavior with low power. Early neuromorphic chips from IBM and Intel have supported millions of simulated neurons with 50-100x better energy efficiency than GPUs. As of 2024, no commercially available analog AI chips exist, but a hybrid analog-digital future for ultra-efficient AI hardware seems imminent. This could enable revolutionary advances in fields like robotics and autonomous systems in the coming years.
VISUALIZATIONS
Denis Dmitriev - @DenisDmitrievDeepRobotics
Jay Alammar - @arp_ai
Ivan Dimkovic - @321psyq
Carson Scott - @carsonscott260
SUPPORT NEW MIND ON PATREON
1 view
127
39
2 days ago 00:08:17 1
Like it or Not, Pam Bondi Will Be the Next Attorney General
2 days ago 00:03:33 1
Trump Held Fundraiser for Attorney General After She Dropped Trump University Investigation
2 days ago 00:28:57 1
Правда о Самом Опасном Астероиде / Необъяснимые объекты в галактике / Астрообзор #175
3 days ago 00:01:13 1
TABLE TENNIS FTW!
6 days ago 00:03:02 2
What is love (Rastafair Remix) Tomorrowland Videoclip
6 days ago 00:17:15 7
Comment avoir des petits FRUITIERS GRATUITS en illimité
1 week ago 00:03:20 5
Monster Hunter Wilds: 6th Trailer | Into the Iceshard Cliffs
1 week ago 00:08:00 16
Dream Theater - Midnight Messiah (Official Video)
3 weeks ago 00:11:39 1
Highlights Women’s 60m Heats | Istanbul 2023
3 weeks ago 01:32:44 7
Phonk Music Mix ※ Badass Playlist of Aggressive Phonk ※ Фонк 2025
3 weeks ago 00:10:17 2
DRIFTERZ – THE BEGINNING: PART 1 | TIL SCHWEIGER | Official Action Movie 2025 | 4K ULTRA HD
4 weeks ago 00:01:54 2
[4K USA] Red Mesh Transparent Dresses Try on Haul with Blondy Bella
4 weeks ago 00:29:33 1
7 Ghost Videos SCARIER Than Pocket Dialing Your Ex
4 weeks ago 00:55:40 1
Greatest Hits Of All Time The Beatles (The Beatles Best Performance Live)
1 month ago 00:02:43 1
Rīċa Ēastlēah - Never gonna give you up Cover In Old English. Bardcore/Medieval style
1 month ago 00:02:09 1
[Ep 4 Preview] Worried Lee Min-ho, imperiled Kong Hyo-jin | When the Stars Gossip | Netflix [ENG]
1 month ago 00:06:45 1
Tedy to Mix Disney Slime | Slime Story | 29
1 month ago 00:08:19 1
Laid Back - White Horse (Moreno J Remix)
1 month ago 00:03:07 1
Scary Movie: Wazzup! (HD CLIP)
1 month ago 00:24:57 1
TF2 players when they use 100% of their brain
1 month ago 00:20:33 1
Russia Reveals Insane New AI Fighter Jet & SHOCKS The US!
1 month ago 00:02:43 1
Addison Rae - Aquamarine (Official Video)
1 month ago 00:24:26 1
UPDATE: Using GG MAX for over a Week now - My newest discoveries and thoughts.