Thanks to KiwiCo for sponsoring today’s video! Go to and use code WELCHLABS for 50% off your first month of monthly lines and/or for 20% off your first Panda Crate.
Activation Atlas Posters!
Special thanks to the Patrons:
Juan Benet, Ross Hanson, Yan Babitski, AJ Englehardt, Alvin Khaled, Eduardo Barraza, Hitoshi Yamauchi, Jaewon Jung, Mrgoodlight, Shinichi Hayashi, Sid Sarasvati, Dominic Beaumont, Shannon Prater, Ubiquity Ventures, Matias Forti
Welch Labs
Ad free videos and exclusive perks:
Watch on TikTok: @welchlabs
Learn More or Contact:
Instagram:
X:
References
AlexNet Paper
Original Activation Atlas Article- explore here - Great interactive Atlas!
Carter, et al., “Activation Atlas“, Distill, 2019.
Feature Visualization Article:
`Olah, et al., “Feature Visualization“, Distill, 2017.`
Great LLM Explainability work:
Templeton, et al., “Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet“, Transformer Circuits Thread, 2024.
“Deep Visualization Toolbox“ by Jason Yosinski video inspired many visuals:
Great LLM/GPT Intro paper
3B1Bs GPT Videos are excellent, as always:
Andrej Kerpathy’s walkthrough is amazing:
Goodfellow’s Deep Learning Book
OpenAI’s 10,000 V100 GPU cluster (1 exaflop)
GPT-3 size, etc: Language Models are Few-Shot Learners, Brown et al, 2020.
Unique token count for ChatGPT:
GPT-4 training size etc, speculative:
Historical Neural Network Videos
1 view
1185
362
17 hours ago 00:00:16 0
When the zebra decides to take revenge on the lion, who can stop him? #shorts #shortvideo #wildlife
4 days ago 00:00:00 0
Музыка Для Снятия Усталости
4 days ago 00:29:25 2
TOTAL IDIOTS AT WORK | Instant Regret Fails Compilation 2025 #347 | Best Fails of the Week
4 days ago 00:10:07 2
Moments Of Instant Karma Caught On Camera | Best Of The Week #42
4 days ago 00:03:18 0
[프레임 밖😎직캠모먼트/4K] 투모로우바이투게더(TXT) - Higher Than Heaven|VoiceCamMix|보이스캠 믹스
4 days ago 00:03:28 0
[프레임 밖😎직캠모먼트/4K] 투모로우바이투게더(TXT) - Love Language|VoiceCamMix|보이스캠 믹스
7 days ago 00:01:52 0
Eela Official Trailer | Indie Adventure/Horror Game | by Zalzar
1 week ago 00:00:19 1
Этот момент доказал, что Бог существует 🙏
1 week ago 00:03:28 0
Shaky Hands? Stormy Skies? Canon 18x50 Binocs Crush Blur, Fog & Distance Like a Navy SEAL Sniper - YouTube