Thanks to KiwiCo for sponsoring today’s video! Go to and use code WELCHLABS for 50% off your first month of monthly lines and/or for 20% off your first Panda Crate.
Activation Atlas Posters!
Special thanks to the Patrons:
Juan Benet, Ross Hanson, Yan Babitski, AJ Englehardt, Alvin Khaled, Eduardo Barraza, Hitoshi Yamauchi, Jaewon Jung, Mrgoodlight, Shinichi Hayashi, Sid Sarasvati, Dominic Beaumont, Shannon Prater, Ubiquity Ventures, Matias Forti
Welch Labs
Ad free videos and exclusive perks:
Watch on TikTok: @welchlabs
Learn More or Contact:
Instagram:
X:
References
AlexNet Paper
Original Activation Atlas Article- explore here - Great interactive Atlas!
Carter, et al., “Activation Atlas“, Distill, 2019.
Feature Visualization Article:
`Olah, et al., “Feature Visualization“, Distill, 2017.`
Great LLM Explainability work:
Templeton, et al., “Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet“, Transformer Circuits Thread, 2024.
“Deep Visualization Toolbox“ by Jason Yosinski video inspired many visuals:
Great LLM/GPT Intro paper
3B1Bs GPT Videos are excellent, as always:
Andrej Kerpathy’s walkthrough is amazing:
Goodfellow’s Deep Learning Book
OpenAI’s 10,000 V100 GPU cluster (1 exaflop)
GPT-3 size, etc: Language Models are Few-Shot Learners, Brown et al, 2020.
Unique token count for ChatGPT:
GPT-4 training size etc, speculative:
Historical Neural Network Videos
2 views
203
176
5 months ago 00:13:17 1
Короткометражный фильм “Муза“(2020 ) / Short movie “Muse“ (2020)
5 months ago 00:04:51 1
Dååth - Ascension (Official Video)
5 months ago 00:06:46 1
Yeh Hum Aa Gaye Hain Kahaan Song | Veer-Zaara, Shah Rukh Khan, Preity Zinta, Lata Mangeshkar, Udit N
5 months ago 01:02:49 1
The Heart of Reiki by Merlin’s Magic - Relaxing music take you to the deepest centers of energy
5 months ago 00:33:04 1
Zendaya & Andrew Garfield | Actors on Actors - Full Conversation
5 months ago 00:03:11 1
“I AM the resurrection and the life.” (Season 4 Scene)
5 months ago 00:00:24 1
[edit] Uh Oh 💛 ScaraLumi | Wanderer & Lumine
5 months ago 01:04:21 1
Calming Meditation | 1 hour handpan music | Malte Marten
5 months ago 00:24:49 1
ANGELINA JORDAN 10 Years In The Making
5 months ago 00:00:00 1
[The Body Regenerates After 14 Minutes] 🦴️ Healing with 432Hz + 528Hz Sound Therapy + Alpha Waves #2
5 months ago 00:00:38 1
Estas Tonne | Cosmic Fairytale: Dimensions (2014)
5 months ago 00:05:29 1
Шри Чинмой говорит о Беге Мира
5 months ago 00:04:12 1
In This Moment - “Roots“ [Official Video]
5 months ago 00:00:00 1
Gentle Blues Music - Tracing the Evolution of Blues Through Soul-Stirring Melodies | Blues Reverie
5 months ago 01:43:31 1
Tchaikovsky - The Nutcracker, Ballet in two acts | Mariinsky Theatre (HD 1080p)
5 months ago 00:00:54 1
Video Lucu 🤣🤣🤣 #short #lucu #ngakak
5 months ago 00:04:12 1
In Hearts Wake - Farewell (Official Music Video)
5 months ago 01:00:45 1
Watching the Waves: Smooth Jazz & Chillout Music for Relaxation with Peter Pearson
5 months ago 00:17:28 1
Еvil Sailor 2.0 Смешные Тик Ток Аниме Моменты (ч.143) / ТЕСТ НА ПСИХИКУ / ЗАСМЕЯЛСЯ ПОДПИСАЛСЯ
5 months ago 00:00:27 1
Katy Perry goes viral for mid-concert eye ‘glitch’ | USA TODAY #Shorts
5 months ago 00:04:01 1
Mzade - Aтмосферу
5 months ago 00:29:23 1
UNE UNION DE LA DISSIDENCE EST-ELLE POSSIBLE ? | RICHARD BOUTRY | GÉOPOLITIQUE PROFONDE
5 months ago 00:31:23 1
ALBERTA FERRETTI Milan Spring Summer 1993 - Fashion Channel