But what is a neural network? | Chapter 1, Deep learning
What are the neurons, why are there layers, and what is the math underlying it?
Help fund future projects:
Written/interactive form of this series:
Additional funding for this project provided by Amplify Partners
Typo correction: At 14 minutes 45 seconds, the last index on the bias vector is n, when it’s supposed to in fact be a k. Thanks for the sharp eyes that caught that!
For those who want to learn more, I highly recommend the book by Michael Nielsen introducing neural networks and deep learning:
There are two neat things about this book. First, it’s available for free, so consider joining me in making a donation Nielsen’s way if you get something out of it. And second, it’s centered around walking through some code and data which you can download yourself, and which covers the same example that I introduce in this video. Yay for active learning!
I also highly recommend Chris Olah’s blog:
For more videos, Welch Labs also has some great series on machine learning:
For those of you looking to go *even* deeper, check out the text “Deep Learning“ by Goodfellow, Bengio, and Courville.
Also, the publication Distill is just utterly beautiful:
Lion photo by Kevin Pluck
-----------------
Timeline:
0:00 - Introduction example
1:07 - Series preview
2:42 - What are neurons?
3:35 - Introducing layers
5:31 - Why layers?
8:38 - Edge detection example
11:34 - Counting weights and biases
12:30 - How learning relates
13:26 - Notation and linear algebra
15:17 - Recap
16:27 - Some final words
17:03 - ReLU vs Sigmoid
Correction 14:45 - The final index on the bias vector should be “k“
------------------
Animations largely made using manim, a scrappy open source python library.
If you want to check it out, I feel compelled to warn you that it’s not the most well-documented tool, and has many other quirks you might expect in a library someone wrote with only their own use in mind.
Music by Vincent Rubinetti.
Download the music on Bandcamp:
Stream the music on Spotify:
If you want to contribute translated subtitles or to help review those that have already been made by others and need approval, you can click the gear icon in the video and go to subtitles/cc, then “add subtitles/cc“. I really appreciate those who do this, as it helps make the lessons accessible to more people.
------------------
3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to stay posted on new videos, subscribe, and click the bell to receive notifications (if you’re into that).
If you are new to this channel and want to see more, a good place to start is this playlist:
Various social media stuffs:
Website:
Twitter:
Patreon:
Facebook:
Reddit:
1 view
273
60
1 month ago 00:03:05 1
Void Of Vision - Decades
1 month ago 00:03:08 1
Numb (Official Music Video) [4K UPGRADE] – Linkin Park
1 month ago 00:02:23 1
Best Crypto Signals : Your Guide to Profitable Trading in 2024!
1 month ago 00:10:10 1
Dinner for few | Animated short film by Nassos Vakalis
1 month ago 00:04:48 1
John Legend - Preach (Official Video)
1 month ago 00:03:09 1
~In my Bones~ Simba x Kovu I
1 month ago 00:02:25 1
Inside Out 2 | Official Trailer
1 month ago 00:04:09 1
The Animals - House of the Rising Sun (1964) ♫ 60 YEARS 🎶⭐ ❤
1 month ago 00:25:00 1
PADLOCKED home was left TOO LONG and this is what it turned into
1 month ago 00:07:15 1
A Comment Game
1 month ago 00:03:26 1
Billie Eilish - bad guy
1 month ago 00:02:51 1
Sabrina Carpenter – Bed Chem (Lyrics)
1 month ago 00:59:38 1
The DARK Truth About Islamism & Mass Immigration - Det. Peter Bleksley (4K) | heretics. 93
1 month ago 00:03:23 1
K/DA - POP/STARS (ft. Madison Beer, (G)I-DLE, Jaira Burns) | Music Video - League of Legends
1 month ago 00:04:46 1
Отава Ё – Сумецкая (русские частушки под драку) Otava Yo - russian couplets while fighting
1 month ago 00:03:42 1
Daisy Gray - Wicked Game (Official Tribute Video)
1 month ago 00:04:15 1
PAIN - Shut Your Mouth (OFFICIAL MUSIC VIDEO)
1 month ago 00:05:12 1
Summer Wine (Cover) - Tyrannocaster
1 month ago 00:04:43 1
TUNGSTEN - The Grand Inferno (Official Music Video)
1 month ago 00:12:02 1
RUSSIA’S REACTION: WHAT EXPLODED IN TOROPETS AMMO DEPOT? Vlog 810: War in Ukraine
1 month ago 00:17:17 1
CAUGHT: NYC Covid Czar Admits Forcing Vaccines & Having Drug-Fueled Sex Parties
1 month ago 00:45:04 1
The Return of the Anunnaki Movie | Ancient Gods Return
1 month ago 00:03:54 1
Down AKA Kilo - Lean Like A Cholo (Official Music Video)
1 month ago 01:39:57 1
Michael Moore Presents: Planet of the Humans | A Film by Jeff Gibbs | Full Documentary