A Review of Learning Rules in Machine Learning - March 8, 2021
In this research meeting, our research intern Alex Cuozzo reviews some notable papers and explains high level concepts related to learning rules in machine learning. Moving away from backpropagation with gradient descent, he talks about various attempts at biologically plausible learning regimes which avoid the weight transport problem and use only local information at the neuron level. He then moves on to discuss work which infers a learning rule from weight updates, and further work using machine learning to create novel optimizers and local learning rules.
Papers / Talks mentioned (in order of presentation):
• “Random synaptic feedback weights support error backpropagation for deep learning“ by Lillicrap et al.:
• Talk: A Theoretical Framework for Target Propagation:
• “Decoupled Neural Interfaces using Synthetic Gradients“ by DeepMind:
• Talk: Brains@Bay Meetup (Ra
3 views
11
3
1 month ago 00:13:18 1
крутим коробки на новых агентах Warface
1 month ago 00:12:05 1
ZenBusiness Review 2024: What Makes It Stand Out?
1 month ago 00:12:48 1
The Brand New STIHL MS400.1! WHY is this CHAINSAW different?
1 month ago 00:08:10 1
AI Agents Will Create MILLIONAIRES in 2025 – Are You Ready
1 month ago 00:03:04 1
Arena Of Valor Hack - How to Get Unlimited Vouchers! iOS Android
1 month ago 00:13:15 1
BREAKING: MASS EXODUS Of Soldiers Rock IDF After BLOODIEST DAY EVER in Lebanon
1 month ago 00:41:19 1
Предсмертный рёв уходящего класса. Что нам готовят хозяева мировой игры. Андрей Фурсов
1 month ago 00:00:00 1
THE LOST CHILDREN Netflix Documentary Review (2024)
2 months ago 00:04:27 1
Botsol vs. Leads Sniper: Email Extractor Showdown 🔥
2 months ago 00:04:28 1
💸 HOW TO ALWAYS WIN AND PROFIT ON CRASH ROOBET! BEST ROOBET CRASH STRATEGY! ROOBET PROMOCODE 2024 💸
2 months ago 00:20:02 1
NEW Thermaltake TH360 V2 Ultra ARGB Sync AIO CPU Water Cooler With IPS LCD Screen
2 months ago 00:03:07 1
Cooking Madness Hack - How I Got Unlimited Diamonds & Coins iOS/Android 2024
2 months ago 01:00:07 1
Shreeman Narayan Bhjan - श्रीमन् नारायण नारायण हरे हरेNONSTOP-2024
2 months ago 00:42:19 1
КУПИЛ АВТОБУС ИЗ ДЕТСТВА И ПОЕХАЛ НА ДАЛЬНЯК. ЛИАЗ 677.
2 months ago 00:37:03 4
Demonic Toys (and a lil’ more Puppet Master) - re:View
2 months ago 00:17:17 1
Diana Ankudinova - Can’t Help Falling In Love (Live) First Time Hearing | REVIEWS AND REACTIONS
2 months ago 00:10:50 1
Best LLC Services of 2024: Watch Before You Buy!
2 months ago 00:04:40 1
Joint Special Operations Command(.) (GTAV PS4 MilSim on Discord)
2 months ago 00:46:09 2
I do not recommend: ’Dragon Age: The Veilguard’ (Review)
2 months ago 00:04:01 1
Pearl Park Beach Resort Neil Island by Experience Andamans
2 months ago 00:15:01 1
Inside the World’s Largest AI Supercluster xAI Colossus
2 months ago 00:41:45 1
Dragon Age: The Veilguard - Review After 100%
2 months ago 00:15:23 2
Ivermectin and Cancers
2 months ago 00:05:16 1
NEW! Animal Instinct, Jay Leno ’99 w/Transformed Audio/Video (The Cranberries