Patreon:
Discord:
In this special edition episode, we have a conversation with Prof. Noam Chomsky, the father of modern linguistics and the most important intellectual of the 20th century.
With a career spanning the better part of a century, we took the chance to ask Prof. Chomsky his thoughts not only on the progress of linguistics and cognitive science but also the deepest enduring mysteries of science and philosophy as a whole - exploring what may lie beyond our limits of understanding. We also discuss the rise of connectionism and large language models, our quest to discover an intelligible world, and the boundaries between silicon and biology.
We explore some of the profound misunderstandings of linguistics in general and Chomsky’s own work specifically which have persisted, at the highest levels of academia for over sixty years.
We have produced a significant introduction section where we discuss in detail Yann LeCun’s recent position paper on AGI, a recent paper on emergence in LLMs, empiricism related to cognitive science, cognitive templates, “the ghost in the machine” and language.
Panel:
Dr. Tim Scarfe
Dr. Keith Duggar
Dr. Walid Saba
Pod version:
00:00:00 Kick off
00:02:24 C1: LeCun’s recent position paper on AI, JEPA, Schmidhuber, EBMs
00:48:38 C2: Emergent abilities in LLMs paper
00:51:32 C3: Empiricism
01:25:33 C4: Cognitive Templates
01:35:47 C5: The Ghost in the Machine
02:00:08 C6: Connectionism and Cognitive Architecture: A Critical Analysis by Fodor and Pylyshyn
02:20:12 C7: We deep-faked Chomsky
02:29:58 C8: Language
02:34:34 C9: Chomsky interview kick-off!
02:35:32 Large Language Models such as GPT-3
02:39:07 Connectionism and radical empiricism
02:44:37 Hybrid systems such as neurosymbolic
02:48:40 Computationalism silicon vs biological
02:53:21 Limits of human understanding
03:00:39 Semantics state-of-the-art
03:06:36 Universal grammar, I-Language, and language of thought
03:16:20 Profound and enduring misunderstandings
03:25:34 Greatest remaining mysteries science and philosophy
03:33:04 Debrief and ’Chuckles’ from Chomsky
References;
(Currently incomplete, we will add to this)
LeCun Path to Autonomous AI paper
Tim’s marked up version:
Emergent Abilities of Large Language Models [Wei et al] 2022
Connectionism and Cognitive Architecture: A Critical Analysis [Fodor, Pylyshyn] 1988
Ghost in the machine
(thanks to user tikwidd for your analysis)
Noam Chomsky in Greece: Philosophies of Democracy (1994) [Language chapter]
Richard Feynman clip
Chomsky Bryan Magee BBC interview:
Randy Gallistel’s work (question 3)
Helmholtz “NNs : they’ve damn slow”
Purkinje cells
Barbara Partee
Iris Berent
Penrose Orch OR
Alan Turing “Systems of Logic Based on Ordinals”
CAS/Turing/Turing-1939 Sysyems of logic based on
://
Fodor “The Language of Thought”
Least Effort
structure dependence in grammar formation
three models
Darwin’s problem
Descartes’s problem
–body_problem
Control Theory
(linguistics)
Thanks;
Thanks to Pikachu for helping us get the Chomsky NVidia Tacotron 2 model working 😍.
4 views
3
0
10 months ago 01:43:34 1
Ученица Мессинга - 1-2 серии мелодрама
10 months ago 00:03:16 1
Kate Bush - Wuthering Heights - TOTP - 1978 [Remastered]
10 months ago 00:33:33 1
Die Flache Erde - Eine Selbstschussanlage im Garten Eden? [Eines Nachts in der Badewanne]
10 months ago 00:40:45 1
ИМЕЮЩИЕ ДУШУ БОГА ТВОРЦА ПРОЯВИТЕ СВОЮ СИЛУ ⚡️@novoe_probujdene_chelovchestva
10 months ago 01:12:33 1
Пресс-конференция С.Лаврова по итогам недели высокого уровня 78-й сессии Генеральной Ассамблеи ООН
10 months ago 00:06:50 1
Сильное и слабое сознание.
10 months ago 00:02:46 1
Детuшкu очень любят😍 Вам тоже понравится
10 months ago 00:13:38 1
Белгород Поселение Родовых Поместий Серебряный Бор Белгородская область Возрождение Руси 2022
10 months ago 00:56:12 1
. Человек внутри фантома
10 months ago 00:05:30 1
Когда есть селёдка, всегда готовлю ЭТОТ САЛАТ ЗА ДВЕ МИНУТЫ. Лучше шубы!
10 months ago 00:01:03 1
Удачная жизнь (78)
10 months ago 00:23:23 1
Comment ne pas mourir de faim ? Stock Moyen/Long terme.
10 months ago 00:06:54 1
Первообразная. 11 класс.
10 months ago 00:05:07 1
Много Чего Готовила и пробовала но всегда повторяю этот рецепт!Воздушное тесто как пух!Пышные Пиццы.
10 months ago 00:00:50 1
Scorpions - He’s a Woman - She’s a Man (Live in Atlanta) (July 4, 1980)
10 months ago 04:07:14 1
HISTORICAL CONCERT! Paganini 6 VIOLIN CONCERTOS in 1 evening by heart!
10 months ago 05:26:39 1
Jazz & Bossa Nova - Covers Of Popular Songs (5 Hours)
10 months ago 02:50:37 1
Высокий блондин в чёрном ботинке. дилогия (1972-1974)
10 months ago 00:05:07 2
Танец Макса и Элен (cериал “Дневник Элен“ 275 серия / 78 серия 2 сезон)
10 months ago 00:06:28 1
Никого не посадили. Из отдела полиции пропало 10 килограммов наркотиков
10 months ago 00:15:23 1
Номенклатура и изомерия алканов. 10 класс.
10 months ago 00:06:01 1
ПОДСКАЗАЛА БАБУЛЬКА - КОТОРАЯ В 78 ИЗБАВИЛАСЬ ОТ ХОЛКИ
10 months ago 05:06:29 1
МИХАИЛ КРУГ - ВСЕ ХИТЫ КОРОЛЯ РУССКОГО ШАНСОНА | ЛУЧШИЕ ПЕСНИ РЕМАСТЕРИНГ | 60 Лет Юбилейный Альбом
10 months ago 00:10:03 1
КУРИНЫЕ НОЖКИ В СЛИВОЧНО-ЧЕСНОЧНОМ СОУСЕ С СЫРОМ И ШПИНАТОМ