So How Does ChatGPT really work? Behind the screen!
Claim your SPECIAL OFFER for MagellanTV here: Start your free trial TODAY so you can watch “Tech Talk“ about new technologies transforming out planet:
FOLLOW UP VIDEO:
For Input on Videos and Early Access, Join Me here:
REFERENCES
The subject of video:
Detailed overview of how ChatGPT works:
ChatGPT facts:
CHAPTERS:
0:00 What is ChatGPT?
1:33 Magellan offer
2:31 How ChatGPT differs from Google
4:26 Overview of how ChatGPT works
7:07 Simple example of what happens behind the scenes
9:45 Beyond sentence completion
10:21 Three stages of pre-training process
13:24 The huge dataset used
SUMMARY
ChatGPT is an intelligent chatbot that uses natural language processing. The GPT stands for Generative Pre-trained Transformer, which means it generates responses, it is pre-trained by humans, and it transforms input data into an output. This model was created by an artificial intelligence research company called OpenAI.
ChatGPT’s power is the ability to interpret the context and meaning of a query and produce a relevant answer in grammatically correct and natural language, based on the information that it has been trained on.
It uses neural networking, with supervised learning and reinforcement learning, two key components of modern machine learning. What it does fundamentally is predict what words, phrases and sentences are likely to be associated with the input made. It then chooses the words and sentences that it deems most likely to be associated with the input. So it attempts to understand your prompt and then output words and sentences that it predicts will best answer your question, based on the data it was trained on.
It also randomizes some outputs so that the answers you get for the same input, will often be different. How ChatGPT fundamentally works, is that it tries to determine what words would most likely be expected after having learned how your input compares to words written on billions of webpages, books, and other data that it has been trained on.
But it’s not like the predictive text on your phone that’s just guessing what the word will be based on the letters it sees. ChatGPT attempts to create fully coherent sentences as a response to any input. And it doesn’t just stop at the sentence level. It’s generating sentences and even paragraphs that could follow your input.
If you ask it complete this sentence, “Quantum mechanics is…” -- The processing that happens behind the scenes goes something like this: It calculates from all the instances of this text, what word comes next, and at what fraction of the time. It doesn’t look literally at text, but it looks for matches in context and meaning.
The end result is that it produces a ranked list of words that might follow, together with their “probabilities.” So it’s calculations might produce something like this for the next word that would follow after the word “is”:
a 4.5%
based 3.8%
fundamentally 3.5%
described 3.2%
many 0.7%
It chooses the next word based on this tanking.
But the sentence completion model is not enough, because you might ask it to do something where that strategy might not be appropriate.
In the first stage of the training process, Human contractors play the role of both a user and the ideal chatbot. Each training consists of a conversation with the goal of training the model to have human-like conversations.
Through this supervised human-taught process, it learns to come up with an output that is more than just sentence completion. It learns patterns about the context and meaning of various inputs so that it can respond appropriately.
But human training has scale limitations. Human trainers could not possibly anticipate all the questions that could ever be asked. For this it uses a third step which is called reinforcement learning. This is a type of unsupervised learning. This process trains the model where no specific output is associated with any given input.
Instead the model is trained to learn the underlying context and patterns in the input data based on its earlier human-taught pretraining.
#chatgpt
This way the model can process a huge amount of data from various sources, and learn the patterns from texts and sentences of a near limitless number of subjects. The dataset used to train ChatGPT which is based on GPT-3.5 is about 45 terabytes of data.
1 view
340
93
7 months ago 00:04:19 1
Al Bano & Romina Power - Liberta
7 months ago 00:03:18 1
Осторожно! Ядовитый рис скоро поступит на прилавки магазинов страны | Берегите детей от отравы
7 months ago 01:02:16 1
Burn 600 Calories in a 60-Minute Workout With Jeanette Jenkins
7 months ago 00:02:52 1
The Beatles - When I’m Sixty Four (Official Video)
7 months ago 00:05:54 1
Shakira - Nothing Else Matters/Despedida Medley (Live from Paris)
7 months ago 00:00:10 1
Video title!1384215420
7 months ago 00:29:47 1
The Most Sinister Bands In Black Metal
7 months ago 00:05:24 1
This is the MOST DELICIOUS I’ve ever eaten! The tastiest eggless eggplant recipe! [Vegan]
7 months ago 00:02:06 1
If Sans played saxophone... (Sans Theme cover ft. Logan Moore!)
7 months ago 00:06:06 1
Как ПРОСТО вплести ленту в косу из 3 прядей бесплатный урок по плетению 5-прядная #коса с 2 лентами
7 months ago 00:14:47 1
ПРИНЯЛСЯ В БАНДУ, ПЕРВЫЙ УГОН АВТО. ПУТЬ К ВЕРШИНЕ ГЕТТО #2 (RADMIR RP / HASSLE ONLINE)
7 months ago 00:04:41 1
Buena Vista Social Club - Chan Chan (Official HD Video)
7 months ago 00:06:10 1
Милые Гномики в Шапочках из Пряжи 🧶 Делаю за 5 минут 🤗 Pompom Gnome making idea 💛 DIY NataliDoma
7 months ago 00:03:54 1
IMAGINE. (Ultimate Mix, 2020) - John Lennon & The Plastic Ono Band (with the Flux Fiddlers) HD
7 months ago 00:29:25 1
Вяжем ПОТРЯСАЮЩИЙ КОВЕР из ОСТАТКОВ ПРЯЖИ 💜🧡💛🤎 / МАСТЕР-КЛАСС! / HOW TO CROCHET BEAUTIFUL CARPET
7 months ago 00:03:56 1
Simon Khorolskiy – Белая ворона (Official Audio)
7 months ago 00:08:46 1
FITS ALL SIZES 💥 My grandma taught me very easy method! Sewing shalwar pants
7 months ago 00:03:50 1
Bring Me The Horizon - Obey with YUNGBLUD (Official Video)
7 months ago 00:07:29 1
Why These Chocolate Balls Are Named After Famous Composer Mozart | Tasty Legacies Ep. 3
7 months ago 00:03:36 1
GODS ft. NewJeans (뉴진스) Worlds Anthem 2023 Rock Cover (League of Legends)
7 months ago 00:01:17 1
Bangsar Penthouse For Sale || #Stanproperty. com
7 months ago 00:05:09 1
LP - Lost On You [Live Session]
7 months ago 00:10:30 1
Dainty Rings With Beads and Crystals (wire wrapping rings) DIY Rings, Stacking Rings
7 months ago 00:15:43 1
Three Variants of Tempting Dishes with Carp! From Royal Cooking