In this video, we recount an incident that occurred at OpenAI while researchers were trying to finetune GPT-2 to be as helpful and ethical as possible. It’s narrated that inadvertently flipping a single minus sign led GPT-2 to become the embodiment of a well-known cardinal sin.
#ai #aisafety #alignment
▀▀▀▀▀▀▀▀▀SOURCES & READINGS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
OpenAI blog post:
OpenAI paper behind the blog post:
RLHF explainer on Hugging Face:
RLHF explainer on
Concrete Problems in AI Safety, by @RobertMilesAI:
▀▀▀▀▀▀▀▀▀PATREON, MEMBERSHIP, KO-FI▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🟠 Patreon:
🟢Merch:
🔵 Channel membership:
🟤 Ko-fi, for one-time and recurring donations:
▀▀▀▀▀▀▀▀▀SOCIAL & DISCORD▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Discord:
Reddit:
X/Twitter:
▀▀▀▀▀▀▀▀▀PATRONS & MEMBERS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Riley Matthews
Vladimir Silyaev
Nathanael Moody
Alcher Black
RMR
Nathan Metzger
Monadologist
Glenn Tarigan
NMS
James Babcock
Colin Ricardo
Long Hoang
Tor Barstad
Gayman Crothers
Stuart Alldritt
Chris Painter
Juan Benet
Falcon Scientist
Jeff
Christian Loomis
Tomarty
Edward Yu
Ahmed Elsayyad
Chad M Jones
Emmanuel Fredenrich
Honyopenyoko
Neal Strobl
bparro
Danealor
Craig Falls
Vincent Weisser
Alex Hall
Ivan Bachcin
joe39504589
Klemen Slavic
blasted0glass
Scott Alexander
noggieB
Dawson
John Slape
Gabriel Ledung
Jeroen De Dauw
Craig Ludington
Jacob Van Buren
Superslowmojoe
Michael Zimmermann
Nathan Fish
Bleys Goodson
Ducky
Bryan Egan
Matt Parlmer
Tim Duffy
rictic
marverati
Luke Freeman
Dan Wahl
Ken Mc
leonid andrushchenko
Alcher Black
Rey Carroll
William Clelland
ronvil
AWyattLife
codeadict
Lazy Scholar
Torstein Haldorsen
Supreme Reader
Michał Zieliński
뿌리와 가지있는 나무 connect
▀▀▀▀▀▀▀CREDITS▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Direction: Hannah Levingstone (@hannah_luloo)
Written by: Jai(@Laneless_) & :3
Line Producer & Production Manager: Kristy Steffens ()
Quality Assurance Lead: Lara Robinowitz (@CelestialShibe)
Animation:
Damon Edgson
Gabriel Diaz (@gabreleiros)
Ira Klages (@dux)
Keith Kavanagh (@johnnycigarettex)
Michela Biancini
Owen Peurois (@owenpeurois)
Colors Giraldo (@colorsofdoom)
Jordan Gilbert (@Twin_Knight/ Twin Knight Studios)
Zack Gilbert (@Twin_Knight/ Twin Knight Studios)
Neda Lay (@Nezhahah)
Background Art:
Hané Harnett (@thepeonyvibes)
Zoe Martin-Parkinson (@zoemar_son)
Compositing:
Renan Kogut (@kogut_r)
Patrick O’Callaghan (@)
Ira Klages (@dux)
Narrator:
Rob Miles
VO Editor:
Tony Dipiazza
Sound Design and Music:
Epic Mountain
23 views
102
20
6 days ago 01:01:39 1
TIME SLIP STORIES (SN 18 EP 38) TRUE UNEXPLAINABLE EXPERIENCES WITH MISSING TIME & TIME SLIPS
6 days ago 00:00:31 2
How To Train Your Dragon | Big Game Spot
1 week ago 00:42:52 1
The True Story Of The Philadelphia Experiment (Full Documentary)
1 week ago 00:04:31 3
Captain America Brave New World Trailer Spoof - TOON SANDWICH
2 weeks ago 00:04:58 2
My People Whom I Acknowledge | WMSCOG, Church of God
2 weeks ago 00:33:22 1
SCARY ENCOUNTER WITH A JUVENILE BIGFOOT
2 weeks ago 00:56:53 3
DOGMAN, MIRRORED MEN AND HIGHWAY GHOSTS: TALES FROM THE ROAD (SN 18 EP 36) TRUE SPOOKY STORIES
2 weeks ago 01:11:16 1
Ziggy Marley live | Rockpalast | 2018
2 weeks ago 00:04:47 1
Icon For Hire-Now You Know (Official Music Video)
2 weeks ago 00:01:29 1
Zebra Birth and First Steps in the Wild: A Miraculous Moment | WILDLIFE
3 weeks ago 00:44:14 1
CRAZY MAMA LOVE AND MADNESS: A TRUE STORY PERFORMED BY ACTOR, SINGER AND PERFORMER LINDA PURL