KDD 2021 invited talk: It is time for deep learning to understand its expense bills by Eric Xing
In the past several years, deep learning has dominated both academic and industrial R&D over a wide range of applications, with two remarkable trends: 1) developing and training ever larger “all-purpose” monster models over all data possibly available, with a astounding 10,000x parameter number increase in recent 3 years; 2) developing and assembling end-to-end “white-boxes” deployments with ever larger number of component sub-models that need to be highly customized and interoperative. Progresses made to the leaderboards or featured in news headlines are highlighting metrics such as saliency of content production, accuracy on labeling, or speed of convergence, but a number of key challenges impacting the cost effectiveness of such results, and eventually the sustainability of current R&D efforts in DL, are not receiving enough attention: 1) For large models, how many lines of code outside of the DL model are need to parallelize the computing over a computer cluster? (2) Which/How many hardware resources to u
1 view
31
8
3 months ago 00:00:24 1
2 terrorists killed by security forces in Kupwara, J&K | DD India
9 months ago 00:06:51 1
Где похоронен Вилли ТОКАРЕВ? Как найти могилу Вилли ТОКАРЕВА.
12 months ago 00:44:44 1
Nachtstreife - Rausch und Randale | Folge 1/Staffel 2 | SWR Doku
1 year ago 00:44:51 1
Nachtstreife - Suche in der Dunkelheit | Folge 2/Staffel 2 | SWR Doku
2 years ago 00:04:50 1
«Возвращайся»
2 years ago 00:03:01 1
Два огня
3 years ago 01:02:04 1
2021-12-25 ИЯФ-КДД 2:1
3 years ago 01:00:56 2
2021-12-18 Домино2-КДД 3:1
3 years ago 01:02:19 1
2021-12-12 КВУ-КДД 0:4
3 years ago 00:53:09 1
2021-12-05 Локо-КДД 4:1
3 years ago 00:06:23 6
«Белое безмолвие»
3 years ago 00:02:19 2
«TTV» Церемония награждения
3 years ago 00:02:57 1
«Фортепианный ансамбль»
3 years ago 00:40:01 1
KDD 2021 invited talk: It is time for deep learning to understand its expense bills by Eric Xing
3 years ago 00:15:45 2
STUDIO VLOG 14 новые наборы с кактусами, первая страничка ДД
3 years ago 00:04:36 2
Object-550 - CE-5: KDD. Live @ When Summer Calls 2021
3 years ago 00:03:33 5
Праздник посёлка 2021
3 years ago 01:33:12 1
Charlie Sheen | Sober living, “Tigers Blood“, “Winning“, Two and a Half Men and The Road To Recovery
4 years ago 00:04:56 11
Object-550 - CE-5: KDD. United Metal Forces festival. Alcatraz. NN. 06/14/2021
4 years ago 01:58:49 18
VI фестиваль казачьей культуры «Холковский сполох»
4 years ago 00:01:57 1
Ax1Le - MVP of IEM Summer 2021
4 years ago 00:04:58 15
Object-550 - CE-5: KDD. Live in Vagabond MC. Sarov. 04/24/2021