How to work with big data files (5gb+) in Python Pandas!
In this video, we quickly go over how to work with large CSV/Excel files in Python Pandas. Instead of trying to load the full file at once, you should load the data in chunks. This is especially useful for files that are a gigabyte or larger. Let me know if you have any questions :).
Source code on Github:
Raw data used (from Kaggle):
I want to start uploading data science tips & exercises to this channel more frequently. What should I make videos on??
-------------------------
Follow me on social media!
Instagram |
Twitter |
TikTok | @keithgalli
-------------------------
If you are curious to learn how I make my tutorials, check out this video:
Practice your Python Pandas data science skills with problems on StrataScra
3 views
3
1
3 weeks ago 00:05:17 1
The Ultimate Email Extractor in 2024: YellowPages Scraper 🌎
3 weeks ago 00:03:55 1
Pokemon GO Joystick, Teleport, Auto Walk - How to Get Pokemon GO Spoofer iOS & Android 2024 FREE
3 weeks ago 00:12:05 1
ZenBusiness Review 2024: What Makes It Stand Out?
3 weeks ago 00:04:14 1
Paramore: Decode [OFFICIAL VIDEO]
4 weeks ago 02:01:18 1
Half-Life 2: 20th Anniversary Documentary
4 weeks ago 00:36:24 2
Best of the Worst Trivia!
4 weeks ago 00:03:07 1
Delta Executor iOS iPhone Android NO KEY - Roblox Script Executor Mobile NEW UPDATE 2024
4 weeks ago 00:03:04 1
Bach, Organ Sonata No. 4 in E minor (BWV 528) 3. Un poco Allegro.
4 weeks ago 00:04:49 1
Play To Earn🔥This New Play to Earn Game is About to Make a Lot of People RICH
4 weeks ago 00:03:04 1
Arena Of Valor Hack - How to Get Unlimited Vouchers! iOS Android