BERT classifier fine-tuning with PyTorch, HuggingFace, and Catalyst. Part 1. Intro

In the 1st part of the tutorial we describe the reusable BERT fine-tuning pipeline I’m sharing the pipeline that I actually use at work (that’s not a Kaggle Notebook anymore) which follows a modular approach, is easy to run and be reproduced. The follow-up parts of this tutorial cover: - data preparation for training, from CSV files to PyTorch DataLoaders - understanding the BERT classifier model by HuggingFace, digging into the code of the transformers library - running the pipeline with Catalyst and GPUs
Back to Top