Text classification

Example algorithm that can train a huggingface model.

Also check out this link for more detailed example script:

https://github.com/lebrice/mila-docs/blob/llm_training/docs/examples/distributed/LLM_training/main.py

TextClassificationDataModule

Bases: LightningDataModule

Lightning data module for HF text classification datasets.

This is based on this tutorial: https://lightning.ai/docs/pytorch/stable/notebooks/lightning_examples/text-transformers.html