Fine-tuning LLMs#
This example is based on this language modeling example from the HuggingFace transformers documentation.
To better understand what's going on in this example, it is a good idea to read through these tutorials first: * Causal language modeling simple example - HuggingFace docs * Fine-tune a language model - Colab Notebook
The main difference between this example and the original example from HuggingFace is that the LLMFinetuningExample is a LightningModule, that is trained by a lightning.Trainer.
This also means that this example doesn't use accelerate or the HuggingFace Trainer.