🧑‍🏫 Instruction Tuning Vol. 1

NLP and ML have gone through several phases of how models are trained in recent years. With the arrival of pre-trained models such as BERT, fine-tuning pre-trained models for downstream tasks became the norm. The increasing capabilities of ever larger models then enabled in-context learning via prompting. Recently, instruction tuning has become the newest method to make LLMs useful in practice.In this edition, we will cover some of the most popular datasets for instruction tuning. The next editi...