Skip to main content

PS9594: Computational Text Analysis

10 Week 10: Encoder-Only LLMs

Slides

  • 10 Encoder-Only LLMs (link to slides)

10.1 Using Fine-Tuned Models

Before we fine-tune our own models, let’s play a bit with previously fine-tuned models, see how they work, and get an intuition to the workflow. Here is the link.

10.2 Fine-Tuning a Model

Ok, now we can fine-tune our own model. Here is the link.

10.3 Further Pre-Training a Model

Finally, we can also further pre-train a model (to then fine-tune it). Here is the link for that.