In this chapter, students will delve into the intricacies of transformer-based architectures, which have revolutionized the field of language modeling.