StudyToCert

All certifications / Azure AI Fundamentals / Lessons

Microsoft Certified: Azure AI Fundamentals AI-900 · Domain 5: Generative AI workloads on Azure

How large language models generate text: tokens, next-token prediction and pretraining

▶ Watch the overview video

Last reviewed September 25, 2026 · Leer en español

Large language models (LLMs) are the engines behind most generative AI. They are transformer-based neural networks with billions of parameters, trained on enormous amounts of text. Understanding how they produce text explains both what they are good at and why they sometimes get things wrong.

Free account

Keep reading for free

Create a free StudyToCert account to read the rest of this lesson: 5 more sections, 4 key terms, a real-world example, an exam tip and self-check questions. Every lesson, lab and practice test is free with an account.

Sign up free Log in

Study Azure AI Fundamentals for free
A week-by-week plan with every lesson, quizzes, checkpoint tests, a practice exam and hands-on labs.
Open the Azure AI Fundamentals study plan