The transformer is the neural network architecture behind today's language models, including the GPT family used in Azure OpenAI. AI-900 expects you to know its main ideas at a conceptual level: tokens, embeddings and attention.
Free account
Keep reading for free
Create a free StudyToCert account to read the rest of this lesson: 5 more sections, 4 key terms, a real-world example, an exam tip and self-check questions. Every lesson, lab and practice test is free with an account.