Section 11: Lab: Evaluation, Tracing and Monitoring
- Evaluators for relevance, groundedness, quality and safety
- Tracing, token analytics and latency breakdowns with Application Insights
- Monitor performance, drift and safety events for models and agents
- Lab: run an evaluation question set and analyse agent errors from traces
Section 12: Lab: Responsible AI and Guardrails
- Safety filters, guardrails, risk detection and content moderation
- Defend against prompt injection, including instructions hidden in text within images
- Govern agents with oversight modes, constraints and tool access controls
- Lab: audit with trace logs, provenance metadata and approval workflows
Section 13: Lab: Generating and Editing Images and Video
- Generate images and videos from text prompts and reference media
- Edit images with inpainting, masks and text instructions
- Video editing workflows and visual policies such as watermarks and brand rules
- Lab: a product image pipeline with checks for inappropriate content
Section 14: Lab: Multimodal Understanding
- Analyse images with multimodal models and answer questions grounded in visual evidence
- Generate captions and alt text in line with accessibility guidelines
- Analyse video and identify objects with Content Understanding
- Lab: generate alt text automatically for website images
Section 15: Lab: Text Analysis, Speech and Document Extraction
- Extract entities, topics, summaries and JSON, and detect sentiment and sensitive content
- Translate with Azure Translator or an LLM and use speech as an agent modality
- OCR, layout and field extraction with Content Understanding analysers
- Lab: convert documents into structured Markdown for agents and RAG
Section 16: Workshop: Capstone and Exam Preparation
- Build an end-to-end agent with RAG, tools, guardrails and an approval step
- Measure it with evaluation and switch on tracing before hand-over
- Review against the AI-103 outline and try the free practice assessment
- Workshop: clean up resources and wrap up with a pre-production checklist