Section 7: Lab: Application Design and Prompt Engineering
- Model selection criteria: cost, modality, latency, language and the effect of temperature
- Zero-shot, few-shot, chain-of-thought, prompt templates and Bedrock Prompt Management
- Risks: prompt injection, jailbreaking, poisoning and data exposure
- Lab: tune prompts and inference parameters for a document summary task
Section 8: Lab: RAG with Amazon Bedrock Knowledge Bases
- What RAG is, how it reduces hallucination and where it fits in business
- Vector stores on AWS: OpenSearch Service, Aurora, RDS for PostgreSQL, Neptune and S3 Vectors
- Cost trade-offs of pre-training, fine-tuning, in-context learning, RAG and distillation
- Lab: build a knowledge base from documents in S3, ask questions with citations, then clean up
Section 9: Fine-Tuning and Model Evaluation
- Pre-training, fine-tuning, continued pre-training, instruction tuning and RLHF
- Preparing fine-tuning data: quality, size, labelling and governance
- Metrics: ROUGE, BLEU, BERTScore, LLM-as-a-judge and human evaluation
- Workshop: choose how to evaluate a RAG application or agent against business goals
Section 10: Lab: Responsible AI and Amazon Bedrock Guardrails
- Responsible AI principles: fairness, inclusivity, robustness, safety and veracity
- Risks around intellectual property, bias and trust in model output
- Transparency and explainability with SageMaker Model Cards and SageMaker Clarify
- Lab: create a guardrail that blocks denied topics and harmful content and masks personal data
Section 11: Security, Compliance and Governance
- The shared responsibility model, IAM, AWS KMS, Macie and PrivateLink for AI workloads
- AgentCore Identity and Policy in AgentCore for controlling what agents can do
- Auditing with CloudTrail, Config, Inspector, Artifact and Trusted Advisor
- Data governance: lineage, retention, logging and grounding to reduce hallucination
Section 12: Workshop: Review and Exam Planning
- Key content summarised by the weighting of each domain
- Practise scenario-style questions and how to rule out wrong options
- Free AWS revision resources and a study plan for after the course
- Check and delete every resource in your AWS account before the course ends