Section 7: Lab: Function Calling with Business Data
- Let the agent call tools to check orders, book appointments and open tickets
- Answer from manuals and FAQs with RAG, keeping answers short for voice
- Keep talking while a tool runs so the caller is not left in silence
- Check permissions before revealing customer data
Section 8: Lab: Handover to Staff
- Handover triggers: the caller asks for a person, is upset, is out of scope, or the bot is unsure
- Summarise the context so staff can take over without the caller repeating themselves
- Transfer to a number or SIP address, or create a ticket or callback when nobody is free
- Lab: build a handover tool with a conversation summary
Section 9: Phone Numbers and Other Channels
- Connect a voice agent to a phone number through a SIP trunk or telephony provider
- The Realtime API over SIP and ready-made platforms such as ElevenLabs Agents
- Voice on the web and in apps over WebRTC
- Lab: demonstrate a call into the voice agent through a telephony trial service
Section 10: Guardrails, PDPA and Security
- Tell callers they are talking to AI and ask for consent before recording
- PDPA: keep only the audio and transcripts you need, mask personal data and set retention periods
- Defend against prompt injection and attempts to obtain other customers' data
- Stop the bot from promising anything that policy does not allow
Section 11: Lab: Testing, Measuring and Improving
- Test with simulated conversations, including angry callers, background noise and off-topic questions
- Metrics: latency, self-service resolution rate, handover rate and data accuracy
- Read transcripts and logs to find where the bot goes wrong
- Lab: test your own agent and refine its prompts and tools
Section 12: Workshop: Voice Agent Capstone
- Choose a brief: status enquiries, appointments or triage before transfer
- Design the conversation, the tools and the handover conditions
- Build and test end to end
- Give a live demo with a pilot plan and metrics