Advanced level · Module 6: AI Capstone Project · Lesson 2 of 5
Building the System
Build the system with retrieval, tools, permissions, logging and offline fallbacks.
In this lesson you will
- Implement the designed system
- Track quality and cost while building
Key concepts
retrievaltools and permissionsloggingfallbacks
The lesson
Implement retrieval over the approved documents, the tools with permissions and approval steps, logging and the offline fallback.
Run the evaluation set regularly while building to catch regressions early, and track cost per task.
Keep prompts, configuration and evaluation data in version control.
Step by step
- Implement retrieval and tools.
- Add permissions, approvals and logging.
- Add the offline fallback.
- Run the evaluation set.
Practice activity
Complete milestone 2: the working system.
Expected result: A working system with evaluation results and cost tracking.
Check your understanding
-
Why run the evaluation set during building?
Show answer
To catch regressions early.
-
What belongs in version control besides code?
Show answer
Prompts, configuration and evaluation data.
Taught live by an instructor — online or in person. Free course lessons are for self-study and do not lead to a certificate — see registration options.