
Build and evaluate a retrieval workflow
Description
About Build and Evaluate a Retrieval Workflow: Evidence Before Confidence
This is a live, interactive session hosted by AumOS, designed specifically for individuals interested in the technical aspects of a retrieval workflow. Scheduled to take place online, this 90-minute event offers both guided and observer participation levels, making it accessible to various levels of engineering expertise. The session's primary focus is on inspecting a small retrieval workflow and testing its accuracy against provided documents.
What Is It About?
The session revolves around a hands-on experience with a retrieval workflow. Participants will engage in inspecting the workflow and evaluating whether the answers given by the system are supported by the referenced documents. This practical approach ensures participants not only learn the theoretical aspects of retrieval workflows but also gain valuable experience in validating them.
Key Topics
• Retrieval workflow inspection
• Evidence evaluation
• Practical application using Python/Git (optional)
What Can You Expect?
Participation in this session includes a worked example, exercises, discussions, and opportunities for questions. The event emphasizes practical, hands-on learning, with attendees receiving a set of documents, questions, expected evidence, and an evaluation worksheet as takeaways. All activities are conducted using public, synthetic, licensed, or authorized examples, ensuring the availability of resources and learning materials to everyone.
Things to Consider Before Attending
This workshop is free and open to everyone, regardless of geographic location. Since the event is conducted online, the link to the session will be shared with those who RSVP. It's beneficial to have a basic understanding of Python and Git if you choose the hands-on path; however, a guided observer path is also available for those who prefer it.
Let your network know you`re going
Share this event to start conversations, invite colleagues, and connect before it begins.











