LLM Evals: RAGAS, DeepEval, and Automated Testing
«LLM Evals: RAGAS, DeepEval, and Automated Testing» è un corso online di RAG e AI engineering di livello intermedio, tenuto da InsightLearn Curated AI su InsightLearn. Il percorso comprende 8 lezioni organizzate in 3 sezioni, per una durata complessiva di 8h 0m. Build automated evaluation pipelines for LLM applications using RAGAS, DeepEval, and custom metrics.
- Docente: InsightLearn Curated AI
- Categoria: RAG e AI engineering
- Livello: intermedio
- Durata: 8h 0m
- Accesso: gratuito in questa fase di validazione, in cambio di un feedback al termine
- Certificato: certificato di completamento verificabile online
Descrizione del corso
InsightLearn è in fase di sviluppo (work in progress): i contenuti di questa pagina sono pubblicati esclusivamente a fini di verifica e test.
Learn how to systematically evaluate LLM-powered applications beyond vibes. This course covers the evaluation crisis in LLM apps, building ground-truth datasets, RAGAS metrics (answer relevancy, faithfulness, context recall, context precision), DeepEval framework setup, LLM-as-judge patterns, regression testing CI/CD pipelines, A/B evaluation of prompts, and monitoring evaluation drift in production.
Cosa imparerai
- Curated from public resources. Build automated evaluation pipelines for LLM applications using RAGAS, DeepEval, and custom metrics.
Programma del corso
- The evaluation crisis: why vibes don't scale (20 min)
- Building ground-truth datasets for your domain (30 min)
- RAGAS metrics: faithfulness, answer relevancy, context precision (35 min)
- Running RAGAS on your RAG pipeline (25 min)
- Synthetic test set generation with RAGAS (28 min)
- DeepEval setup: unit tests for LLM outputs (32 min)
- LLM-as-judge: GPT-4 and Claude as evaluators (30 min)
- Regression testing in CI/CD with DeepEval (25 min)
Dalle lezioni
Estratto della trascrizione di «The evaluation crisis: why vibes don't scale»
Welcome to this lesson of the course LLM EMALS. RAGAS, VEP EMAL, and Automated Testing. In this session we will explore the EMAL-LATION CREDITS. We will start with the fundamental concepts and the basic theoretical principles. We will then see practical applications and practical cases in the world of development. We will analyze concrete elements and my practices. of the sector. At the end of this lesson you will be able to apply autonomously the techniques of devaluation to your projects. We will start with the fundamental concepts and the basic theoretical principles. We will then see practical applications and almost real uses in the world of the development of AI. We will analyze concrete times and the best practices…
Estratto della trascrizione di «Building ground-truth datasets for your domain»
Welcome to this lesson of the LLM-EVALS course. RAGAS, VEVAL, and Automated Testing. In this session, we will explore building ground with data sets for your work domain. We will start with the fundamental concepts and the basic theoretical principles. We will then see practical applications and practical cases in the world of development. We will analyze concrete elements and practical practices. At the end of this lesson you will be able to apply autonomously the techniques of building a good data set for your own mind and your projects. We will start with the fundamental concepts and the theoretical principles of the base. We will then see practical applications and almost practical cases in the world of development. We…
Estratto della trascrizione di «RAGAS metrics: faithfulness, answer relevancy, context precision»
Welcome to this lesson of the course LLM EMALS, RADAS, VEP EMAL, and Automated Testing. In this session we will explore RADAS metrics, fight fullness, answer elements, context precision. We will start with the fundamental concepts and the basic principles. We will then see practical applications and almost universal ones in the world of the loop. We will analyze them. and the best practices in the sector. At the end of this lesson, you will be able to apply autonomously the techniques of RGAS Metrics in your projects. We will start with the fundamental concepts and the basic principles. We will then see practical applications and almost universal cases in the world of development. We will also analyze the concrete…
Altri corsi di RAG e AI engineering
- Local LLMs: Ollama, vLLM, and Self-Hosted AI
- Multimodal AI: Vision, Audio, and Image Generation APIs
- Advanced Prompt Engineering: Chain-of-Thought, Few-Shot, and Beyond
- RAG from Scratch: Complete Retrieval-Augmented Generation
- Vector Databases in Production: Chroma, FAISS, pgvector
- Agentic AI Patterns: ReAct, Plan-and-Execute, and Multi-Agent
Domande frequenti
Quanto dura il corso LLM Evals: RAGAS, DeepEval, and Automated Testing?
Il corso dura 8h 0m in totale, con 8 lezioni suddivise in 3 sezioni, da seguire online al proprio ritmo.
Serve esperienza pregressa?
Il corso è di livello intermedio e non indica requisiti specifici di ingresso.
Il corso rilascia un certificato?
Sì: al completamento del corso ricevi un certificato di completamento verificabile online.