Multimodal AI: Vision, Audio, and Image Generation APIs

Descrizione del corso

A comprehensive guide to building multimodal AI applications. Covers vision LLMs (GPT-4o vision, Claude Opus 3 vision, Gemini Flash), image analysis techniques (object detection, OCR, diagram understanding), document intelligence (PDF parsing with vision), audio transcription with Whisper (local and API), speaker diarization, text-to-speech with ElevenLabs and OpenAI TTS, image generation with DALL-E 3 and Stable Diffusion APIs, and building multimodal RAG pipelines.

Cosa imparerai

• Curated from public resources. Build multimodal AI applications with GPT-4V, Claude Vision, Gemini, Whisper, and image generation APIs.

Programma del corso

1. GPT-4o vision: image analysis and OCR (30 min)
2. Claude vision: multi-image analysis and document parsing (28 min)
3. Multimodal RAG: combining vision and text retrieval (40 min)
4. Whisper: local transcription and the OpenAI API (28 min)
5. Speaker diarization with pyannote.audio (25 min)
6. Text-to-speech: OpenAI TTS, ElevenLabs, and Coqui (30 min)
7. DALL-E 3: prompt engineering for images (25 min)
8. Stable Diffusion APIs: ComfyUI and A1111 (35 min)

Struttura del corso

3 sezioni, 8 lezioni, 10h 0m di durata complessiva. Il corso si segue interamente online, al proprio ritmo.

Domande frequenti