ai-multimodal

Process audio, images, videos, documents, and generate images using Google Gemini's multimodal API. Unified interface for all multimedia content understanding and generation. API Key Setup : Supports both Google AI Studio and Vertex AI. The skill checks for GEMINI_API_KEY in this order: Get API key : For Vertex AI : Install SDK : Transcribe Audio : Analyze Image : Process Video : Extract from PDF : Generate Image : Optimize Media : Convert Documents to Markdown : For detailed implementation guidance, see: Input Pricing : Token Rates : TTS Pricing : Free Tier : YouTube Limits : Storage Limits : Common errors and solutions: All scripts support unified API key detection and error handling: gemini_batch_process.py : Batch process multiple media files media_optimizer.py : Prepare media for Gemini API document_converter.py : Convert documents to PDF Run any script with --help for detailed usage. - Transcription with timestamps (up to 9.5 hours) - Audio summarization and analysis - Speech understanding and speaker identification - Music and environmental sound analysis - Text-to-speech generation with controllable voice - Image captioning and description - Object detection with bounding boxes (2.0+) - Pixel-level segmentation (2.5+) - Visual question answering - Multi-image comparison (up to 3,600 images) - OCR and text extraction - Scene detection and summarization - Video Q&A with...