domains / families / media / gpt-multimodal

gpt-multimodal

separate

Analyze images and multi-frame sequences using OpenAI GPT series

When to use

• This skill enables image analysis, scene understanding, text extraction, and multi-frame comparison using OpenAI's vision-capable GPT models (e.g., `gpt-4o`, `gpt-5`). It supports single and multiple images analysis and sequential frames f…
• Analyzing image content (objects, scenes, colors, spatial relationships)
• Extracting and reading text from images (OCR via vision models)
• Comparing multiple images to detect differences or changes
• Processing video frames to understand temporal progression
• Generating detailed image descriptions or captions
• Answering questions about visual content

When not to use

• **Not for medical diagnosis**: Cannot interpret CT scans, X-rays, or provide medical advice
• **Poor text recognition**: Struggles with rotated, upside-down, or very small text (< 10pt)
• **Non-Latin scripts**: Reduced accuracy for non-Latin alphabets and special characters
• **Spatial reasoning**: Weak at precise localization tasks (e.g., chess positions, exact coordinates)
• **Graph interpretation**: Cannot reliably distinguish line styles (solid vs dashed) or precise color gradients
• **Object counting**: Provides approximate counts; may miss or double-count objects
• **Panoramic/fisheye**: Distorted perspectives reduce accuracy
• **Metadata loss**: Original EXIF data and exact dimensions are not preserved

Skill page

Source