analyze_imageAnalyze an image using a multimodal model and return a detailed text description.
The vision model sees the image; the calling agent is text-only and cannot.
Sources for `image` (pick one, or pass an array to analyze several at once):
- "path": absolute or relative path to a local image file (PNG/JPEG/WEBP/GIF)
- URL: http(s) URL to an image on the web or a local server
- "data:...": base64 data URI, e.g. data:image/png;base64,<payload>
- "clipboard": read the image currently copied to the system clipboard
- "recent": auto-find the most recently pasted image in THIS session
- "session": auto-find EVERY image pasted in this session (analyze them all in one call)
- "raw": the string itself is the literal raw image bytes
- ["a.png", "b.png", ...]: array of any of the above — all analyzed in one request
Pick `task` for common jobs (describe | ocr | ui | layout | qa) or pass your own `prompt`.
`detail` defaults to "high" for maximum completeness.
Use `save_to` to write a long description to a file and get back only a path + summary.Input schema{
"type": "object",
"properties": {
"image": {
"anyOf": [
{
"type": "string",
"minLength": 1
},
{
"type": "array",
"items": {
"type": "string",
"minLength": 1
}
}
],
"description": "Image source(s): a file path, URL, data: URI, 'clipboard', 'recent', 'session', 'raw', or an array of any of these to analyze multiple images in one call. 'session' analyzes every image pasted in the current session."
},
"prompt": {
"type": "string",
"description": "Free-form question or instruction about the image. Overrides `task`."
},
"task": {
"type": "string",
"enum": [
"describe",
"ocr",
"ui",
"layout",
"qa"
],
"description": "Common analysis task. Ignored when `prompt` is provided."
},
"detail": {
"type": "string",
"enum": [
"low",
"high"
],
"description": "Desired detail level. Defaults to 'high'."
},
"save_to": {
"type": "string",
"description": "Optional file path (.txt/.md) to write the full description to."
}
},
"required": [
"image"
],
"additionalProperties": false,
"$schema": "http://json-schema.org/draft-07/schema#"
} | — | | — |