Shadow Vision

Live v0.1.1

Help a text-first AI understand images

When a text model replies “I can’t see the image” after you share a screenshot, Shadow Vision adds vision tools through MCP so you can keep working in the Agent you already use.

GitHub

01 / The outcome

How it helps

See images inside your existing Agent

Once connected through MCP, Codex, Claude Code, Cursor, and other clients can work with images in the same conversation.

Do not get locked to one model

Switch between Ollama, OpenAI-compatible, Anthropic, and Gemini backends as the task, cost, or quality changes.

Keep sensitive images on your device

With Ollama, the image and inference stay local, which gives internal screenshots and private documents a clearer boundary.

Bring images from where they already are

Use a local file, base64 data, or a remote image URL, with safety limits around remote requests.

03 / What it can do

From seeing to doing

The Agent gets more than a description: it gets structured results it can inspect, compare, and turn into the next step.

vision_ocr

Pull text from screenshots, receipts, documents, and tables so the Agent can search, organize, and cite it.

vision_inspect

Ask “what is wrong with this interface?” and let the Agent understand the scene before it explains or checks it.

vision_annotate

Read circles, arrows, underlines, and highlights so the Agent can connect your marked point to the right object.

vision_layout

Break an interface into elements, positions, text styles, and relationships for review, debugging, or code generation.

vision_reconstruct

Generate an HTML, React, or SVG draft from a reference screenshot instead of starting from a blank page.

vision_compare

Put before-and-after images, frames, or related documents together and surface what changed and why it matters.

04 / Choose your data boundary

Choose the vision source that fits your data

Local models, cloud models, and compatible services all use the same MCP entry point.

Ollama

Keep images and inference local for code screenshots, internal documents, and other content you do not want to send out.

OpenAI Compatible

Already using LM Studio, vLLM, or another OpenAI-protocol service? Change the configuration, not the client.

Anthropic

Choose Claude vision models when the task needs deeper image understanding and reasoning.

Gemini

Choose Gemini when the work benefits from broader multimodal understanding.

05 / Works with your Agent

Keep your Agent; give it sight

Connect once, then use the same visual entry point from Codex, Claude Code, Cursor, and more.

One shared start command: uv run shadow-vision

Codex

Claude Code

Cursor

VS Code Copilot

Windsurf

Claude Desktop

OpenCode

02 / Use cases

Use Cases

Developers

Give an Agent an error screenshot, wireframe, or design and let it understand, review, explain, or turn it into code.

Research and document work

Extract information from paper charts, scanned documents, and tables without the usual screenshot-and-copy loop.

When images should stay private

Use a local Ollama backend for sensitive screenshots and internal documents, keeping the data boundary on your device.