Skip to main content

How it works — Image Analysis

Image Analysis

Upload any image and ask NuBench AI to analyze, describe, or extract data from it — powered by GPT-4o and Claude 3 vision capabilities. Images are classified, DLP-scanned, and governed by the same pipeline as every other NuBench request.

How it works

Attach images directly in chat

Use the paperclip icon in the chat input to attach one or more images to your message. Supported formats are PNG, JPEG, GIF, and WebP up to 5 MB per image.

Images are uploaded over an encrypted connection and associated with your conversation record. They are stored at the same classification tier as the conversation and subject to the same DLP scanning as text content.

Vision-capable model routing

When an image is attached, NuBench automatically routes the request to a vision-capable model. The model picker shows which models support vision — GPT-4o and Claude 3 Sonnet, Opus, and Haiku are eligible by default.

Model eligibility for vision is configured in the model registry and subject to the same classification constraints as text-only models. PHI-classified conversations are restricted to BAA-eligible vision models.

What the model can do with an image

Vision models can describe the contents of an image in natural language, extract text and structured data visible in the image, answer questions about specific regions or elements, and compare multiple images in a single turn.

Performance varies by model and image content. For document-heavy images like scanned pages or screenshots, Claude 3 Opus typically produces more accurate text extraction. For photographic images, GPT-4o typically produces richer descriptive output.

DLP scanning before processing

Images are passed through the DLP pipeline before being sent to the model. The DLP engine applies optical character recognition to extract visible text and scans it against your active DLP rules.

If the image contains content that would trigger a DLP block in text form — a PII pattern, a restricted keyword, or a content type you have blocked — the request is stopped before the model sees the image. The audit trail records the block event.

Use cases

Document analysis

Upload a scanned contract, invoice, or form and ask NuBench to extract key fields, summarize the terms, or flag unusual clauses. The model reads the document as a human would, without requiring a PDF parser or OCR pipeline.

Chart and data reading

Paste a screenshot of a chart, dashboard, or financial table and ask NuBench to describe the trends, extract the underlying numbers, or draft a written summary for a report.

UI and UX review

Share a screenshot of an interface — a web page, a mobile app, or a design mockup — and ask NuBench for feedback on layout, accessibility, consistency, or user flow.

Diagram explanation

Upload an architecture diagram, process flow, network map, or org chart and ask NuBench to explain what it depicts, identify gaps, or suggest improvements.

Security and compliance

Classification and DLP before processing
Images are classified at the conversation tier and scanned by the DLP engine — including OCR-based text extraction — before the model sees them. A block at the DLP layer prevents the image from reaching the model.
PHI classification requires BAA-eligible model
Conversations classified at the PHI tier are restricted to vision models covered under a BAA with your organization's provider. The model picker enforces this — non-BAA-eligible vision models are grayed out in PHI conversations.
Stored at conversation classification
Attached images are stored in your dedicated tenant environment at the same classification tier as the conversation. They are not extracted, indexed, or used outside the conversation context.
Audit trail
Every image attachment event — upload, DLP scan result, model dispatch, and response — is recorded in the immutable NuBench audit trail with user identity, conversation ID, classification tier, and timestamp.