BrainyBeeBrainyBee
ExploreBlogStart Studying
HomeDeveloping AI Apps and Agents on Azure (AI-103)Configure single-task and pro-mode Content Understanding pipelines
Lesson2,572 words

Configure single-task and pro-mode Content Understanding pipelines

AI-103 › Unit 3: Implement computer vision solutions › Design and implement multimodal understanding workflows › Configure single-task and pro-mode Content Understanding pipelines

Configure single-task and pro-mode Content Understanding pipelines

Standard Content Understanding answers one question about one file: apply this schema, return these fields. Pro mode answers a question that requires reasoning across several files and against reference material — is this invoice consistent with the contract? It is a different shape of pipeline, and it carries one restriction that decides most questions about it: pro mode is currently available for document data only.

Why This Matters

Reference data is the defining feature. Pro mode "enables reasoning over both input content and reference data", where standard mode sees only the input.

Reference documents attach at analyzer creation. They are configured once and applied at analysis time, not passed per request.

The modality restriction eliminates designs. "Currently, pro mode is exclusively available for document data" — so any pro-mode proposal over images, audio, or video is wrong on that basis.

Standard against pro, in one line each

Standard (single-task) — extract, classify, or generate fields from the input content, per file. Pro — multi-step reasoning over multiple input files plus reference data supplied at analyzer creation, for validation, inference, and decisions. Documents only, and in preview.

Prerequisites

  • The analyzer model, fieldSchema, and the three field methods.
  • That extract is documents only, and confidence and grounding come from estimateFieldSourceAndConfidence.
  • The API versions: 2025-11-01 GA, 2026-06-01-preview.
  • That Content Understanding runs on your own model deployments.

Learning Objectives

By the end of this lesson you will be able to:

  1. Distinguish standard and pro mode by what each reasons over.
  2. Configure reference data and know when it is supplied.
  3. Design a multi-file pro-mode request.
  4. Apply the document-only and preview restrictions.
  5. Choose the cheaper mode where it suffices.

Building Blocks

Standard mode — the single task. One analyzer, one input, one schema. Content extraction, then field extraction producing extract, classify, or generate values, with confidence scores 0–1 and grounding where enabled. This covers intelligent document processing, captioning, classification, and RAG ingestion — the great majority of work.

Pro mode. "Designed for advanced use cases that require multi-step reasoning and complex decision-making, such as identifying inconsistencies, drawing inferences, and making decisions." It "enables reasoning over both input content and reference data", and offers "multi-step reasoning capabilities, and multi-input document support".

Reference data. "During analyzer creation, you can provide reference documents that add context at analysis time." The guidance: "Reference documents should be concise and focused, prioritizing essential documents and ensuring they're as brief as possible to enhance retention and recall."

The canonical example. "To analyze invoices for consistency with a contractual agreement, you can provide the invoice and related documents (such as a purchase order) as inputs, and provide the contract files as reference data."

The restriction. "Currently, pro mode is exclusively available for document data."

Availability. Pro mode is documented as preview.

Standard against pro mode

Attribute
Reasons over

The input content

Input content and reference data

Inputs

Per file

Multiple related documents

Work performed

Extract, classify, generate

Multi-step reasoning: inconsistencies, inferences, decisions

Reference material supplied

—

At analyzer creation

Modalities

Documents, images, audio, video

Documents only

Cost

Lower

Higher — multi-step, more context

Deep Dive

What "multi-step reasoning" actually buys

Standard mode answers questions about a document. Pro mode answers questions across documents and against a standard.

The documented framing is precise: pro mode is for "identifying inconsistencies, drawing inferences, and making decisions". Each names a task standard mode cannot do in one pass.

Inconsistencies require at least two sources — a value here compared to a value there. A standard analyzer extracts an invoice total and a contract rate; something else must compare them, which means writing that comparison logic yourself.

Inferences require combining facts that no single document states. Whether a mortgage applicant supplied everything needed is not a field on any one document; it is a conclusion from a set.

Decisions require applying a standard to evidence — approve, flag, reject — which is what makes pro mode's output actionable rather than descriptive.

The practical read: if you find yourself planning to run several standard analyzers and then write cross-document comparison code, that is the shape pro mode exists to absorb.

Configuring a pro-mode pipeline

  1. 1

    Confirm the modality

    Documents only. Images, audio, and video cannot use pro mode.

Inputs against reference data

The split is the core configuration decision, and the documented example makes it concrete: to check invoices against a contract, supply "the invoice and related documents (such as a purchase order) as inputs", and "the contract files as reference data".

Inputs are the documents being examined — the ones that vary per request, the ones the question is about.

Reference data is the stable material they are judged against — contracts, policies, rate cards, standards. It changes rarely, which is why it belongs at analyzer creation rather than in every request.

Getting the split backwards produces a pipeline that works and costs far more than it should: passing the contract as an input on every request re-sends stable material each time, while attaching the varying invoices as reference data would be wrong outright.

The brevity guidance matters more than it first appears. Reference documents should be "concise and focused, prioritizing essential documents and ensuring they're as brief as possible to enhance retention and recall". A 200-page master agreement attached whole is worse than the handful of clauses that actually govern the check — not merely more expensive, but less effective, because retention and recall degrade with volume.

When standard mode is enough

Pro mode costs more, is preview, and is document-only, so the default should be standard unless the requirement genuinely needs cross-document reasoning.

Standard mode is sufficient whenever the question is answerable from one document at a time: extracting invoice fields, classifying document type, captioning an image, describing a video segment, producing RAG-ready Markdown. Adding pro mode to any of these buys nothing.

Standard mode is also the right choice where the comparison logic is simple and deterministic. If the check is "does the invoice total equal the sum of line items", that is arithmetic — extract the fields with a standard analyzer and compare in code, which is exact, cheap, auditable, and repeatable. Pro mode earns its cost when the comparison requires judgement over unstructured language: whether an invoiced service falls within a contract's scope, whether supporting documentation satisfies a stated requirement.

That mirrors the hybrid principle from orchestration: deterministic checks belong in code; judgement over unstructured text belongs in the model.

Pro mode does not extend to images or video

"Currently, pro mode is exclusively available for document data." A proposal to reason across several photographs against a reference set of approved images, or to compare video footage to a brand standard, is outside it — regardless of how well it fits the multi-step-reasoning description. The available route is standard analyzers over each asset plus your own comparison logic.

Verification, and why it matters more here

A decision needs to be defensible in a way a description does not.

Confidence scores — "reliability estimates from 0 to 1" — and grounding, which "identifies the specific regions in the content where each value was extracted or generated", let a reviewer trace a conclusion to the clause and the line item that produced it. In a standard extraction that is convenient; in a pro-mode decision it is close to essential, because the output is an assertion about a relationship rather than a copied value.

The operational pattern is the same as elsewhere: route high-confidence decisions straight through, and queue low-confidence ones with their grounding attached so a reviewer sees exactly where to look. That is the documented purpose — accuracy "while minimizing the cost of human review".

Worked Examples

Example 1 — invoice against contract. A finance team must confirm each invoice is consistent with the governing contract, with related purchase orders considered.

Pro mode, matching the documented example exactly: the invoice and purchase order as inputs, the contract files as reference data attached at analyzer creation. This is "identifying inconsistencies" over multiple documents — a standard analyzer per file plus hand-written comparison logic is the workaround pro mode exists to replace.

Example 2 — comparing product photographs to an approved set. A brand team wants to reason across submitted photographs against a reference library of approved imagery.

Not available: "pro mode is exclusively available for document data". The route is standard analyzers producing classifications and descriptions for each image, plus your own comparison against the approved set — or a multimodal model at question time for a small number of assets.

Example 3 — arithmetic dressed as reasoning. A team proposes pro mode to check that invoice totals equal the sum of their line items.

Standard mode plus code. The check is deterministic arithmetic, so extract the fields with a standard analyzer and compare in application logic — exact, cheap, auditable, and repeatable. Pro mode is warranted when the comparison needs judgement over unstructured language, such as whether an invoiced service falls within a contract's scope.

Visual Explanations

The two shapes:

Loading Diagram...
Figure 1 — Mermaid diagram

Choosing the mode:

Loading Diagram...
Figure 2 — Mermaid diagram

Common Mistakes

Proposing pro mode for images, audio, or video. Documents only.

Passing reference material as an input on every request. It attaches at analyzer creation.

Attaching large reference documents whole. Brevity aids retention and recall.

Using pro mode for deterministic arithmetic. Standard plus code is exact and cheaper.

Using pro mode where one document answers the question.

Ignoring that pro mode is preview under a production-only constraint.

Skipping confidence and grounding on a decision output.

Building cross-document comparison logic by hand where pro mode fits.

Practice Exercises

  1. State the defining difference between standard and pro mode.
  2. When is reference data supplied, and what guidance governs it?
  3. Split the canonical invoice example into inputs and reference data.
  4. Give two situations where standard mode is the better answer.
  5. What single restriction eliminates most pro-mode proposals?
▶Answers
  1. Standard mode reasons over the input content; pro mode "enables reasoning over both input content and reference data", performing multi-step reasoning across multiple input documents for "identifying inconsistencies, drawing inferences, and making decisions".
  2. During analyzer creation — reference documents "add context at analysis time" once configured, rather than being passed per request. They "should be concise and focused, prioritizing essential documents and ensuring they're as brief as possible to enhance retention and recall".
  3. Inputs: the invoice and related documents such as a purchase order — the material being examined, varying per request. Reference data: the contract files — the stable standard they are judged against.
  4. When the question is answerable from one document (extraction, classification, captioning, RAG ingestion), and when the comparison is deterministic — arithmetic or an exact match — where a standard analyzer plus code is exact, cheaper, and auditable. Also whenever the modality is not documents, or preview capability is not permitted.
  5. "Currently, pro mode is exclusively available for document data" — which rules it out for images, audio, and video however well the multi-step-reasoning description fits.

Summary & Concept Map

Standard Content Understanding is the single task: one analyzer, one input, a schema producing extract, classify, or generate values with confidence and grounding — and it covers the large majority of work, including everything non-document. Pro mode adds multi-step reasoning across multiple input documents and against reference data attached at analyzer creation, for "identifying inconsistencies, drawing inferences, and making decisions" — the canonical shape being invoice and purchase order as inputs with contract files as reference data. Keep reference material concise and focused to preserve retention and recall, express the conclusion as a field, and enable confidence and grounding so a decision traces to its evidence. Two restrictions decide most questions: pro mode is documents only and is preview — and where a comparison is deterministic, standard plus code remains exact, cheaper, and auditable.

Loading Diagram...
Figure 3 — Mermaid diagram
Loading flashcards…

Sources and freshness

Written against current Microsoft Learn documentation for the AI-103 skills measured (16 April 2026), reviewed 2026-08-20. Microsoft Learn controls every changing product contract — availability, preview status, quotas, limits, regional support, naming, and retirement dates all move independently of this lesson. Where a scenario turns on a specific number or a GA/preview boundary, confirm it against the product's own page before relying on it.

All Developing AI Apps and Agents on Azure (AI-103) Study Resources

Related Notes

  • Choose an appropriate method for retrieval and indexing2,778 words
  • Quick Note — Choose an appropriate method for retrieval and indexing888 words
  • Choose an appropriate model for each task, including LLMs, small language models, multimodal models, and Foundry Tools3,097 words
  • Quick Note — Choose an appropriate model for each task, including LLMs, small language models, multimodal models, and Foundry Tools1,041 words
  • Choose appropriate memory, tool, and knowledge integration services for agent solutions2,815 words
  • Quick Note — Choose appropriate memory, tool, and knowledge integration services for agent solutions949 words
  • Choose the appropriate Foundry services for generative tasks, grounding, vector search, agent workflows, or multimodal processing2,733 words
  • Quick Note — Choose the appropriate Foundry services for generative tasks, grounding, vector search, agent workflows, or multimodal processing901 words
  • Apply responsible AI instrumentation, including evaluators, safety evaluations, and explanation tooling2,891 words
  • Configure safety filters, guardrails, risk detection, and content moderation2,795 words
  • Govern agent behavior with oversight modes, constraints, and tool-access controls2,863 words
  • Implement auditing through trace logging, provenance metadata, and approval workflows2,624 words

Ready to study Developing AI Apps and Agents on Azure (AI-103)?

Practice tests, flashcards, and all study notes — free, no sign-up.

Start Studying

Ready to study Developing AI Apps and Agents on Azure (AI-103)?

Practice tests, flashcards, and all study notes — free, no sign-up needed.

Start Studying — Free
Developing AI Apps and Agents on Azure (AI-103) ResourcesExplore All HivesBlogHome

© 2026 BrainyBee. Free AI-powered exam prep.

Loading Diagram...
Flowchart, top to bottom. One input file connects to Analyzer + fieldSchema. A1 connects to Fields: extract / classify / generate<br/>+ confidence + grounding. Multiple input documents<br/>invoice + purchase order connects to Pro analyzer. Reference data<br/>contract files<br/>ATTACHED AT ANALYZER CREATION connects to A2. A2 connects to Multi-step reasoning:<br/>inconsistencies, inferences, decisions.
Loading Diagram...
Flowchart, top to bottom. The question connects to Documents only?. M connects to STANDARD - pro is documents only (No). M connects to Answerable from ONE document? (Yes). C connects to STANDARD - single task (Yes). C connects to Is the comparison deterministic? (No). D connects to STANDARD + code<br/>exact, cheap, auditable (Yes). D connects to PRO MODE<br/>inputs + reference data (No - needs judgement). PRO connects to Note: PREVIEW.
Loading Diagram...
Flowchart, top to bottom. Pipeline mode connects to Standard - single task. Pipeline mode] --> STD[Standard - single task connects to Pro mode. Pipeline mode] --> STD[Standard - single task connects to Choosing. STD connects to One input, one schema. STD connects to extract / classify / generate. STD connects to ALL modalities. STD connects to Lower cost. PRO connects to Multi-step reasoning. 9 more statements.

Standard and pro mode — retrieval

Card 1 of 6

Front of flashcard 1 of 6

What defines pro mode

medium

It "enables reasoning over both input content and reference data", offering multi-step reasoning and multi-input document support for "identifying inconsistencies, drawing inferences, and making decisions".

pro-mode

Standard and pro mode — retrieval

Card 1

Front

What defines pro mode

Back

It "enables reasoning over both input content and reference data", offering multi-step reasoning and multi-input document support for "identifying inconsistencies, drawing inferences, and making decisions".

Card 2

Front

When is reference data supplied?

Back

During analyzer creation — reference documents "add context at analysis time" once configured, not per request. They should be "concise and focused… as brief as possible to enhance retention and recall".

Card 3

Front

The pro-mode restriction

Back

"Currently, pro mode is exclusively available for document data." It cannot be used for images, audio, or video — however well the multi-step-reasoning description fits the scenario. It is also preview.

Card 4

Front

The canonical pro-mode example

Back

To check invoices against a contract: the invoice and related documents (such as a purchase order) are inputs; the contract files are reference data. Inputs vary per request; reference data is the stable standard.

Card 5

Front

When standard mode is the better answer

Back

When the question is answerable from one document, when the comparison is deterministic (arithmetic or exact match — standard plus code is exact, cheaper, auditable), when the modality is not documents, or when preview capability is not permitted.

Card 6

Front

Why verification matters more in pro mode

Back

The output is a decision about a relationship, not a copied value. Confidence scores (0–1) and grounding to source regions let a reviewer trace the conclusion to the clause and line item behind it — routing high-confidence decisions straight through and queueing the rest.

Standard and pro mode — retrieval

Card 1

Front

What defines pro mode

Back

It "enables reasoning over both input content and reference data", offering multi-step reasoning and multi-input document support for "identifying inconsistencies, drawing inferences, and making decisions".

Card 2

Front

When is reference data supplied?

Back

During analyzer creation — reference documents "add context at analysis time" once configured, not per request. They should be "concise and focused… as brief as possible to enhance retention and recall".

Card 3

Front

The pro-mode restriction

Back

"Currently, pro mode is exclusively available for document data." It cannot be used for images, audio, or video — however well the multi-step-reasoning description fits the scenario. It is also preview.

Card 4

Front

The canonical pro-mode example

Back

To check invoices against a contract: the invoice and related documents (such as a purchase order) are inputs; the contract files are reference data. Inputs vary per request; reference data is the stable standard.

Card 5

Front

When standard mode is the better answer

Back

When the question is answerable from one document, when the comparison is deterministic (arithmetic or exact match — standard plus code is exact, cheaper, auditable), when the modality is not documents, or when preview capability is not permitted.

Card 6

Front

Why verification matters more in pro mode

Back

The output is a decision about a relationship, not a copied value. Confidence scores (0–1) and grounding to source regions let a reviewer trace the conclusion to the clause and line item behind it — routing high-confidence decisions straight through and queueing the rest.