Versatile AI Risk Assessment
Banking and insurance

AI-assisted insurance claims handling

Also known as: AI-assisted claims handling

The system analyses claim documents and photographs, checks entitlement against the policy, flags inconsistencies and prepares settlement.

Explore the interactive model

Export handout

A concise PDF covering how the system works, its data flows and points to investigate, ready to share.

The explanations and measures describe the typical system design. Extensive personal changes add an appendix.

Understand the use case

What defines this use case?

Language models and image recognition extract information from claims, invoices, expert reports and photographs and compare the claim with the policy. Insurers use this for motor and property claims; Allianz states that people still decide coverage and payment.

This page describes a typical system design. Actual data flows and permissions depend on your implementation.

System design
Analysis and processing
Ability to act
Action permissions depend on integration
Fields of use
insurance
Also known as
AI claims settlement, claims automation

How it works, step by step

System design and data flows

  1. Input data

    Claims, photographs, invoices and reports enter the claim file alongside policy data.

    Claimants, repair shops and experts supply claims, photographs, invoices and reports. The system analyses damage photographs alongside invoices, expert reports and policy data.

  2. Processing

    The system reads documents, analyses images, checks the claim against the policy and estimates damage.

    The system assigns notifications and documents to a claim and extracts or evaluates relevant information. This can produce prioritisation, a recommendation for review or a processing proposal. Payment or rejection is a further process step with its own rules and approvals.

  3. Results

    The system proposes settlement, flags inconsistencies and drafts correspondence if needed.

    The result describes the defined model task. A match, category or forecast acquires its professional significance only in conjunction with the underlying data and intended use.

  4. Use and impact

    Claims staff decide coverage and payment.

    Integration determines whether the result is simply displayed, adopted after approval or written directly into a business application. These variants differ in their data flows and permissions.

Explore the system design: Select a component to see its task, incoming and outgoing data, and role in the use case. The guided walkthrough explains each phase. Then use Yes, Uncertain and No to represent your specific system variant.

How the system is built

8 review first30 clarify7 baseline threats

InputProcessingResultImpact Externalaccess 04 Input 50 Third-partycontent 00 AI model 06 Providerservice 11 Documentcollection 01 Memory 00 Training andfeedback 02 OtherAI agents 00 Tools andinterfaces 02 Result 113 Business appor equipment 00 person 10 Affectedperson 00 AI serviceswithout approval 01 Externalaccess 04 Input 50 Third-partycontent 00 AI model 06 Providerservice 11 Documentcollection 01 Memory 00 Training andfeedback 02 OtherAI agents 00 Tools andinterfaces 02 Result 113 Business appor equipment 00 person 10 Affectedperson 00 AI serviceswithout approval 01
  • Present
  • Depends on your system
  • Absent
  • Review first
  • To clarify

In this system design: 8 to review first, 30 to clarify, 7 baseline threats.

Architecture as a list

How it differs from similar use cases

Data and information

Input data and information sources

Claimants, repair shops and experts supply claims, photographs, invoices and reports. Claim files identify insured people, injured parties, witnesses and number plates.

Processing and operating environment

Language models and image recognition generally come from a provider.

Storage and further use

Depending on design, the system retrieves policy terms and agreements from a document collection to check entitlement. Damage estimation models often learn from the insurer's own claims; language models are usually used unchanged.

Results and data sharing

The insurer determines whether it automatically approves small payments or only presents a proposal. Cloud services send claim files and photographs outside the organisation's environment.

Using a provider does not automatically determine where processing takes place. Storage location, subcontractors, deletion periods and use for training must be checked for the specific deployment.

Assess risks and determine measures

From understanding the system to analysing risks

  1. Define the system boundary

    Record data, participants, interfaces and permissions. Resolve uncertain characteristics in the model.

  2. Investigate threats

    Relate review candidates to actual data flows: what could happen, and who would be affected?

  3. Assess risk

    Assess impacts and likelihood in the deployment context. The number of review candidates is not a risk score.

  4. Provide evidence of measures

    Select appropriate controls, assign responsibilities and define effectiveness checks. Document residual risks and approvals.

Key threats in the application context

  • 3 particularly important
  • 5 typical
  • 30 depending on the system
  • 7 additional threats for every AI system

A total of 45 threats from the threat catalogue may be relevant to this use case.

Also review: whether the system disadvantages groups

Check whether selection, ranking or assessment disadvantages people with protected characteristics, such as sex, age or origin.

Priority review points

  1. Multimodal Attacks

    Claimants control photographs and documents. An edited photograph or an invoice inconsistent with the image can inflate the estimate.

  2. Overreliance

    Staff approving many settlement proposals daily may start waving them through. Inconsistencies missed by the system then escape human review too.

  3. Insecure Output Handling

    The proposal passes directly into the claims system with amount and coverage assessment. Accepting an incorrect amount unchecked leads to overpayment or underpayment.

5 further review candidates in the typical design

Other relevant threats

  1. Backdoor ML Model

    Training data or an adopted base model can introduce hidden triggers for misbehaviour.

    Listed because of this characteristic

    • Uses another provider's model
  2. Model Denial of Service

    Complex or high-volume inputs can exhaust model computing resources.

    Listed because of this characteristic

    • Processes text, images and speech together
  3. Privacy Attacks

    Targeted queries can recover some personal or protected training data from the model.

    Listed because of these characteristics

    • Processes personal data
    • Processes confidential data
  4. Sensitive Information Disclosure

    Confidential content can appear in answers, supplied context or logs.

    Listed because of these characteristics

    • Processes personal data
    • Processes confidential data
  5. Exfiltration from ML Application

    Protected data can leak through tools, network connections, storage or insiders.

    Listed because of this characteristic

    • Processes confidential data

Up to 30 further threats may apply, depending on your system design. Nine threats need to be reviewed for every AI system. Two of these are particularly important here and are therefore listed above.

System features and open questions

Each Yes adds further threats to your checklist, up to 30 in total. If you cannot yet answer a question, include its threats in your review.

How many threats a Yes adds
  • Added by this Yes
  • Also requires a Yes to another question

How your system is built

  1. Performs natural language tasks5 threats
  2. Calls other programs or interfaces2 threats
  3. Uses operational feedback2 threats
  4. Generates its own text1 threat, plus 13 only in combination with other characteristics
  5. Learns from your own data1 threat, plus 1 only in combination with other characteristics
  6. Searches its own document collection1 threat
  7. Formulates answers from retrieved documents1 threat
  8. Changes data or triggers processes1 threat
  9. Learns from examples with correct answers1 threat
  10. Optimises a specified metric1 threat
  11. Generates content from open-ended requests12 threats only in combination with other characteristics

How you operate the system

  1. Available to people outside the organisation4 threats, plus 2 only in combination with other characteristics
  2. Accepts queries directly through an interface3 threats, plus 1 only in combination with other characteristics
  3. Accessible over a network1 threat, plus 1 only in combination with other characteristics
  4. Incurs costs with each query1 threat
  5. Shares computing resources with other customers or applications1 threat
  6. Used alongside unapproved AI services1 threat

How your system is built

Does the system search its own collection of documents or records for relevant content?

Depending on design, the system retrieves policy terms and agreements from a document collection to check entitlement.

If yes, add

Can the system change things itself, such as storing data, sending messages, initiating transactions or granting permissions?

The insurer determines whether it automatically approves small payments or only presents a proposal.

If yes, add

Does your organisation train or fine-tune the model itself using its own data?

Damage estimation models often learn from the insurer's own claims; language models are usually used unchanged.

If yes, add

Is the model trained on examples to which someone has assigned the correct answer?

Damage estimates learn from settled cases with known amounts; a language model does not require these.

If yes, add

Is the system intended to maximise a specified metric, such as revenue, utilisation or clicks?

If yes, add

How you operate the system

These questions arise for almost every AI system.

Do you pay per query or unit of computing time, so costs increase with use?

With a cloud language model, each analysed claim file costs money.

If yes, add

Controls and implementation

Measures for the priority review areas are expanded. Each linked measure explains how to implement it.

Controls for the remaining threats are available on their pages in the threat catalogue.

AI Act provisions

When AI Act provisions apply
  1. Art. 4: AI literacy

    For every AI system Applies since 2 February 2025.

  2. Art. 53 para. 1 point b, Annex XII: Embedded general-purpose model

    Depending on use Review trigger since 2 August 2025.

  3. Art. 50 para. 2: Marking artificially generated content

    Depending on use Review trigger since 2 August 2026.

Applies to every AI system

Art. 4: AI literacy

Applies if staff or appointed representatives operate or use AI systems.

Applies since 2 February 2025.

Obligations and details for Art. 4: AI literacy
Who bears the obligations
Provider, Deployer, Product manufacturer, Provider of a general-purpose AI model

Detailed obligations

May apply in particular uses

Art. 50 para. 2: Marking artificially generated content

Applies if the system generates letters to claimants or experts beyond assisting with existing texts.

Applies since 2 August 2026.

Obligations and details for Art. 50 para. 2: Marking artificially generated content
The general condition is
Applies if the system generates synthetic text, images, audio or video.
Exception
Exceptions include ordinary editing assistance that does not substantially alter inputs or their meaning.
Points to consider
Systems marketed before 2 August 2026 must be updated by 2 December 2026.
Who bears the obligations
Provider, Product manufacturer, Provider of a general-purpose AI model

Detailed obligations

Art. 53 para. 1 point b, Annex XII: Embedded general-purpose model

Applies if a large language model or another third-party general-purpose model analyses documents or drafts correspondence.

Applies since 2 August 2025.

Obligations and details for Art. 53 para. 1 point b, Annex XII: Embedded general-purpose model
The general condition is
Applies if another provider's general-purpose AI model is incorporated, such as a large language model.
Points to consider
The model provider bears its obligations. It must give you the Annex XII information; use it for your own documentation.
Who bears the obligations
Provider of a general-purpose AI model

Detailed obligations

Generally does not apply

Annex III no. 5 point c: Life and health insurance

Claims handling assesses damage that has occurred, rather than life or health insurance risk or pricing.

Obligations and details for Annex III no. 5 point c: Life and health insurance
The general condition is
Applies if the system assesses risk or sets prices for people's life or health insurance.
Who bears the obligations
Provider, Deployer, Product manufacturer

Detailed obligations

Classify your system with the quick checker All obligations in the obligations compass

Cross-cutting threats

Review these threats for every AI system, whatever its purpose.

Why these threats always belong on the checklist

Atypical system features

View 7 further questions

If any of these features does apply to your system, add the listed threats.

Sources

Related use cases

Also in the field of Banking and insurance

Often used together with

Updated: 30 September 2026. Review checklist rules version 0.3.2, threat catalogue version 2026.10.24.2. How these pages are structured