Versatile AI Risk Assessment
Administration, justice and public safety

AI assistance in high-volume court proceedings

Also known as: AI assistance in courts for mass litigation

In high-volume proceedings, the system organises pleadings, extracts each case's features and prepares draft decisions.

Explore the interactive model

Export handout

A concise PDF covering how the system works, its data flows and points to investigate, ready to share.

The explanations and measures describe the typical system design. Extensive personal changes add an appendix.

Understand the use case

What defines this use case?

For cases such as diesel emissions claims or airline compensation claims, it extracts the few differing details and selects appropriate standard text passages. Stuttgart Higher Regional Court uses such a system; four German states are jointly trialling another.

This page describes a typical system design. Actual data flows and permissions depend on your implementation.

System design
Analysis and processing
Ability to act
Action permissions depend on integration
Fields of use
judiciary
Also known as
AI in mass litigation, judgment drafting tool

How it works, step by step

System design and data flows

  1. Input data

    Claims, responses and attachments arrive through the electronic case file.

    The parties' lawyers write pleadings, often using their own templates in mass litigation. Pleadings include parties, addresses, vehicles or flight details.

  2. Processing

    The system classifies pleadings by proceeding type and extracts decision-relevant features.

    The system prepares pleadings and case information and identifies recurring topics or comparable circumstances. It can support grouping and preparing similar proceedings. An automatically generated case pattern and the legal assessment of an individual case serve different purposes.

  3. Results

    The system displays case features and suggests standard text passages or a draft decision.

    The result describes the defined model task. A match, category or forecast acquires its professional significance only in conjunction with the underlying data and intended use.

  4. Use and impact

    Judges review the proposal, decide the case and take responsibility for the judgment.

    Integration determines whether the result is simply displayed, adopted after approval or written directly into a business application. These variants differ in their data flows and permissions.

Explore the system design: Select a component to see its task, incoming and outgoing data, and role in the use case. The guided walkthrough explains each phase. Then use Yes, Uncertain and No to represent your specific system variant.

How the system is built

6 review first18 clarify6 baseline threats

InputProcessingResultImpact Externalaccess 05 Input 40 Third-partycontent 00 AI model 05 Providerservice 01 Documentcollection 01 Memory 00 Training andfeedback 03 OtherAI agents 00 Tools andinterfaces 00 Result 11 Business appor equipment 01 person 10 Affectedperson 00 AI serviceswithout approval 01 Externalaccess 05 Input 40 Third-partycontent 00 AI model 05 Providerservice 01 Documentcollection 01 Memory 00 Training andfeedback 03 OtherAI agents 00 Tools andinterfaces 00 Result 11 Business appor equipment 01 person 10 Affectedperson 00 AI serviceswithout approval 01
  • Present
  • Depends on your system
  • Absent
  • Review first
  • To clarify

In this system design: 6 to review first, 18 to clarify, 6 baseline threats.

Architecture as a list

How it differs from similar use cases

Data and information

Input data and information sources

The parties' lawyers write pleadings, often using their own templates in mass litigation. Pleadings include parties, addresses, vehicles or flight details.

Processing and operating environment

The model processes the inputs. Whether it runs internally or with a service provider must be established for the specific implementation.

Storage and further use

Some systems retrieve similar cases that have already been decided. Case-feature classification models are often trained on pleadings from the court itself.

Results and data sharing

Depending on integration, the system writes features into the electronic file itself or only displays them. If a cloud service hosts a language model, parts of case files leave the court.

Using a provider does not automatically determine where processing takes place. Storage location, subcontractors, deletion periods and use for training must be checked for the specific deployment.

Assess risks and determine measures

From understanding the system to analysing risks

  1. Define the system boundary

    Record data, participants, interfaces and permissions. Resolve uncertain characteristics in the model.

  2. Investigate threats

    Relate review candidates to actual data flows: what could happen, and who would be affected?

  3. Assess risk

    Assess impacts and likelihood in the deployment context. The number of review candidates is not a risk score.

  4. Provide evidence of measures

    Select appropriate controls, assign responsibilities and define effectiveness checks. Document residual risks and approvals.

Key threats in the application context

  • 3 particularly important
  • 3 typical
  • 18 depending on the system
  • 6 additional threats for every AI system

A total of 30 threats from the threat catalogue may be relevant to this use case.

Also review: whether the system disadvantages groups

Check whether selection, ranking or assessment disadvantages people with protected characteristics, such as sex, age or origin.

Priority review points

  1. Overreliance

    With many similar claims, simply accepting extracted features and drafts is tempting. If the system misses a distinguishing detail, the judgment does not fit the case.

  2. Insecure Output Handling

    Extracted features such as vehicle type, purchase date or flight delay select the draft's standard text passages. A misread feature inserts the wrong legal reasoning.

  3. Adversarial Inputs

    Law firms handling mass claims can draft pleadings to make the system recognise or overlook particular features. Preparation then shifts in one party's favour.

3 further review candidates in the typical design

Other relevant threats

  1. Privacy Attacks

    Targeted queries can recover some personal or protected training data from the model.

    Listed because of these characteristics

    • Processes personal data
    • Processes confidential data
  2. Sensitive Information Disclosure

    Confidential content can appear in answers, supplied context or logs.

    Listed because of these characteristics

    • Processes personal data
    • Processes confidential data
  3. Exfiltration from ML Application

    Protected data can leak through tools, network connections, storage or insiders.

    Listed because of this characteristic

    • Processes confidential data

Up to 18 further threats may apply, depending on your system design. Nine threats need to be reviewed for every AI system. Three of these are particularly important here and are therefore listed above.

System features and open questions

Each Yes adds further threats to your checklist, up to 18 in total. If you cannot yet answer a question, include its threats in your review.

How many threats a Yes adds
  • Added by this Yes
  • Also requires a Yes to another question

How your system is built

  1. Performs natural language tasks5 threats
  2. Generates its own text2 threats, plus 1 only in combination with other characteristics
  3. Learns from your own data2 threats, plus 1 only in combination with other characteristics
  4. Uses operational feedback2 threats
  5. Searches its own document collection1 threat
  6. Formulates answers from retrieved documents1 threat
  7. Changes data or triggers processes1 threat
  8. Uses another provider's model1 threat
  9. Learns from examples with correct answers1 threat

How you operate the system

  1. Accepts queries directly through an interface4 threats, plus 1 only in combination with other characteristics
  2. Accessible over a network2 threats, plus 1 only in combination with other characteristics
  3. Incurs costs with each query1 threat
  4. Shares computing resources with other customers or applications1 threat
  5. Used alongside unapproved AI services1 threat

How your system is built

Does the system search its own collection of documents or records for relevant content?

Some systems retrieve similar cases that have already been decided.

If yes, add

Can the system change things itself, such as storing data, sending messages, initiating transactions or granting permissions?

Depending on integration, the system writes features into the electronic file itself or only displays them.

If yes, add

Does the model or its base model come from another provider, even if you host it?

If yes, add

Is the model trained on examples to which someone has assigned the correct answer?

Learning to recognise case features requires pleadings in which people have marked those features.

If yes, add

How you operate the system

These questions arise for almost every AI system.

Do staff also use AI services for this task that your organisation has not approved?

Staff who copy case-file material into a freely available chat service do so without approval.

If yes, add

Controls and implementation

Measures for the priority review areas are expanded. Each linked measure explains how to implement it.

Controls for the remaining threats are available on their pages in the threat catalogue.

AI Act provisions

When AI Act provisions apply
  1. Art. 4: AI literacy

    For every AI system Applies since 2 February 2025.

  2. Art. 53 para. 1 point b, Annex XII: Embedded general-purpose model

    Depending on use Review trigger since 2 August 2025.

  3. Annex III no. 8 point a: Administration of justice

    In typical use Review trigger from 2 December 2027.

Applies to every AI system

Art. 4: AI literacy

Applies if staff or appointed representatives operate or use AI systems.

Applies since 2 February 2025.

Obligations and details for Art. 4: AI literacy
Who bears the obligations
Provider, Deployer, Product manufacturer, Provider of a general-purpose AI model

Detailed obligations

May apply in typical use

Annex III no. 8 point a: Administration of justice

Applies if the system helps judges research facts or interpret and apply legal provisions, for example by preparing draft decisions.

Applies from 2 December 2027.

Obligations and details for Annex III no. 8 point a: Administration of justice
The general condition is
Applies if the system helps courts or dispute resolution bodies establish facts and interpret law.
Exception
Purely ancillary tasks such as anonymising judgments or staff communication are excluded under recital 61.
Who bears the obligations
Provider, Deployer, Product manufacturer

Detailed obligations

May apply in particular uses

Art. 53 para. 1 point b, Annex XII: Embedded general-purpose model

Applies if a large language model or another third-party general-purpose model analyses pleadings or drafts decisions.

Applies since 2 August 2025.

Obligations and details for Art. 53 para. 1 point b, Annex XII: Embedded general-purpose model
The general condition is
Applies if another provider's general-purpose AI model is incorporated, such as a large language model.
Points to consider
The model provider bears its obligations. It must give you the Annex XII information; use it for your own documentation.
Who bears the obligations
Provider of a general-purpose AI model

Detailed obligations

Classify your system with the quick checker All obligations in the obligations compass

Cross-cutting threats

Review these threats for every AI system, whatever its purpose.

Why these threats always belong on the checklist

Atypical system features

View 14 further questions

If any of these features does apply to your system, add the listed threats.

Sources

Related use cases

Also in the field of Administration, justice and public safety

Often used together with

Updated: 30 September 2026. Review checklist rules version 0.3.2, threat catalogue version 2026.10.24.2. How these pages are structured