Versatile AI Risk Assessment
Healthcare and emergency services

AI support for emergency call handling

Also known as: AI-assisted emergency call triage

The system listens during an emergency call and alerts dispatchers to signs of an emergency, such as cardiac arrest.

Explore the interactive model

Export handout

A concise PDF covering how the system works, its data flows and points to investigate, ready to share.

The explanations and measures describe the typical system design. Extensive personal changes add an appendix.

Understand the use case

What defines this use case?

Copenhagen's dispatch centre trialled it in live operation. Services in France, Italy and Scotland tested it on recorded calls; Wales has an ongoing research project.

This page describes a typical system design. Actual data flows and permissions depend on your implementation.

System design
Analysis and processing
Ability to act
Action permissions depend on integration
Fields of use
emergency medical services, emergency dispatch centres
Also known as
emergency call triage, cardiac arrest detection during emergency calls

How it works, step by step

System design and data flows

  1. Input data

    Audio from the ongoing emergency call reaches the system directly.

    The caller alone determines what is said during the call. Emergency calls contain callers' and affected people's names, addresses and voices.

  2. Processing

    Speech recognition transcribes the call; a model continually checks the transcript for signs such as cardiac arrest.

    The system processes information from the ongoing call, for example through speech recognition and analysis of relevant terms or patterns. It provides the control room with indications of a possible emergency. Decisions on follow-up questions, urgency and deployment of resources take place within the designated control-room process.

  3. Results

    An indication appears for the dispatcher while the call is still underway.

    The result describes the defined model task. A match, category or forecast acquires its professional significance only in conjunction with the underlying data and intended use.

  4. Use and impact

    The centre determines urgency and whether to guide callers through resuscitation.

    Integration determines whether the result is simply displayed, adopted after approval or written directly into a business application. These variants differ in their data flows and permissions.

Explore the system design: Select a component to see its task, incoming and outgoing data, and role in the use case. The guided walkthrough explains each phase. Then use Yes, Uncertain and No to represent your specific system variant.

How the system is built

7 review first9 clarify7 baseline threats

InputProcessingResultImpact Externalaccess 04 Input 30 Third-partycontent 00 AI model 10 Providerservice 12 Documentcollection 00 Memory 00 Training andfeedback 11 OtherAI agents 00 Tools andinterfaces 00 Result 00 Business appor equipment 01 person 10 Affectedperson 00 AI serviceswithout approval 01 Externalaccess 04 Input 30 Third-partycontent 00 AI model 10 Providerservice 12 Documentcollection 00 Memory 00 Training andfeedback 11 OtherAI agents 00 Tools andinterfaces 00 Result 00 Business appor equipment 01 person 10 Affectedperson 00 AI serviceswithout approval 01
  • Present
  • Depends on your system
  • Absent
  • Review first
  • To clarify

In this system design: 7 to review first, 9 to clarify, 7 baseline threats.

Architecture as a list

How it differs from similar use cases

Data and information

Input data and information sources

The caller alone determines what is said during the call. Emergency calls contain callers' and affected people's names, addresses and voices.

Processing and operating environment

All documented uses rely on one manufacturer's system.

Storage and further use

In the pilots, the manufacturer trained the model on recordings from each dispatch centre. New recordings with confirmed diagnoses can improve the model later.

Results and data sharing

Depending on integration, it only displays the indication or sets an incident category or urgency in dispatch software itself. In the pilots, the manufacturer held the training recordings.

Using a provider does not automatically determine where processing takes place. Storage location, subcontractors, deletion periods and use for training must be checked for the specific deployment.

Assess risks and determine measures

From understanding the system to analysing risks

  1. Define the system boundary

    Record data, participants, interfaces and permissions. Resolve uncertain characteristics in the model.

  2. Investigate threats

    Relate review candidates to actual data flows: what could happen, and who would be affected?

  3. Assess risk

    Assess impacts and likelihood in the deployment context. The number of review candidates is not a risk score.

  4. Provide evidence of measures

    Select appropriate controls, assign responsibilities and define effectiveness checks. Document residual risks and approvals.

Key threats in the application context

  • 3 particularly important
  • 4 typical
  • 9 depending on the system
  • 7 additional threats for every AI system

A total of 23 threats from the threat catalogue may be relevant to this use case.

Also review: whether the outputs are substantively correct

Check probability reliability, possible test-data leakage into training and the consequences of an error in the business process.

Also review: whether the system disadvantages groups

Check whether selection, ranking or assessment disadvantages people with protected characteristics, such as sex, age or origin.

Also review: Safety of people and equipment

Check independent safety functions, intended operating limits and the safety evidence your sector requires.

Priority review points

  1. Overreliance

    A dispatcher relying on cardiac arrest alerts may stop asking targeted questions when none appears. Telephone resuscitation instructions then begin too late.

  2. Model Drift & Degradation

    A model trained on one centre's calls performs worse with different languages, dialects or questioning practices. Pilots in France, Italy and Scotland therefore first trained it on local recordings.

  3. Sensitive Information Disclosure

    Real call recordings go to the manufacturer for training and evaluation. Unauthorised disclosure of voices and health information causes irreversible harm.

4 further review candidates in the typical design

Other relevant threats

  1. Targeted Poisoning / Label Poisoning

    Falsified training labels can deliberately shift model outputs.

    Listed because of this characteristic

    • Learns from examples with correct answers
  2. Backdoor ML Model

    Training data or an adopted base model can introduce hidden triggers for misbehaviour.

    Listed because of this characteristic

    • Uses another provider's model
  3. Privacy Attacks

    Targeted queries can recover some personal or protected training data from the model.

    Listed because of these characteristics

    • Processes personal data
    • Processes confidential data
  4. Exfiltration from ML Application

    Protected data can leak through tools, network connections, storage or insiders.

    Listed because of this characteristic

    • Processes confidential data

Up to 9 further threats may apply, depending on your system design. Nine threats need to be reviewed for every AI system. Two of these are particularly important here and are therefore listed above.

System features and open questions

Each Yes adds further threats to your checklist, up to 9 in total. If you cannot yet answer a question, include its threats in your review.

How many threats a Yes adds
  • Added by this Yes
  • Also requires a Yes to another question

How your system is built

  1. Learns from your own data1 threat, plus 1 only in combination with other characteristics
  2. Changes data or triggers processes1 threat
  3. Learns in operation without renewed approval1 threat
  4. Uses operational feedback1 threat

How your system is built

Can the system change things itself, such as storing data, sending messages, initiating transactions or granting permissions?

Depending on integration, it only displays the indication or sets an incident category or urgency in dispatch software itself.

If yes, add

Does your organisation train or fine-tune the model itself using its own data?

In the pilots, the manufacturer trained the model on recordings from each dispatch centre.

If yes, add

Does the system keep learning in operation and change its behaviour without renewed approval?

If yes, add

Does operational feedback or output later feed into analysis or training?

New recordings with confirmed diagnoses can improve the model later.

If yes, add

How you operate the system

These questions arise for almost every AI system.

Controls and implementation

Measures for the priority review areas are expanded. Each linked measure explains how to implement it.

Controls for the remaining threats are available on their pages in the threat catalogue.

AI Act provisions

When AI Act provisions apply
  1. Art. 4: AI literacy

    For every AI system Applies since 2 February 2025.

  2. Annex III no. 5 point d: Emergency calls and emergency care

    In typical use Review trigger from 2 December 2027.

Applies to every AI system

Art. 4: AI literacy

Applies if staff or appointed representatives operate or use AI systems.

Applies since 2 February 2025.

Obligations and details for Art. 4: AI literacy
Who bears the obligations
Provider, Deployer, Product manufacturer, Provider of a general-purpose AI model

Detailed obligations

May apply in typical use

Annex III no. 5 point d: Emergency calls and emergency care

Applies if the system assesses calls during the conversation and gives dispatchers urgency indications, such as possible cardiac arrest.

Applies from 2 December 2027.

Obligations and details for Annex III no. 5 point d: Emergency calls and emergency care
The general condition is
Applies if the system evaluates or classifies emergency calls, dispatches responders or prioritises emergency patients.
Who bears the obligations
Provider, Deployer, Product manufacturer

Detailed obligations

Generally does not apply

Art. 50 para. 1: Disclosure of AI interaction

The caller speaks to a person at the centre rather than the system. The obligation to disclose AI interaction therefore generally does not apply.

Obligations and details for Art. 50 para. 1: Disclosure of AI interaction
The general condition is
Applies if people directly write or speak with the system and it is not obvious that they are interacting with AI.
Who bears the obligations
Provider, Product manufacturer

Detailed obligations

Classify your system with the quick checker All obligations in the obligations compass

Cross-cutting threats

Review these threats for every AI system, whatever its purpose.

Why these threats always belong on the checklist

Atypical system features

View 17 further questions

If any of these features does apply to your system, add the listed threats.

Sources

Related use cases

Also in the field of Healthcare and emergency services

Updated: 30 September 2026. Review checklist rules version 0.3.2, threat catalogue version 2026.10.24.2. How these pages are structured