Versatile AI Risk Assessment

AI threat catalogue Supply Chain and Provenance Supply Chain

Supply Chain – Datasets

Training and fine-tuning data from external sources can be poisoned, flawed, or legally tainted. The model learns these defects along with everything else; beyond skewed or harmful outputs, copyright and data protection violations can follow.

As of: October 2026 · Catalogue version 2026.10.24.2 · 4 mitigations · 18 verified sources

Description

AI models learn from large volumes of data that are often gathered automatically from the internet (crawling) or bought in from third parties, frequently without deeper integrity checks. Attackers exploit this: they place prepared content in sources that feed into training data, or take over expired internet domains listed in well-known dataset catalogs and replace their content. Poisoned data thus enters training or fine-tuning (the subsequent adjustment of a finished model) and embeds bias, false information, or hidden backdoors. External datasets also carry legal risks, such as copyrighted material or personal data collected unlawfully. If data provenance is not documented, the defect often goes undetected for a long time.

Possible impact

Poisoned or defective data lowers the quality and reliability of the model and can implant deliberately harmful behavior. The organization faces copyright disputes and GDPR violations if personal data flows in without a legal basis; the individuals whose data is processed unnoticed are affected too. Depending on role and risk class, the EU AI Act requires safeguards against data poisoning and transparency about training data. Clean-up and retraining costs and reputational damage come on top.

Example

A company buys an industry dataset to fine-tune its model for credit decisions. Part of the data comes from manipulated web sources and contains systematically skewed examples. The model then disadvantages certain customer groups without this showing up in standard testing.

Recommended mitigations (4)

Compare effects and implementation levels. Expand each entry for the additional classification and rationale.

  • Use trusted data sources

    Organizational & process-based
    Effect
    Preventive
    Implementation level
    Data, Supply chain
    Classification and rationale

    Complementary control typeTechnical

    Primarily organizational and process-based: Defined selection, operating, or lifecycle procedures make the control binding and repeatable; complemented by technical implementation.

  • Data provenance tracking

    Technical
    Effect
    Detective
    Implementation level
    Data
    Classification and rationale

    Complementary control typeOrganizational & process-based

    Primarily technical: Cryptographic or machine-verifiable properties protect confidentiality, integrity, or provenance; complemented by binding workflows.

  • Dataset validation and integrity checks

    Technical
    Effect
    Preventive, Detective
    Implementation level
    Data
    Classification and rationale

    Primarily technical: Software or analytical tools systematically produce and evaluate measurements, deviations, or attack indicators.

  • License and copyright compliance audits

    Governance & compliance
    Effect
    Detective
    Implementation level
    Data, Supply chain, Organization
    Classification and rationale

    Complementary control typeOrganizational & process-based

    Primarily a governance and compliance control: Binding rules, control objectives, or oversight define permitted use and accountability; complemented by binding workflows.

Framework mappings

Verified locations in OWASP, NIST AI RMF, MITRE ATLAS, the EU AI Act and further frameworks. The mappings are taxonomic, not evidence of compliance.

Verified references (18)

Every reference states the framework, the exact location and the publishing organisation.

EU AI Act obligations related to this threat

The obligations from the obligations compass whose articles the catalogue maps to this threat. Each leads to its entry with core, action step and evidence; whether it applies to you depends on role and risk class.

  • Support downstream providers Art. 25 Abs. 2, Art. 25 Abs. 4 · applies from Annex III: 2 December 2027 · Annex I: 2 August 2028 · amended by Reg. 2026/1744

    Statutory roles: Provider, Provider of a general-purpose AI model. Classes: High-risk under Annex III, High-risk as a product or safety component.

    Regulation (EU) 2026/1744 spelled out the initial provider duty to cooperate and at the same time created an exception: it does not apply where the initial provider has clearly specified that their system must not be turned into a high-risk system. Infringements of Art. 25(2) and (4) are now expressly subject to fines.

    This reference is a review prompt. A threat match alone does not establish applicability.

  • Draw up the technical documentation of the model Art. 53 Abs. 1 Buchst. a, Anhang XI · applies from 2 August 2025

    Statutory roles: Provider of a general-purpose AI model. Classes: General-purpose AI model, Model with systemic risk.

    This reference is a review prompt. A threat match alone does not establish applicability.

  • Provide information to downstream providers Art. 53 Abs. 1 Buchst. b, Anhang XII · applies from 2 August 2025

    Statutory roles: Provider of a general-purpose AI model. Classes: General-purpose AI model, Model with systemic risk.

    This reference is a review prompt. A threat match alone does not establish applicability.

  • Respect copyright and summarise the training content Art. 53 Abs. 1 Buchst. c und d · applies from 2 August 2025

    Statutory roles: Provider of a general-purpose AI model. Classes: General-purpose AI model, Model with systemic risk.

    For models released under a free and open-source licence with publicly available parameters, the obligations under points (a) and (b) do not apply, but the copyright policy and the summary do. Models with systemic risk are excluded from this relief.

    This reference is a review prompt. A threat match alone does not establish applicability.

All 62 obligations by role, risk class and deadline in the obligations compass

Terms on this page

Glossary terms that occur in this entry. Every link leads to the full explanation.

  • Data Poisoning Manipulated training or reference data steers a model wrong on purpose.
  • Fine-tuning An existing model is trained further on your own data.

More entries from the topic group Supply Chain and Provenance.

Matching use cases

This list shows where to review this threat, rather than how high the risk is.

Belongs on the checklist for every AI system. What to review for every AI system

Frequently asked questions

What is Supply Chain – Datasets?
Training and fine-tuning data from external sources can be poisoned, flawed, or legally tainted. The model learns these defects along with everything else; beyond skewed or harmful outputs, copyright and data protection violations can follow.
Which mitigations help against Supply Chain – Datasets?
The catalogue lists 4 mitigations, each with control type, effect and implementation level. First among them are Use trusted data sources, Data provenance tracking and Dataset validation and integrity checks.
Which EU AI Act obligations does Supply Chain – Datasets touch?
The catalogue maps this threat to Art. 25 Abs. 2, Art. 53 Abs. 1 Buchst. a, Art. 53 Abs. 1 Buchst. b and Art. 53 Abs. 1 Buchst. c und d of the EU AI Act. In the obligations compass this leads to: Support downstream providers, Draw up the technical documentation of the model, Provide information to downstream providers and Respect copyright and summarise the training content. Whether an obligation applies depends on role, risk class and deadline.

Assess this threat in your own system

The live demo contains all 52 threats of this catalogue, including the EU AI Act and GDPR assessment. The free single modules cover AI risk, the EU AI Act and GDPR. No sign-up; the assessment runs locally in your browser.

Cite this entry

For reports, policies or internal documents; the link leads directly to this entry.

“Supply Chain – Datasets”. Versatile AI Risk Assessment, AI threat catalogue, as of October 2026.
https://www.versatile-ai-risk-assessment.com/en/wissensbasis/threats/supply-chain-datasets/

← Back to the full catalogue