AI threat catalogueReliability and Responsible UseProduction
Model Drift & Degradation
The quality of an AI model gradually declines in operation because the world keeps changing while the model stays frozen on old knowledge (model drift). Without dedicated monitoring, decisions get silently worse and nobody notices.
Description
A model learns from past data. As customer behaviour, language, products, or fraud patterns change, the learned relationships fit the present less and less. Specialists speak of distribution shift (the distribution of the input data moves) and concept drift (the learned relationship itself becomes outdated). Feedback loops can add to this: the model's outputs influence future input data and reinforce existing distortions. Where new models are increasingly trained on AI-generated content, quality can also decay across model generations (model collapse). Because the system keeps responding fluently and produces no error messages, the decline stays invisible for a long time without continuous monitoring.
Possible impact
Gradually degrading forecasts, scores, or filter decisions lead to lost revenue, poor planning, and undetected fraud, often over months. The EU AI Act obliges deployers of high-risk systems to monitor the system's operation, so unnoticed drift can also become a compliance issue. Fixing it requires retraining and reworking decisions that have already been made.
Example
A payment fraud detection model was trained on historical patterns. As fraudsters change their methods, the detection rate drops month by month; it only becomes apparent once the annual accounts show significantly higher losses.
Recommended mitigations (7)
Every mitigation states its control type, effect, implementation level and the reason for the classification.
Continuous performance monitoringTechnical
- Effect
- Detective
- Implementation level
- Model & training, Use & operations
- Complementary control type
- Organizational & process-based
- Reason for the classification
- “Continuous performance monitoring” is primarily technical: Software or analytical tools systematically produce and evaluate measurements, deviations, or attack indicators; complemented by binding workflows.
Automated drift detectionTechnical
- Effect
- Detective
- Implementation level
- Model & training, Use & operations
- Reason for the classification
- “Automated drift detection” is primarily technical: Software or analytical tools systematically produce and evaluate measurements, deviations, or attack indicators.
Periodic retraining schedulesOrganizational & process-based
- Effect
- Corrective
- Implementation level
- Model & training, Use & operations
- Complementary control type
- Technical
- Reason for the classification
- “Periodic retraining schedules” is primarily organizational and process-based: Defined selection, operating, or lifecycle procedures make the control binding and repeatable; complemented by technical implementation.
A/B testing for model updatesTechnical
- Effect
- Detective
- Implementation level
- Model & training, Use & operations
- Reason for the classification
- “A/B testing for model updates” is primarily technical: Software or analytical tools systematically produce and evaluate measurements, deviations, or attack indicators.
Data quality monitoringTechnical
- Effect
- Detective
- Implementation level
- Data, Model & training, Use & operations
- Complementary control type
- Organizational & process-based
- Reason for the classification
- “Data quality monitoring” is primarily technical: Software or analytical tools systematically produce and evaluate measurements, deviations, or attack indicators; complemented by binding workflows.
Canary deploymentsTechnical
- Effect
- Detective, Impact-limiting
- Implementation level
- Model & training, Use & operations
- Reason for the classification
- “Canary deployments” is primarily technical: Software or analytical tools systematically produce and evaluate measurements, deviations, or attack indicators.
Feedback loops from productionOrganizational & process-based
- Effect
- Detective, Corrective
- Implementation level
- Model & training, Use & operations
- Complementary control type
- Technical, People & competence
- Reason for the classification
- “Feedback loops from production” is primarily organizational and process-based: A defined reporting, triage, and handling workflow turns observations into traceable follow-up actions; complemented by technical implementation as well as human expertise and judgment.
Framework mappings
Verified locations in OWASP, NIST AI RMF, MITRE ATLAS, the EU AI Act and further frameworks. The mappings are taxonomic, not evidence of compliance.
Verified references (9)
Every reference states the framework, the exact location and the publishing organisation.
- OWASP LLM Top 10 LLM09:2025 MisinformationLLM09:2025 Misinformation, official category page OWASP FoundationOriginal
- NIST AI RMF Section 2.6 Harmful Bias and HomogenizationSection 2.6, pp. 8–9 National Institute of Standards and Technology (NIST)Original
- NIST AI RMF MEASURE 2.5 MEASURE 2.5MEASURE 2.5, p. 29 National Institute of Standards and Technology (NIST)Original
- EU AI Act Article 26(5) Obligations of deployers of high-risk AI systemsArticle 26(5) European Union (EUR-Lex)Original
- EU AI Act Article 55(1)(b) Obligations of providers of general-purpose AI models with systemic riskArticle 55(1)(b) European Union (EUR-Lex)Original
- BSI R9 Selbstverstärkende Effekte und Model Collapse (Text, Bild, Video)Kap. 4, R9, p. 18 Bundesamt für Sicherheit in der Informationstechnik (BSI)Original
- BIML BIML-LLM raw:9 TimePDF p. 15, [raw:9:time] Berryville Institute of Machine Learning (BIML)Original
- BIML BIML78 alg:1 OnlinePDF p. 16, [alg:1:online] Berryville Institute of Machine Learning (BIML)Original
- BIML BIML78 eval:5 Catastrophic ForgettingPDF p. 18, [eval:5:catastrophic forgetting] Berryville Institute of Machine Learning (BIML)Original
Related threats
More entries from the topic group Reliability and Responsible Use.
Assess this threat in your own system
The live demo contains all 52 threats of this catalogue, including the EU AI Act and GDPR assessment. The free single modules cover AI risk, the EU AI Act and GDPR. No sign-up; the assessment runs locally in your browser.
Cite this entry
For reports, policies or internal documents; the link leads directly to this entry.
“Model Drift & Degradation”. Versatile AI Risk Assessment, AI threat catalogue, as of July 2026. https://www.versatile-ai-risk-assessment.com/en/wissensbasis/threats/model-drift/