AI threat catalogue Reliability and Responsible Use Production
Shadow AI (Unsanctioned AI Service Use)
Employees or business units use AI services without company approval or oversight (shadow AI). Confidential data flows to external providers, and compliance gaps and an unmanaged attack surface emerge.
Description
Freely available AI tools such as chatbots, translators, or coding assistants are within everyone's reach and promise quick productivity gains. Where clear rules or an approved internal offering are missing, employees adopt such services on their own initiative and enter customer data, trade secrets, or source code into third-party systems. The external provider can access these inputs and may use them to train its models; contractual safeguards and data protection checks are absent. The company loses track of where AI is in use, which decisions depend on it, and which data leaves the organisation. Surveys show that this kind of use is widespread and continues to grow.
Possible impact
Leaked trade secrets cannot be taken back; for personal data, the company risks GDPR violations because there is no legal basis and no data processing agreement. Obligations under the EU AI Act, such as deployer duties and AI literacy, cannot be met for systems the company does not know about. At the same time, unverified AI results flow into work products, and every uncontrolled service enlarges the attack surface.
Example
A sales employee copies a customer list including revenue figures into a free online chatbot to draft a presentation. The confidential data now sits on an external provider's servers, beyond any control of the company; comparable incidents are publicly documented.
Recommended mitigations (7)
Compare effects and implementation levels. Expand each entry for the additional classification and rationale.
-
AI usage policy and communication
Governance & compliance- Effect
- Preventive
- Implementation level
- Organization, Use & operations
Classification and rationale
Complementary control typeOrganizational & process-based
Primarily a governance and compliance control: Binding usage rules, accountability, and permitted-use boundaries govern AI use; communication and control processes put them into practice.
-
Approved AI tool catalogue
Governance & compliance- Effect
- Preventive
- Implementation level
- Organization, Use & operations
Classification and rationale
Complementary control typeOrganizational & process-based
Primarily a governance and compliance control: Binding rules, control objectives, or oversight define permitted use and accountability; complemented by binding workflows.
-
Egress monitoring for AI-service traffic
Technical- Effect
- Detective
- Implementation level
- Infrastructure, Use & operations
Classification and rationale
Complementary control typeOrganizational & process-based
Primarily technical: Software or analytical tools systematically produce and evaluate measurements, deviations, or attack indicators; complemented by binding workflows.
-
Data classification awareness training
People & competence- Effect
- Preventive
- Implementation level
- Organization, Use & operations
Classification and rationale
Complementary control typeOrganizational & process-based
Primarily a people-and-competence control: Human knowledge, attention, or professional judgment produces the protective decision; complemented by binding workflows.
-
DLP controls for AI data flows
Technical- Effect
- Preventive, Detective
- Implementation level
- Data, Application, API & agents, Use & operations
Classification and rationale
Complementary control typeOrganizational & process-based
Primarily technical: System-enforced inspection, transformation, or blocking rules stop or neutralize disallowed content before further processing; complemented by binding workflows.
-
Sanctioned enterprise AI offering
Organizational & process-based- Effect
- Preventive
- Implementation level
- Application, API & agents, Organization, Use & operations
Classification and rationale
Complementary control typeGovernance & compliance, Technical
Primarily organizational and process-based: Defined selection, operating, or lifecycle procedures make the control binding and repeatable; complemented by rules and oversight as well as technical implementation.
-
Periodic AI usage audits
Organizational & process-based- Effect
- Detective
- Implementation level
- Organization, Use & operations
Classification and rationale
Complementary control typeGovernance & compliance
Primarily organizational and process-based: A planned, repeatable assessment with ownership and documented follow-up creates the protective effect; complemented by rules and oversight.
Framework mappings
Verified locations in OWASP, NIST AI RMF, MITRE ATLAS, the EU AI Act and further frameworks. The mappings are taxonomic, not evidence of compliance.
Verified references (8)
Every reference states the framework, the exact location and the publishing organisation.
- OWASP LLM Top 10 LLM02:2026 Sensitive Information DisclosureLLM02:2026 Sensitive Information Disclosure, OWASP Top 10 for LLM Applications 2026 v1.0, pp. 18-22 (doi:10.5281/zenodo.22109015); canonical text 2026/final/LLM02_SensitiveInformationDisclosure.md at commit 7e144e05 OWASP FoundationOriginal
- OWASP LLM Top 10 LLM04:2026 Supply ChainLLM04:2026 Supply Chain, OWASP Top 10 for LLM Applications 2026 v1.0, pp. 27-32 (doi:10.5281/zenodo.22109015); canonical text 2026/final/LLM04_SupplyChain.md at commit 7e144e05 OWASP FoundationOriginal
- NIST AI RMF Section 2.12 Value Chain and Component IntegrationSection 2.12, p. 12 National Institute of Standards and Technology (NIST)Original
- NIST AI RMF NISTAML.05 Supply Chain AttacksTaxonomy Index, pp. x–xi; Section 3.2, pp. 41–43 National Institute of Standards and Technology (NIST)Original
- EU AI Act Article 4 AI literacyArticle 4(1), as replaced by Article 1(5) of Regulation (EU) 2026/1744 European Union (EUR-Lex)Original
- GDPR Article 25(1)–(2) Data protection by design and by defaultArticle 25(1) and 25(2) European Union (EUR-Lex)Original
- BIML BIML-LLM inference:10 User RiskPDF p. 19, [inference:10:user risk] Berryville Institute of Machine Learning (BIML)Original
- BIML BIML78 inference:5 User RiskPDF p. 20, [inference:5:user risk] Berryville Institute of Machine Learning (BIML)Original
EU AI Act obligations related to this threat
The obligations from the obligations compass whose articles the catalogue maps to this threat. Each leads to its entry with core, action step and evidence; whether it applies to you depends on role and risk class.
-
Support the AI literacy of your staff
Art. 4 · applies from 2 February 2025 · amended by Reg. 2026/1744
Statutory roles: Provider, Deployer, Product manufacturer, Provider of a general-purpose AI model. Classes: Prohibited practice, High-risk under Annex III, High-risk as a product or safety component, System subject to transparency obligations, General-purpose AI model, Model with systemic risk, Minimal risk.
Regulation (EU) 2026/1744 recast Art. 4. The duty to ensure AI literacy has become a duty to support its development. It is now expressly clarified that no one has to guarantee a particular level of competence for any individual. The obligation as such remains and has applied since 2 February 2025. The wording attaches to AI systems; a provider of a general-purpose AI model alone is covered in so far as they also provide or deploy systems.
This reference is a review prompt. A threat match alone does not establish applicability.
All 62 obligations by role, risk class and deadline in the obligations compass
Terms on this page
Glossary terms that occur in this entry. Every link leads to the full explanation.
- Shadow AI AI tools used without the organisation knowing or approving.
- AI literacy (Art. 4 EU AI Act) Knowledge and skills for informed use of AI.
Related threats
More entries from the topic group Reliability and Responsible Use.
Matching use cases
This list shows where to review this threat, rather than how high the risk is.
For 47 further use cases, relevance depends on the system design, for example whether it is used alongside AI services that have not been approved. Show these use cases
Frequently asked questions
- What is Shadow AI (Unsanctioned AI Service Use)?
- Employees or business units use AI services without company approval or oversight (shadow AI). Confidential data flows to external providers, and compliance gaps and an unmanaged attack surface emerge.
- Which mitigations help against Shadow AI (Unsanctioned AI Service Use)?
- The catalogue lists 7 mitigations, each with control type, effect and implementation level. First among them are AI usage policy and communication, Approved AI tool catalogue and Egress monitoring for AI-service traffic.
- Which EU AI Act obligations does Shadow AI (Unsanctioned AI Service Use) touch?
- The catalogue maps this threat to Art. 4 of the EU AI Act. In the obligations compass this leads to: Support the AI literacy of your staff. Whether an obligation applies depends on role, risk class and deadline.
Assess this threat in your own system
The live demo contains all 52 threats of this catalogue, including the EU AI Act and GDPR assessment. The free single modules cover AI risk, the EU AI Act and GDPR. No sign-up; the assessment runs locally in your browser.
Cite this entry
For reports, policies or internal documents; the link leads directly to this entry.
“Shadow AI (Unsanctioned AI Service Use)”. Versatile AI Risk Assessment, AI threat catalogue, as of October 2026. https://www.versatile-ai-risk-assessment.com/en/wissensbasis/threats/shadow-ai/