Align Your AI · Reference
Contents
Standards crosswalk
Security and risk teams already work from a handful of public catalogs. This page lines up the failures described in Part Two with four of them. OWASP, a nonprofit security community, publishes a Top 10 for LLM Applications1 and a Top 10 for Agentic Applications.2 MITRE keeps ATLAS, a catalog of attacks on AI systems.3 NIST publishes the AI Risk Management Framework,4 with a profile for generative AI.5 A short section covers the one article of the EU AI Act that names specific attacks.
The item numbers and names below are copied from those documents. Which item matches which failure is the author’s judgment; the catalogs themselves make no such mapping.
OWASP and MITRE ATLAS, by failure
Each cell gives the closest item and how it relates. Names means the item describes this failure. Part means it covers one part of it. Route means it describes an attacker’s way in, while the failure can also happen with no attacker. Nearest means nothing matches and the item named is the closest. The item names are in the key at the end of the page.
| Failure (chapter) | OWASP LLM 2026 | OWASP Agentic 2026 | MITRE ATLAS |
|---|---|---|---|
| proxy overoptimization (6) | none | nearest ASI10 | none |
| gaming the grader (6) | none | ASI10 (part) | none |
| emergent misalignment (6) | LLM05 (route) | none | AML.T0018.000, AML.T0020 (route) |
| reward hacking that spreads (6) | none | ASI10 (part) | none |
| sycophancy (6) | nearest LLM07 | nearest ASI09 | none |
| update regression (7) | nearest LLM04 | nearest ASI04 | nearest AML.T0109 |
| safety erosion (7) | LLM05 (route) | none | AML.T0018.000, AML.T0020 (route) |
| compression safety loss (7) | LLM04 (route) | none | AML.T0018 (route) |
| composition failure (7) | LLM02 (part); LLM04 (route) | none | AML.T0010.003, AML.T0018.000 (route) |
| conditional misalignment (7) | LLM05 (part) | none | AML.T0018.000, AML.T0043.004 (route) |
| compromised checkpoints (8) | LLM04 (names); LLM05 (part) | ASI04 (part) | AML.T0010.003, AML.T0011.000, AML.T0018.002, AML.T0018.003, AML.T0115.001 (names) |
| data poisoning (8) | LLM05 (names); LLM04 (part) | ASI04 (part) | AML.T0020, AML.T0010.002, AML.T0043.004, AML.T0115.000 (names) |
| subliminal learning (8) | nearest LLM05 | none | none |
| agent supply chain (8) | LLM04 (part) | ASI04 (names); ASI02 (part) | AML.T0010.005, AML.T0110, AML.T0109, AML.T0011.002 (names) |
| evaluation awareness (9) | none | none | nearest AML.T0097 |
| scheming (9) | none | ASI10 (names) | none |
| unauditable reasoning (9) | none | ASI09 (part) | none |
| prompt injection (10) | LLM01 (names) | ASI01 (names) | AML.T0051 and its two sub-techniques, AML.T0086, AML.T0077 (names) |
| deployer-rule jailbreak (10) | LLM01, LLM08 (names) | ASI01 (part) | AML.T0054, AML.T0056, AML.T0069.002 (names) |
| excessive agency (10) | LLM03 (names) | ASI02, ASI03 (names) | AML.T0053, AML.T0101, AML.T0086 (route) |
| instrumental escalation (10) | LLM03 (part) | ASI10 (names); ASI05 (part) | AML.T0105, AML.T0116, AML.T0117, AML.T0121, AML.T0017.001 (names) |
| memory poisoning (10) | LLM01, LLM09 (part) | ASI06 (names) | AML.T0080, AML.T0080.000, AML.T0070, AML.T0071 (names) |
| persona drift (10) | none | nearest ASI10 | none |
| multi-agent contagion (10) | LLM01 (part) | ASI08, ASI10 (names); ASI07 (part) | AML.T0061 (names); AML.T0118 (part) |
| fabricated actions (10) | LLM07 (part) | ASI09 (part) | none |
| authoritative confabulation (10) | LLM07 (names) | ASI09 (part) | AML.T0062, AML.T0060 (route) |
| answer leakage (10) | none | nearest ASI02 | none |
| insecure generated code (10) | LLM10 (names); LLM07 (part) | ASI05 (part) | none |
| robot jailbreak (11) | LLM01 (route) | ASI01 (part) | AML.T0054 (route) |
| physical-channel attack (11) | LLM01 (part) | ASI01 (part) | AML.T0041, AML.T0008.003, AML.T0043, AML.T0015, AML.T0051.001, AML.T0129 (names) |
| oversight erosion (12) | LLM07 (part) | ASI09 (part) | none |
| misuse uplift (12) | LLM01 (route) | none | AML.T0054, AML.T0103, AML.T0116, AML.T0117, AML.T0124, AML.T0017.001, AML.T0102 (names) |
Nine failures meet no item in any of the three catalogs: distribution shift and safety tax (Chapter 6), over-refusal and monitor staleness (Chapter 7), evaluation blind spots and black-box only (Chapter 9), and off-instruction action, unsafe exploration and the certification gap (Chapter 11).
The pattern is plain in the table. Eight of the eleven failures in Chapter 10, where an attacker usually supplies the input, are named by at least one item. None of the failures in Chapters 6 and 7, which come from training and from changes to a deployed system, is. Update regression has only a malicious relative, the “rug pull” (AML.T0109), in which an adopted component turns hostile after an update.3 OWASP’s LLM list does cover one change-related case, weights crafted to look harmless at full precision and misbehave once quantized, under Supply Chain.1 The same loss of safety after compression, with no attacker involved, appears in none of the catalogs.
Where each failure enters
Each failure in Part Two enters a system at one main stage: data and supply chain, pretraining, post-training and fine-tuning, deployment and inference, agent runtime, continual change after release, or one of the two lanes that run alongside them, evaluation and oversight. Other stages where it can also enter are in parentheses.
| Failure | Chapter | Enters at |
|---|---|---|
| proxy overoptimization (Mode 1) | 6 | post-training and fine-tuning (also the evaluation lane; agent runtime) |
| gaming the grader (Mode 2) | 6 | post-training and fine-tuning (also agent runtime; the evaluation lane) |
| emergent misalignment (Mode 3) | 6 | post-training and fine-tuning (also continual change) |
| reward hacking that spreads (Mode 4) | 6 | post-training and fine-tuning (also agent runtime) |
| sycophancy (Mode 5) | 6 | post-training and fine-tuning (also deployment and inference) |
| distribution shift (Mode 6) | 6 | post-training and fine-tuning (also deployment and inference) |
| safety tax (Mode 7) | 6 | the evaluation lane (also post-training and fine-tuning) |
| update regression (Mode 8) | 7 | continual change (also deployment and inference) |
| safety erosion (Mode 9) | 7 | post-training and fine-tuning (also continual change) |
| over-refusal (Mode 10) | 7 | deployment and inference (also continual change) |
| compression safety loss (Mode 11) | 7 | deployment and inference (also continual change) |
| composition failure (Mode 12) | 7 | post-training and fine-tuning (also deployment and inference) |
| conditional misalignment (Mode 13) | 7 | the evaluation lane (also post-training and fine-tuning) |
| monitor staleness (Mode 14) | 7 | continual change (also deployment and inference) |
| compromised checkpoints (Mode 15) | 8 | data and supply chain (also deployment and inference) |
| data poisoning (Mode 16) | 8 | data and supply chain (also pretraining; post-training and fine-tuning) |
| subliminal learning (Mode 17) | 8 | data and supply chain (also post-training and fine-tuning) |
| agent supply chain (Mode 18) | 8 | agent runtime (also data and supply chain) |
| evaluation awareness (Mode 19) | 9 | the evaluation lane (also agent runtime) |
| scheming (Mode 20) | 9 | post-training and fine-tuning (also agent runtime) |
| unauditable reasoning (Mode 21) | 9 | agent runtime (also post-training and fine-tuning; the oversight lane) |
| evaluation blind spots (Mode 22) | 9 | the evaluation lane |
| black-box only (Mode 23) | 9 | the evaluation lane (also the oversight lane) |
| prompt injection (Mode 24) | 10 | agent runtime (also deployment and inference) |
| deployer-rule jailbreak (Mode 25) | 10 | deployment and inference |
| excessive agency (Mode 26) | 10 | agent runtime |
| instrumental escalation (Mode 27) | 10 | agent runtime (also the evaluation lane) |
| memory poisoning (Mode 28) | 10 | agent runtime (also data and supply chain) |
| persona drift (Mode 29) | 10 | agent runtime (also deployment and inference) |
| multi-agent contagion (Mode 30) | 10 | agent runtime |
| fabricated actions (Mode 31) | 10 | agent runtime (also the evaluation lane) |
| authoritative confabulation (Mode 32) | 10 | deployment and inference |
| answer leakage (Mode 33) | 10 | the evaluation lane (also agent runtime) |
| insecure generated code (Mode 34) | 10 | deployment and inference (also agent runtime; post-training and fine-tuning) |
| robot jailbreak (Mode 35) | 11 | deployment and inference |
| physical-channel attack (Mode 36) | 11 | deployment and inference |
| off-instruction action (Mode 37) | 11 | post-training and fine-tuning (also deployment and inference) |
| unsafe exploration (Mode 38) | 11 | post-training and fine-tuning (also deployment and inference) |
| certification gap (Mode 39) | 11 | the oversight lane (also continual change) |
| misuse uplift (Mode 40) | 12 | deployment and inference (also agent runtime) |
| oversight erosion (Mode 41) | 12 | the oversight lane (also agent runtime) |
Five ATLAS case studies
ATLAS writes up real incidents as case studies.3 Five of them are also cases in Appendix A:
- EchoLeak, a zero-click prompt injection that pulled data out of Microsoft 365 Copilot (AML.CS0059; prompt injection, Chapter 10).3
- Code to deploy a destructive AI agent found in the Amazon Q extension for VS Code (AML.CS0047; agent supply chain, Chapter 8).
- A poisoned Postmark MCP server through which an attacker took users’ emails (AML.CS0053; agent supply chain, Chapter 8).
- Autonomous agents in OpenAI’s internal cyber evaluations that crossed their evaluation boundaries and compromised Hugging Face production systems, in ATLAS’s account (AML.CS0068; instrumental escalation, Chapter 10).
- The GTG-1002 espionage campaign run through Claude Code (AML.CS0069; misuse uplift, Chapter 12).
NIST AI Risk Management Framework
NIST’s framework organizes risk work into four functions: Govern, Map, Measure and Manage.4 It does not list failure modes, so the useful mapping runs from its outcomes to the chapters that help meet them.
| NIST AI RMF outcome (paraphrased) | Where this book helps |
|---|---|
| GOVERN 6.1: policies address risks from third-party software, data and other supply-chain issues | Know what you loaded (Chapter 8) |
| MEASURE 1.3: people who did not build the system take part in regular assessments | How AI systems are tested (Chapter 4) |
| MEASURE 2.4: the system’s behavior is monitored in production | When nobody is watching (Chapter 12) |
| MEASURE 2.7: security and resilience are evaluated and documented | Agents acting on what they read (Chapter 10) |
| MANAGE 2.4: someone is responsible for, and able to, switch off a system that behaves outside its intended use | A routine for every change (Chapter 13) |
| MANAGE 4.1: post-deployment monitoring plans cover incident response, recovery and change management | A routine for every change (Chapter 13) |
The generative-AI profile, NIST AI 600-1, names twelve risks.5 Five line up with failures in this book. Confabulation matches authoritative confabulation and fabricated actions (Chapter 10). Human-AI Configuration, which covers automation bias and over-reliance, matches sycophancy (Chapter 6) and oversight erosion (Chapter 12). Information Security matches prompt injection (Chapter 10) and misuse uplift (Chapter 12). Value Chain and Component Integration, about untraceable third-party components, matches the supply-chain failures of Chapter 8. CBRN Information or Capabilities, on help toward chemical, biological, radiological or nuclear weapons, matches misuse uplift.
EU AI Act
For high-risk AI systems, Article 15 of the EU AI Act requires measures against “data poisoning”, against manipulation of “pre-trained components used in training (model poisoning)” and against “adversarial examples or model evasion”.6 Those match data poisoning and compromised checkpoints (Chapter 8) and physical-channel attacks (Chapter 11).
The same article requires high-risk systems to “perform consistently” throughout their lifecycle and asks that systems which keep learning after release be built to address feedback loops.6 No provision of the Act names the other failures in this book.
This page is a reading aid for practitioners and offers no legal advice.
Where each failure appears on alignyourai.com
The site alignyourai.com sorts failures by where they enter a system, on a grid of fifteen layers and fifteen failure words. Each page pairs one layer with one failure and gives the public cases, what people do about it and the sources. The table lists the pages for each failure in Part Two. “Not on the grid” means no pair on the site covers the failure.
Key to the item numbers
OWASP Top 10 for LLM Applications 2026
The 2026 list renumbered the 2025 items and renamed one: “What used to be System Prompt Leakage is now Hidden Context Exposure”.1 Each 2026 ID ends in “:2026”, left off in the table above.
| 2026 ID | Item | 2025 ID7 |
|---|---|---|
| LLM01 | Prompt Injection | LLM01 |
| LLM02 | Sensitive Information Disclosure | LLM02 |
| LLM03 | Excessive Agency | LLM06 |
| LLM04 | Supply Chain | LLM03 |
| LLM05 | Data and Model Poisoning | LLM04 |
| LLM06 | Unbounded Consumption | LLM10 |
| LLM07 | Misinformation | LLM09 |
| LLM08 | Hidden Context Exposure | LLM07 |
| LLM09 | Vector and Embedding Weaknesses | LLM08 |
| LLM10 | Improper Output Handling | LLM05 |
No failure in this book maps to LLM06, Unbounded Consumption.1
OWASP Top 10 for Agentic Applications 2026
| ID | Item |
|---|---|
| ASI01 | Agent Goal Hijack |
| ASI02 | Tool Misuse and Exploitation |
| ASI03 | Identity and Privilege Abuse |
| ASI04 | Agentic Supply Chain Vulnerabilities |
| ASI05 | Unexpected Code Execution (RCE) |
| ASI06 | Memory & Context Poisoning |
| ASI07 | Insecure Inter-Agent Communication |
| ASI08 | Cascading Failures |
| ASI09 | Human-Agent Trust Exploitation |
| ASI10 | Rogue Agents |
MITRE ATLAS techniques
| ATLAS ID | Technique |
|---|---|
| AML.T0008.003 | Acquire Infrastructure: Physical Countermeasures |
| AML.T0010.002 | AI Supply Chain Compromise: Data |
| AML.T0010.003 | AI Supply Chain Compromise: Model |
| AML.T0010.005 | AI Supply Chain Compromise: AI Agent Tool |
| AML.T0011.000 | User Execution: Unsafe AI Artifacts |
| AML.T0011.002 | User Execution: Poisoned AI Agent Tool |
| AML.T0015 | Evade AI Model |
| AML.T0017.001 | Develop Capabilities: Autonomous Exploit Development |
| AML.T0018 | Manipulate AI Model |
| AML.T0018.000 | Manipulate AI Model: Poison AI Model |
| AML.T0018.002 | Manipulate AI Model: Embed Malware |
| AML.T0018.003 | Manipulate AI Model: Modify Prompt Construction Logic |
| AML.T0020 | Training Data Poisoning |
| AML.T0041 | Physical Environment Access |
| AML.T0043 | Craft Adversarial Data |
| AML.T0043.004 | Craft Adversarial Data: Insert Backdoor Trigger |
| AML.T0051 | LLM Prompt Injection (sub-techniques .000 Direct, .001 Indirect) |
| AML.T0053 | AI Agent Tool Invocation |
| AML.T0054 | LLM Jailbreak |
| AML.T0056 | Extract LLM System Prompt |
| AML.T0060 | Publish Hallucinated Entities |
| AML.T0061 | LLM Prompt Self-Replication |
| AML.T0062 | Discover LLM Hallucinations |
| AML.T0069.002 | Discover LLM System Information: System Prompt |
| AML.T0070 | RAG Poisoning |
| AML.T0071 | False RAG Entry Injection |
| AML.T0077 | LLM Response Rendering |
| AML.T0080 | AI Agent Context Poisoning (.000 Memory) |
| AML.T0086 | Exfiltration via AI Agent Tool Invocation |
| AML.T0097 | Virtualization/Sandbox Evasion |
| AML.T0101 | Data Destruction via AI Agent Tool Invocation |
| AML.T0102 | Generate Malicious Commands |
| AML.T0103 | Deploy AI Agent |
| AML.T0105 | Escape to Host |
| AML.T0109 | AI Supply Chain Rug Pull |
| AML.T0110 | AI Agent Tool Poisoning |
| AML.T0115.000 | Publish Poisoned AI Artifacts: Datasets |
| AML.T0115.001 | Publish Poisoned AI Artifacts: Models |
| AML.T0116 | Autonomous Reconnaissance |
| AML.T0117 | Autonomous Attack-Path Adaptation |
| AML.T0118 | Autonomous AI Agent Communication |
| AML.T0121 | AI Agent Environment Reconstruction |
| AML.T0124 | Autonomous Attack Orchestration |
| AML.T0129 | Triggers in Multimodal Inputs |
Notes
- OWASP GenAI Security Project. “OWASP Top 10 for LLM Applications 2026.” version 1.0, resource page dated 2026-08-03. https://genai.owasp.org/resource/owasp-genai-llm-top-10-2026/. Items LLM01:2026 to LLM10:2026; the quantization supply-chain risk is under LLM04:2026. ↩︎
- OWASP GenAI Security Project, Agentic Security Initiative. “OWASP Top 10 for Agentic Applications 2026.” resource page dated 2025-12-09. https://genai.owasp.org/resource/owasp-top-10-for-agentic-applications-for-2026/. Items ASI01 to ASI10. ↩︎
- MITRE. “ATLAS: Adversarial Threat Landscape for AI Systems” (release 2026.09). 2026-09-15. https://atlas.mitre.org/ (data file https://atlas.mitre.org/atlas-data/dist/v6/ATLAS-2026.09.yaml). Technique and case-study IDs and names. ↩︎
- National Institute of Standards and Technology. “Artificial Intelligence Risk Management Framework (AI RMF 1.0) (NIST AI 100-1).” NIST, 2023-01-26. doi:10.6028/NIST.AI.100-1. The four functions and the subcategories GOVERN 6.1, MEASURE 1.3, 2.4 and 2.7, MANAGE 2.4 and 4.1. ↩︎
- National Institute of Standards and Technology. “Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile (NIST AI 600-1).” NIST, 2024-07-26. doi:10.6028/NIST.AI.600-1. Twelve generative-AI risk categories. ↩︎
- European Commission, AI Act Service Desk. “Article 15: Accuracy, robustness and cybersecurity” (Regulation (EU) 2024/1689, consolidated text). ai-act-service-desk.ec.europa.eu. https://ai-act-service-desk.ec.europa.eu/en/ai-act/article-15. Paragraphs 1, 4 and 5; Official Journal text at https://eur-lex.europa.eu/eli/reg/2024/1689/oj/eng. ↩︎
- OWASP GenAI Security Project. “OWASP Top 10 for LLM Applications 2025.” genai.owasp.org, 2025 edition. https://genai.owasp.org/llm-top-10/. The 2025 item IDs. ↩︎