Annex-K: AI Threat Modeling Template
1. System Overview
- AI System Name:
- Version:
- Business Purpose:
- Risk Classification: Low / Medium / High
- Data Types Processed:
- Deployment Environment:
- Integration Points:
2. System Architecture
- Model Type/Framework:
- API Dependencies:
- Data Storage:
- Authentication Mechanisms:
Include architecture diagram here
3. Trust Boundaries
| Boundary | Description | Protection Mechanism | Assessed Strength |
|---|
| External-Internal | | | Low/Medium/High |
| Model-Infrastructure | | | Low/Medium/High |
| Data Processing Zones | | | Low/Medium/High |
| User-System | | | Low/Medium/High |
| Third-Party Components | | | Low/Medium/High |
4. Threat Categories & Risk Assessment
4.1 Model Security Threats
| Threat | Likelihood | Impact | Risk Rating | Controls |
|---|
| Prompt injection | | | | |
| Model extraction | | | | |
| Training data poisoning | | | | |
| Adversarial examples | | | | |
| Model inversion attacks | | | | |
| Membership inference | | | | |
4.2 Infrastructure Threats
| Threat | Likelihood | Impact | Risk Rating | Controls |
|---|
| API abuse | | | | |
| DDoS attacks | | | | |
| Supply chain attacks | | | | |
| Data exfiltration | | | | |
| Authentication bypass | | | | |
4.3 Data Security Threats
| Threat | Likelihood | Impact | Risk Rating | Controls |
|---|
| Training data leakage | | | | |
| Sensitive info in outputs | | | | |
| Data poisoning | | | | |
| Unauthorized access | | | | |
4.4 Operational Threats
| Threat | Likelihood | Impact | Risk Rating | Controls |
|---|
| Availability disruption | | | | |
| Performance degradation | | | | |
| Dependency failures | | | | |
5. Attack Vectors & Scenarios
| ID | Attack Vector | Attack Scenario | Impact | Mitigation |
|---|
| AV-1 | | | | |
| AV-2 | | | | |
| AV-3 | | | | |
6. Security Controls Matrix
| Control Category | Control | Implementation Status | Testing Method | Testing Frequency |
|---|
| Input Validation | | | | |
| Authentication | | | | |
| Authorization | | | | |
| Data Protection | | | | |
| Monitoring & Detection | | | | |
| Response & Recovery | | | | |
7. Vulnerability Testing Plan
| Test Type | Scope | Methodology | Schedule | Responsible Team |
|---|
| Prompt injection testing | | | | |
| Fuzzing | | | | |
| Adversarial testing | | | | |
| Penetration testing | | | | |
| Supply chain review | | | | |
8. Risk Mitigation Plan
| Risk | Mitigation Action | Owner | Timeline | Success Criteria | Status |
|---|
| | | | | |
| | | | | |
| | | | | |
9. Security Monitoring Requirements
- Logging Requirements:
- Alert Thresholds:
- Incident Response Integration:
10. Approvals & Reviews
| Role | Name | Signature | Date |
|---|
| AI Security Architect | | | |
| IT Security Officer | | | |
| DPO | | | |
| AI Ethics Board Rep | | | |
Threat Model Version: ______
Review Date: //20__
Next Review Due: //20__
