Roadmaps Security roadmaps AI and machine learning security

Agentic AI and MCP Security

Secure AI agents that plan, use tools and act on people's behalf, including MCP servers, agent identity, sandboxing and multi-agent systems.

Estimated time: 12–23 months · At about 10 hours a week.

Offensive skills are for authorised testing only: your own lab, a practice platform, or a system whose owner has given you written permission. Testing anything else is a crime in most countries.

Learning path

Click a topic to see what to learn and where. Mark topics as you go; your progress is saved in this browser only.

  • Core topic
  • Optional
  1. Beginner · 1–2 months How agents work and where they fail
  2. Intermediate · 2–4 months Permissions, identity and MCP security
  3. Advanced · 3–5 months Memory, multi-agent systems and monitoring
  4. Expert · 6–12 months Platforms, standards and research

All topics in detail

BeginnerTime: 1–2 months

How agents work and where they fail

Skills

  • Explain how an agent loop and MCP work, step by step.
  • Spot excessive agency in an agent design.
  • Show an indirect injection making an agent misuse a tool in a lab.

Hands-on projects and labs

  • Build a small agent with two tools (for example read a file and send a message) and make it leak a file through an injected instruction.
  • Run the AgentDojo benchmark against a model and look at which attacks succeed.
  • Write a simple MCP server and list every action it lets a client take.

Done when you can…

  • Review an agent design and name each tool's worst case.
  • Explain why an agent that reads email and can send email is risky.

Beginner

Agents, tools and function calling

An agent loops: the model reads the task, picks a tool, reads the result and decides the next step. Learn how tool calls are described and returned.

Resources

Beginner

Model Context Protocol (MCP)

MCP connects AI apps (clients) to servers that offer tools, resources and prompts. Learn the roles, the transports and what each server can see and do.

Resources

Beginner

Agentic AI threats

OWASP's agentic threat list covers tool misuse, privilege compromise, memory poisoning, goal manipulation, rogue agents and more. Use it to frame every review.

Resources

Beginner

Excessive agency

Agents get too many tools, too much permission or too much freedom to act without asking. Cut each one down to what the task needs.

Resources

Beginner

Prompt injection through tools

Every web page, email, file or tool result an agent reads can carry instructions. With tools, an injection can send data out or change things, not just say something odd.

Resources

Beginner

Private data, untrusted content and a way out

When one agent can read private data, read untrusted content and send data outside, an injection can steal that data. Remove at least one of the three.

Resources

Beginner

Human approval for risky actions

Ask a person before an agent pays, deletes, sends or changes permissions. Show exactly what will happen, so approval is a real check and not a habit.

Resources

IntermediateTime: 2–4 months

Permissions, identity and MCP security

Skills

  • Give an agent its own scoped, short-lived credentials.
  • Secure a remote MCP server with proper OAuth checks.
  • Run a code-executing agent in a sandbox with no secrets and limited network.
  • Enforce tool policies in code, outside the model.

Hands-on projects and labs

  • Build a remote MCP server with OAuth, then test it for token passthrough and missing scope checks.
  • Run an agent's code tool inside gVisor or a locked-down container and try to escape or reach the network.
  • Add Open Policy Agent checks in front of an agent's tools and show an injected request being blocked.

Done when you can…

  • Show an agent design where a successful injection still cannot reach private data and an outside channel at the same time.
  • Explain who is accountable for each action an agent took, from its logs.

Intermediate

Agent identity

Give each agent its own identity instead of sharing a person's password or a long-lived key. Then you can limit it, log it and switch it off.

Resources

Intermediate

Delegated access and OAuth for agents

When an agent acts for a user, use delegated, scoped, short-lived tokens and keep a record of both the user and the agent. Token exchange helps with chains of services.

Resources

Intermediate

MCP authorisation

Remote MCP servers use OAuth to decide who may call them. Check audience and scopes, never pass a client's token straight through to another service, and protect the consent step.

Resources

Intermediate

Designing safe tools

Make tools narrow (send to this one address, not anyone), validate every argument in code, and return only the data the task needs.

Resources

Intermediate

Third-party MCP servers

An MCP server you install runs code and sees data. Check who wrote it, pin versions, review its tool descriptions for hidden instructions, and watch for changes after install.

Resources

Intermediate

Sandboxing code-running agents

Agents that run code or shell commands need isolation: containers with tight limits, microVMs or gVisor, no secrets inside, and network access only where needed.

Resources

Intermediate

Policy checks outside the model

Put rules in a policy engine that checks every tool call before it runs. The model can ask; code decides.

Resources

Intermediate

Secrets and credentials for agents

Keep API keys out of prompts, context and the agent's reach. Inject them at the tool layer, scope them, rotate them and log their use.

Resources

AdvancedTime: 3–5 months

Memory, multi-agent systems and monitoring

Skills

  • Design memory that resists poisoning and can be audited.
  • Assess a multi-agent system for trust and permission problems.
  • Build traces and alerts that show what an agent did and why.
  • Test an agent end to end with planted injections.

Hands-on projects and labs

  • Poison a memory-enabled agent you built so a later session follows a planted instruction, then add a defence.
  • Build a two-agent system and show one misleading the other, then separate their permissions.
  • Write detections for an agent sending data to a new destination and test them.

Done when you can…

  • Lead the security review of a production agent or MCP integration.
  • Show a working kill switch that stops an agent and revokes its access.

Advanced

Memory and context poisoning

Agents with long-term memory can be taught false facts or hidden instructions that come back later. Separate memories by user, record where each came from, and let people review them.

Resources

Advanced

Multi-agent trust

When agents talk to agents, a compromised or confused one can mislead the rest. Treat messages between agents as untrusted and keep each agent's permissions separate.

Resources

Advanced

Browser and computer-use agents

Agents that click and type in a browser see every page as possible instructions. Limit them to allowed sites, keep them signed out of sensitive accounts, and confirm risky steps.

Resources

Advanced

Tracing and auditing agents

Log every step: the task, each tool call with its arguments and result, approvals and the identity used. Without traces you cannot investigate what an agent did.

Resources

Advanced

Detecting rogue agent behaviour

Alert on unusual tools, data volumes, destinations or bursts of actions. Have a kill switch that stops an agent and revokes its tokens at once.

Resources

Advanced

Architectures that resist injection

Patterns such as a planner that never reads untrusted data, or tracking which values came from untrusted sources, limit what injections can do.

Resources

Advanced

Testing agents

Test whole tasks, not single prompts: plant injections in the data the agent will read and check what it does. Repeat after every model, prompt or tool change.

Resources

ExpertTime: 6–12 months

Platforms, standards and research

Skills

  • Design an organisation-wide agent platform with security built in.
  • Write agent governance that teams can follow.
  • Discover and publish new agent attack or defence techniques.

Hands-on projects and labs

  • Write a reference architecture for agents at a fictional company, with identity, tools, sandboxes, approvals and logging.
  • Contribute an issue, test or fix to an open agent security project or specification.

Done when you can…

  • Have your patterns, tools or research adopted by others.
  • Own the security of an agent platform used by many teams.

Expert

Securing an agent platform

Give every team the same safe building blocks: agent identities, an approved tool registry, sandboxes, policy checks, approvals and central logging.

Resources

Expert

Accountability and governance for agents

Decide which actions agents may take alone, who approves new tools, and how incidents are handled. Map this to the NIST AI RMF and your existing risk process.

Resources

Expert

Standards and protocols

Agent protocols and their security features are still being written. Follow and contribute to the MCP specification, OWASP and CoSAI work.

Resources

Overview

An AI agent is a model that can decide on steps and take them: read email, browse the web, run code, call APIs, change records. The Model Context Protocol (MCP) has become a common way to connect agents to tools and data. Every tool you connect turns a model's mistake, or an attacker's injected instruction, into a real action.

Agent security combines identity and access management, application security and sandboxing. The core questions are: who is the agent acting for, what is it allowed to do, what untrusted content can reach it, and what stops it when something goes wrong?

Why it matters

Agents are moving from demos into email, coding, customer service and operations. The risks are new and the guidance is young, so people who understand both agents and security are shaping how this is done.

Typical job roles

  • EntryDeveloper building agents and MCP servers Builds tools and integrations with sensible permissions and input checks.
  • Mid-levelAI security engineer (agents) Reviews agent designs, tool permissions and sandboxes, and tests them for injection.
  • Mid-levelIdentity engineer for non-human identities Gives agents their own identities, scoped tokens and audit trails.
  • SeniorAgent security architect Sets the patterns for agent permissions, approvals and isolation across teams.
  • LeadAI platform security lead Owns the security of the organisation's agent platform and tool ecosystem.

Prerequisites

  • The LLM and Generative AI Security beginner and intermediate stages, especially prompt injection.
  • OAuth 2.0 and API authentication basics.
  • Comfort building small apps in Python or TypeScript.
  • Containers and basic Linux security.

Web development AI and machine learning Cybersecurity

Tools and technologies

  • MCP Inspector Open source Connect to and test MCP servers by hand.
  • AgentDojo Open source Benchmark of agent tasks with prompt injection attacks.
  • promptfoo Open source Red-team agents and tools, including in CI.
  • PyRIT Open source Automated red teaming for generative AI, including agents.
  • Open Policy Agent Open source Policy engine to check tool calls before they run.
  • gVisor Open source Sandbox for running untrusted code in containers.
  • Firecracker Open source Lightweight microVMs for strong isolation.
  • SPIFFE and SPIRE Open source Workload identities for services and agents.
  • Langfuse Open source Traces of agent steps and tool calls.

Certifications

Take them in roughly this order. Costs and details for the ones marked with a link are on the Certifications page.

  1. Intermediate Certified AI Security Professional (CAISP) Practical DevSecOpsIncludes LLM and agent security labs.
  2. Advanced AAISM (AI Security Management) ISACAFor AI security management roles, after CISSP or CISM.Cost and exam details

Resources

Frameworks and standards

All frameworks and standards

Career path

A common progression. Titles vary between companies.

  1. Developer or application security engineer0–2 years
  2. AI security engineer working on LLM apps2–4 years
  3. Agent security engineer or identity engineer4–7 years
  4. Agent security architect or AI platform security lead7+ years

Related domains to move into

All security roadmaps Back to top

Last reviewed: . Found a mistake, or want a roadmap written sooner? Contact