Live event

Security Superstream: Secure Code in the Age of AI

Navigating risk to build safe and reliable systems

The live event has ended

Event description

AI tools are transforming the ways that we write and deploy code, making development faster and more efficient, but they also introduce new risks and vulnerabilities. To protect organizations, security must remain a paramount concern across the entire AI ecosystem.

Join top security professionals, software engineers, developers, data scientists, and AI specialists as they share practical insights, real-world experiences, and emerging trends to address the full spectrum of AI security. Whether you’re focused on secure coding practices, building and deploying secure models, or protecting against AI-specific threats, this event offers valuable perspectives on ensuring that your systems remain secure in an increasingly AI-driven world.

What you’ll learn and how you can apply it

  • Understand and apply AI security frameworks such as MAESTRO and the Databricks AI Security Framework
  • Test the security of AI systems with AI red team best practices
  • Defend AI systems from the biggest threats with MITRE ATLAS
  • Explore AI safety risks and how to mitigate them

Schedule

The time frames are only estimates and may vary according to how the class is progressing.

Introduction – Chloé Messdaghi (5 minutes)

  • Chloé welcomes you to the Security Superstream.

MITRE ATLAS: Community-Driven Tools for AI Security and Assurance – Christina Liaghati and Walker Dimon (35 minutes)

  • MITRE ATLAS (atlas.mitre.org) is a public knowledge base of adversary tactics and techniques based on real-world attack observations and realistic demonstrations from artificial intelligence red teams and security groups. A growing number of vulnerabilities can arise with the use of open source AI models or data, and ATLAS raises community awareness and readiness for these unique threats in the broader AI assurance landscape. Christina Liaghati and Walker Dimon of the ATLAS team discuss the latest MITRE ATLAS-community efforts to capture and share cross-community data on real-world AI incidents and to develop mitigations to defend against AI security threats and vulnerabilities.

From Risk to Resilience: Empowering Security to Unlock Enterprise AI – Omar Khawaja (35 minutes)

  • While business and data teams race ahead with AI, security and governance leaders are often hesitant, slowing enterprise AI adoption. How can organizations rapidly and confidently adopt AI while managing security risks? Omar Khawaja, who leads Databricks’ Field Security practice, introduces the Databricks AI Security Framework (DASF), an operational guide that helps bridge the divide between enterprise AI enthusiasts and security professionals. You’ll learn the 12 components of a modern AI system and how its four subsystems interact, as well as how to identify the 62 risks and threats at each layer and map them to 64 actionable controls.

Break (5 minutes)

MAESTRO: A Novel Threat Modeling Framework for Agentic AI – Ken Huang (35 minutes)

  • Traditional threat modeling frameworks are not sufficient to address the unique security challenges posed by agentic AI systems. Ken Huang, CEO and chief AI officer of DistributedApps.ai and a research fellow at Cloud Security Alliance, introduces MAESTRO, a new seven-layer threat modeling approach designed specifically for agentic AI. You’ll discover the limitations of legacy frameworks when applied to agentic AI systems and get a comprehensive overview of the MAESTRO framework’s layers: foundation models, data operations, agent frameworks, deployment infrastructure, evaluation and observability, security and compliance, and the agent ecosystem. Using a practical example of threat modeling for the Model Context Protocol, Ken demonstrates how to apply MAESTRO to identify and mitigate novel threats. He’ll also preview an open source tool, currently in development, that showcases how MAESTRO can be operationalized to manage threats in real-world, complex AI systems.

Ignore Previous Directions – Ram Shankar Siva Kumar (35 minutes)

  • Ram Shankar Siva Kumar, author and Tech Policy Fellow at UC Berkeley, provides an overview of the art and science—along with the societal implications—of AI system attacks. He’ll take you through the evolution of adversarial examples to the now-famous jailbreaks, to consider why it’s so darn difficult to secure AI systems from adversaries.

Break (5 minutes)

Resolving Incidents at the Speed of Agents – Ralph Bird (35 minutes)

  • It’s 3 o’clock in the morning and PagerDuty has woken you up, again. Half asleep, you open up your IDE and ask your coding assistant what’s going on. It gets straight to work, pulling the incident data from PagerDuty, grabbing the latest metrics and logs, and identifying possible causes. Your assistant goes back to PagerDuty to find similar incidents and pull up incident reviews. It proposes a code change before running your test suite and opening a PR with the fix. The incident is over, and you’re heading back to bed. Ralph Bird, staff machine learning engineer at PagerDuty, shows how incident response is being revolutionized by AI agents and MCPs. You’ll see a real-world demo of an agent gathering intel, diagnosing issues, and taking action, all within your IDE. But with the move from demo to production, new challenges emerge, especially around security, reliability, and trust. Ralph shares practical insights into these hurdles and the robust safeguards being built to ensure these solutions solve problems without creating bigger ones.

AI Safety for Businesses – Merve Hickok (35 minutes)

  • General-purpose AI models amplify known risks such as bias, privacy, explainability, and cybersecurity. They also bring new risks such as hallucinated outcomes, granular surveillance, and adversarial actions via deepfakes. The ability to interact simply with natural language instructions also significantly increases the threat surface for adversarial attacks. Merve Hickok, president of the Center for AI and Digital Policy, discusses some of these safety and security risks and their impact on businesses.

Closing Remarks – Chloé Messdaghi (5 minutes)

  • Chloé closes out today’s event.