Staff Product Manager - AI Evals
ABOUT THE COMPANY
America is under sustained cyber attack. Our adversaries infiltrate our networks, steal our IP, and degrade the digital infrastructure that modern life runs on. They’ve learned—correctly—that those attacks rarely produce consequences.
Twenty was founded to change that, by making our adversaries think twice before they attack us. Our vision is American and allied primacy in cyberspace—a future where they cannot contest us, deterrence is assured, and the free world remains secure.
Founded in 2024, Twenty Technologies ( industrializes offensive cyber operations for the U.S. and its allies. Headquartered in Arlington, Virginia, Twenty has raised $168M from Khosla Ventures, Accel, Caffeinated Capital, Friends & Family Capital, Point72 Ventures, General Catalyst, and In-Q-Tel.
Mission | On Site | Full Time | U.S. Citizenship Required / No Active Clearance Required
ROLE SUMMARY
Twenty builds AI-enabled technology for mission-critical cyber operations. We're seeking a Staff Product Manager to help make agentic AI systems measurable, reliable, and continuously improvable. You’ll partner with AI and engineering teams to shape evaluation capabilities—from defining agent performance and product quality to turning results into useful workflows and product decisions.
The strongest candidates will bring meaningful experience building or managing agentic systems, either by directly building evaluations or by building the systems that enable teams to evaluate and improve agents. Cyber experience is a plus, but not required.
WHO YOU ARE
- You're a product-minded, technically curious operator who is excited about how agentic systems work and how to make them better.
- You bring strong product judgment and can turn complex technical needs into clear, usable product direction.
- You enjoy partnering with engineers and AI teams, asking good questions, and working through ambiguity together....