The Uncomfortable Truth About AI and Bioterrorism: Why We Need to Talk About Vibe-Coded Doomsday Scenarios
Let's be honest for a moment. The tech industry loves a good abstraction. We can spend years debating whether AI will achieve consciousness, whether large language models "really" understand things, or whether AGI will emerge by 2027 or 2035. These are fascinating philosophical questions. They're also, when you think about it, a convenient way to avoid talking about the concrete, near-term risks that are already materializing.
Here's a scenario that keeps me up at night: A moderately intelligent person with no specialized biology knowledge uses a jailbroken AI model to design and synthesize pathogens. They release these pathogens in a public space. Within months, civilization as we know it begins to collapse.
Does this sound far-fetched to you? It shouldn't. And that's precisely what makes it terrifying.
The Access Problem Is Already Here
We like to think that dangerous biology requires expensive labs, specialized knowledge, and years of training. But that barrier is eroding faster than most people realize. Benchtop DNA synthesizers exist. Online biolabs will synthesize genetic material for anyone with a credit card. The knowledge of how pathogens work is freely available in academic literature that has existed for decades.
Now layer AI into this equation. Not even frontier AI—just models that exist today. A sufficiently motivated individual with decent prompting skills can use these tools to:
- Design novel viral constructs with enhanced transmissibility
- Identify vulnerabilities in biological defense systems
- Model protein structures for targeted therapeutics—or targeted weapons
- Bypass ethical guardrails that responsible developers built in
The gap between "knowledge exists" and "knowledge is actionable" is closing rapidly. And AI is the bridge.
The Alignment Gap Nobody Talks About
Here's what frustrates me about most AI safety discussions: they focus on abstract alignment problems while ignoring the practical reality that alignment and safety are different things. A model can be perfectly aligned to "do what users want" while still enabling catastrophic misuse. That's not a bug—it's a feature of how these systems are designed.
Jailbroken models don't have safety guardrails. But they still have capabilities. And here's the uncomfortable truth: those capabilities are increasing faster than our ability to implement meaningful safeguards. We're building increasingly powerful tools and hoping that keeping them "in jail" will be enough.
It won't be. Not forever. Not against someone sufficiently motivated.
What Actually Keeps Me Up at Night
I'm not a doomer by nature. I've built software for two decades, and I've seen technology solve far more problems than it creates. But I've also seen how quickly things can spiral when incentives misalign with safety.
The scenario I describe isn't science fiction. It's a plausible timeline of events, given current trajectories. And the worst part? There's no obvious technological solution. We can't uninvent AI. We can't unlearn the biology. The knowledge exists, and it will become increasingly actionable.
This doesn't mean we should panic. It means we need to have uncomfortable conversations about:
- How we regulate DNA synthesis and biolab access
- What responsibilities AI developers have for misuse
- How we build meaningful safeguards without stifling beneficial research
- Whether the current approach to AI development adequately accounts for dual-use risks
The developer community—people building these systems, deploying them, and creating the infrastructure they run on—needs to be part of this conversation. We're not just building software anymore. We're building capabilities with civilizational implications.
That's worth thinking about, even if it's uncomfortable.
The Path Forward
I'm not suggesting we halt AI development. The benefits are too significant, and the competitive dynamics make unilateral restraint impractical. But I am suggesting that developers, investors, and policymakers need to take biosecurity risks seriously as a near-term concern, not just a speculative future problem.
The age of vibe coding is upon us. We can build amazing things with AI assistance. We can also, apparently, design doomsday pathogens if we're so inclined. The question isn't whether this capability will exist—the question is whether we'll build the safeguards, regulations, and social infrastructure to prevent catastrophe before it happens.
My advice? Take this seriously. Read the research on AI-enabled bioterrorism. Talk to biosecurity experts. Support organizations working on this problem. And when you're building the next AI-powered application, take a moment to consider the broader context of what you're helping to create.
We're all building the future together. Let's make sure there's still a civilization around to experience it.