All writing
AI Deployment

AI Product Management Is Not Software Product Management

The mental models from software PM work do not transfer to AI. Some of them are actively misleading. The gap changes almost everything about the job.

I spent years as a product manager building data products before I started working on AI. The transition was humbling in ways I didn't expect. Not because AI is more technically complex — it is, but complexity is manageable. The problem is that the mental models I'd built from that work don't transfer. Some of them are actively misleading.

In software PM, you define requirements, your engineers build to spec, and the system does what it was built to do. If a button is supposed to save a record, it saves a record. Every time. If it doesn't, that's a bug, and you fix it. The system is deterministic. Your job as a PM is to decide what the system should do, then make sure it does it.

In AI PM, you define an objective, your team builds a system that approximates that objective, and the system produces outputs that are right most of the time but wrong some of the time, in ways you can't fully predict, for reasons you can't always explain. That isn't a bug. That's the product.

The gap between those two realities changes almost everything about the job.

Requirements don't work the same way

Software product management runs on requirements. User stories, acceptance criteria, feature specs — the entire discipline is built around defining exactly what the system should do, then verifying that it does it. This is a clean framework. It produces accountability. It works.

AI products resist this framework. You can't write an acceptance criterion that says "the model shall correctly classify 100% of inputs" because it won't. You can set an accuracy target — 90%, 95% — but that target is a statistical property of a population, not a guarantee about any individual output. The system will be wrong. The question isn't whether. It's how often, in what ways, and with what consequences.

This changes the PM's job fundamentally. Instead of defining what the system should do, you're defining what level of error is acceptable and what happens when errors occur. That's a different discipline. It requires you to think in distributions, not binaries. It requires you to have conversations with stakeholders that sound like: "This system will misclassify roughly one in twelve inputs. Here's what that means for the workflow, here's what the fallback is, and here's how we'll know if it's getting worse."

Most stakeholders have never had that conversation. They expect the system to work or not work. "Works 88% of the time" doesn't fit in any box they have.

Iteration means something different

In software, iteration is additive. You ship a feature, get feedback, improve it, ship again. The product gets better in a predictable direction. Users can see the improvement. The roadmap reflects a sequence of enhancements.

In AI, iteration is often corrective and unpredictable. The model performs well on the test set but degrades in production because the real-world data distribution doesn't match training. You retrain with new data and accuracy improves on one segment but drops on another. A source system updates its schema and the feature pipeline silently drifts. You're not building forward on a stable foundation. You're maintaining an equilibrium against a changing environment.

This messes with roadmap planning in ways that are hard to explain to leadership. "We spent the last sprint preventing the model from getting worse" is a true statement that sounds like no progress was made. The PM has to translate maintenance into business language that leadership will accept, which usually means reframing stability as a feature: "We maintained 93% accuracy against a 15% shift in input distribution." That's a real achievement. It doesn't look like one on a Gantt chart.

The stakeholder conversation is harder

Software PMs manage expectations about timelines and features. AI PMs manage expectations about uncertainty itself.

When a VP asks "will this work?" the software PM can give a confident answer based on technical feasibility. The AI PM has to say: "It will work for most cases, and here's how we'll handle the ones where it doesn't." That answer requires the stakeholder to accept a fundamentally different relationship with the product — one where perfect isn't the target and error is a design parameter, not a failure.

I've watched stakeholders hear "85% accuracy" and process it as "doesn't work." I've watched other stakeholders hear "85% accuracy" and process it as "works" without asking what happens to the other 15%. Both reactions are wrong, and the AI PM's job is to navigate the space between them. The 15% error rate might be fine if the errors are low-consequence and easily caught. It might be catastrophic if even one misclassification triggers a regulatory issue. The number alone doesn't tell you. The context does.

This is why statistical literacy isn't optional for AI PMs. Not because you need to tune hyperparameters — you have data scientists for that. Because you need to explain probabilistic behavior to people who make deterministic decisions. You need to know the difference between precision and recall, not so you can compute them, but so you can explain to a business leader why optimizing for one degrades the other and which tradeoff serves the business.

What actually transfers, and what doesn't

Some software PM skills transfer well. Stakeholder management. Cross-functional coordination. The ability to synthesize technical and business concerns into a coherent plan. The instinct for scope management — knowing when to cut.

What doesn't transfer: the assumption that shipping means done. The expectation that defined requirements lead to predictable outputs. The mental model where the PM owns the "what" and engineering owns the "how," cleanly separated. In AI product management, the "what" and the "how" are entangled. The data shapes what's possible. The model architecture constrains what the product can promise. The PM who doesn't engage with those realities — who stays at the user story level and delegates everything technical — will build a roadmap that the system can't deliver.

The hardest adjustment for me was accepting that my job wasn't to eliminate uncertainty but to manage it. To build products that are useful despite being imperfect. To set expectations that are honest without being discouraging. To make decisions with incomplete information and defend those decisions with data, not conviction.

Software PM is about building the right thing. AI PM is about building something that's right enough, and knowing what "enough" means for your specific context.

The skill set is related. It's not the same.