Tell me about a time you had to gather data to support a product decision. What data did you use and how did it change your approach?
Model answer
Model answerI was debating between two onboarding flows for new users. Rather than relying on intuition, I set up an A/B test with 500 users and tracked completion rate, time-to-value, and churn at day 30. The data showed Flow B had a 23% higher completion rate despite being longer. I recommended Flow B even though the design team preferred Flow A. The test prevented us from shipping a worse experience and saved us from learning this mistake in production.
Framework · Data-Driven Decision Making
- DDefine Success Metrics
Identify what you'll measure to evaluate each option - TDesign the Test
Set up an experiment with a clear hypothesis and control group - CCollect and Analyze
Run the test for adequate time to reach statistical significance - OOvercome Bias
Make the recommendation based on data even if it contradicts your preference
Related questions
- Tell me about a time you had to deliver a product feature with unclear requirements. How did you handle it?
- Describe a situation where you had to prioritize feature requests. What framework did you use to make the decision?
- Tell me about a time when a metric you were tracking didn't match your intuition about product performance. What did you do?
- Describe a time you had to work with a difficult stakeholder or team member. How did you manage the relationship?
- Tell me about a time you launched a product that initially underperformed. How did you decide whether to pivot or persevere?