Bringing Visibility to Fraud Detection
Result
€400K saved
Fraud Reduction
€900K → €500K
Challenge
bol.com had invested significantly in building sophisticated fraud detection systems using machine learning. However, despite having great tools in place, there was no visibility into whether these systems were actually working and how to quantify their impact. Fraud owned the numbers, but the analytics team owned the tools to stop fraud. Without owning the numbers, it was difficult to measure, improve, or stay the course on fraud prevention initiatives.
Solution
- Metric Definition and Alignment: Defined clear metrics for fraud detection effectiveness and worked to align ownership between the fraud team and analytics team.
- Ground Truth Analysis: Deployed ground truth analysis to verify whether blocks were actual fraud cases, understanding what the ML flags meant and systematically verifying blocked transactions.
- Visibility Dashboard: Built comprehensive dashboards that showcased the great work being done by the fraud detection team, making the impact visible to stakeholders across the organisation.
Results
Hard numbers showed fraud went from €900K in 2024 to €500K in 2025, demonstrating a €400K reduction in fraud losses. Established clearer ownership lines and confirmed the effectiveness of the ML-based fraud detection through ground truth analysis.
"Ahad brought tremendous energy to the project. What really set him apart was his commitment to alignment—he made sure we were all on the same page before development started, and then kept us aligned throughout. The metrics we defined together aren't just sitting in a dashboard, they're actually being used properly and don't get lost. That's rare."
— Atanas Trodowski, Product Owner, bol.