SyRI (Systeem Risico Indicatie)
Description
State system for detecting social benefits fraud that since 2014 cross-referenced personal data from multiple databases (municipalities, UWV, the tax authority, Social Affairs) with a hidden algorithmic risk model to flag 'unlikely profiles'. It was applied mainly in low-income and minority neighborhoods. A civil rights coalition led by Platform Bescherming Burgerrechten sued it ('Bij Voorbaat Verdacht' campaign). On February 5, 2020 the court of The Hague ordered it to be halted for violating art. 8 of the ECHR, due to lack of transparency and insufficient safeguards.
Lessons learned
An opaque risk model applied to poor neighborhoods discriminates and erodes trust; the opacity made it impossible even to verify whether the algorithm was discriminatory. Simple, transparent preventive controls are more effective and proportionate than mass surveillance. The ruling forced UWV and the tax authority to reassess their algorithmic systems and fueled the debate that preceded the benefits scandal (toeslagenaffaire).