Fair EVA
Fairness EVAluation of Voice Technologies
Project Mission
Fair EVA is an open source project that is gathering resources and building tools
to help researchers and developers, technology activists and voice technology users
evaluate and audit bias and discrimination in voice technologies.
Enabled through the Mozilla Technology Fund Award!
We are proud to be part of Mozilla's first cohort of projects supported with a Mozilla Technology Fund Award.
News and Updates
We are at IEEE IJCB '23
to present Benchmark Dataset Dynamics, Bias and Privacy Challenges in Voice Biometrics Research
Research Summary
Our research on bias and privacy challenges in voice biometrics has been featured on the Montreal AI Ethics Blog.
Featured on Channel 4 News
How to we prevent AI from creating deepfakes? Wiebke weighs in on this question on Channel 4 News. Take a look.
The Computer Says Nah
Michaela and Anna are premiering a XR Prediction experience inspired by FairEVA in NYC. The Tale False Negative or The Computer Says Nah. Check it out!
The bt4vt library has been released!
After a year of hard work, the bias tests for voice tech python library is ready with bias evaluations for speaker verification. Check it out: https://github.com/wiebket/bt4vt
Dataset Audit: read the preprint
We have published the results of our dataset audit. Read it here: About Voice: A Longitudinal Study of Speaker Recognition Dataset Dynamics
INTERSPEECH '22: Design Guidelines for Speaker Verification Evaluation
We have published a technical analysis of design considerations for robust and inclusive speaker verification evaluation. Read it here: Design Guidelines for Inclusive Speaker Verification Evaluation Datasets
The Proposed EU AI Act and The Case of Biometrics
Fair EVA project lead, Wiebke Hutiri, shares her perspectives on voice biometrics and the proposed EU AI Act in the Mozilla Blog. Read it here: The Proposed EU AI Act and The Case of Biometrics
Presentation to the European Association on Biometrics (EAB)
The EAB invited us to present our work on voice recognition at the Artificial Intelligence Act Workshop 2022.
We're at ACM FAcct 2022 in Korea
The research that forms the foundation of FairEVA will be presented at the ACM FAccT 2022 conference. Take a read:
Bias in Automated Speaker Recognition
Fair EVA Featured on the Mozilla Blog
Read more about Fair EVA and why we exist in this blog post: Access Denied! This Doesn’t Sound Like You
Seen at virtual MozFest 2022
We hosted a session on Fair Voice: What happens when your voice becomes your ID? at MozFest 2022, with panelists Halsey Burgund, Johann Diedrick, Kathleen Siminyu and Wiebke Hutiri.