Towards a multi-stakeholder value-based assessment framework for algorithmic systems

  Means Value(s) and Manifestation(s) DT AT DE DS Application (model) Approach Visual elements Additional details
[Z] Fairlearn1 ([30]) PERFORMANCE
- Accuracy
- False Positive and Negative rates
- Precision and recall rates

FAIRNESS
- Accuracy across groups
- False Positive and Negative rates across groups
- Debiasing algorithms
    Agnostic   - Bar charts
- Pie charts
 




Red: descriptive documents specifying whether/how a value manifestation is fulfilled
Blue: strategy for fulfilling value manifestations
Green : complete tool for enabling the fulfillment of value manifestations

DT: Development Team
AT: Auditing Team
DE: Data domain Experts
DS: Decision Subject

Back to “Tailored communication of system-related information”

Back to main page

  1. https://github.com/fairlearn/fairlearn