Towards a multi-stakeholder value-based assessment framework for algorithmic systems

  Means Value(s) and Manifestation(s) DT AT DE DS Application (model) Approach Visual elements Additional details
[AD] Error Analysis dashboard1 NON-DISCRIMINATION
- Analysis of data for potential biases, data quality assessment

EXPLAINABILITY
- Post-hoc explanations

FAIRNESS
- Accuracy across groups
    Agnostic   - Decision tree
- Error heatmap
 




Red: descriptive documents specifying whether/how a value manifestation is fulfilled
Blue: strategy for fulfilling value manifestations
Green : complete tool for enabling the fulfillment of value manifestations

DT: Development Team
AT: Auditing Team
DE: Data domain Experts
DS: Decision Subject

Back to “Tailored communication of system-related information”

Back to main page

  1. https://github.com/microsoft/responsible-ai-toolbox/blob/main/docs/erroranalysis-dashboard-README.md