Towards a multi-stakeholder value-based assessment framework for algorithmic systems

  Means Value(s) and Manifestation(s) DT AT DE DS Application (model) Approach Visual elements Additional details
[K] Datasheets for datasets ([62]) TRANSPARENCY
- Description of data generation process
- Disclosure of origin and properties of models and data

NON-DISCRIMINATION
-Analysis of data for potential biases, data quality assessment

PRIVACY
- Written declaration of consent
- Description of what data is collected
- Description of how data is handled
- Purpose statement of data collection
- Statement of how long the data is kept

FAIRNESS
- Election of protected classes

SECURITY
- Membership inference
    Agnostic   - Summary statistics
- Visual examples of datasets (if images, for instance)
 




Red: descriptive documents specifying whether/how a value manifestation is fulfilled
Blue: strategy for fulfilling value manifestations
Green : complete tool for enabling the fulfillment of value manifestations

DT: Development Team
AT: Auditing Team
DE: Data domain Experts
DS: Decision Subject

Back to “Tailored communication of system-related information”

Back to main page