fairlearn/fairlearn

DOC Contribute to the "Stakeholder Identification" section of the user guide

Aperta

#1543 aperta il 12 apr 2025

 (0 commenti) (2 reazioni) (0 assegnatari)Python (504 fork)auto 404
documentationhelp wanted

Metriche repository

Star
 (2254 stelle)
Metriche merge PR
 (Metriche PR in attesa)

Descrizione

Overview Breaking down #1411 into a smaller scope for beginning contributors.

This issue concerns the development of a new section in the User Guide that describes how users should identify the stakeholders who may be impacted by an AI system. This issue is scoped to finishing the section.

Refer to PR #1479 for the beginning portion of this section and a guide to the tone of this section.

Where should this new content go? Under the Fairness in Machine Learning section, within the section named "Stakeholder Identification." We are aiming for the additional content to take up an additional ~5 or so paragraphs.

What should this section include?

The section should include content that covers items 1 and 2.

  1. Identifying stakeholders: include a summary of who should be involved in this process. Can include groups like the data scientists and UX research teams working on the ML project, social scientists, and domain experts and stakeholders themselves. Also guidance on how to determine which stakeholders are relevant to the project.

Resources: Draw from this paper and this guidance from Microsoft

  1. Identifying factors and groups, within (or across) stakeholder roles: include a few paragraphs about how factors and groups may cause stakeholders to be impacted differently by the AI system

Guidance:

  • The most relevant factors and groups might be specific to your AI feature or the use case and deployment context
  • Stakeholder selection should consider historical disparities that may impact the use case and context
  • Stakeholders should be specific to the use case, i.e. for developing a AI that does language translation you might want to include second language learners in evaluating the system
  • Stakeholders will be specific to the cultural context (see examples here )
  • Point to the importance of construct validity in defining social categories, can link to construct validity section of the user guide

Resources: 1, 2, and 3 may be helpful as you write this section.

Refer to issue #1411 for additional links to use in drafting the section.

If I get stuck, who should I ask for help? Reach out to me or to @mmadaio for guidance.

Guida contributor