Study offers a better way to make AI fairer for everyone

· ScienceDaily
Source:Carnegie Mellon University
Summary:Scientists show a new way of thinking about the fair impacts of AI decisions. They draw on a well-established tradition known as social welfare optimization, which aims to make decisions fairer by focusing on the overall benefits and harms to individuals. This method can be used to evaluate the industry standard assessment tools for AI fairness, which look at approval rates across protected groups.

n a new paper, researchers from Carnegie Mellon University and Stevens Institute of Technology show a new way of thinking about the fair impacts of AI decisions. They draw on a well-established tradition known as social welfare optimization, which aims to make decisions fairer by focusing on the overall benefits and harms to individuals. This method can be used to evaluate the industry standard assessment tools for AI fairness, which look at approval rates across protected groups.

"In assessing fairness, the AI community tries to ensure equitable treatment for groups that differ in economic level, race, ethnic background, gender, and other categories," explained John Hooker,  professor of operations research at the Tepper School at Carnegie Mellon, who coauthored the study and presented the paper at the International Conference on the Integration of Constraint Programming, Artificial Intelligence, and Operations Research (CPAIOR) on May 29 in Uppsala, Sweden. The paper received the Best Paper Award.

Imagine a situation where an AI system decides who gets approved for a mortgage or who gets a job interview. Traditional fairness methods might only ensure that the same percentage of people from different groups get approved. But what if being denied a mortgage has a much bigger negative impact on someone from a disadvantaged group than on someone from an advantaged group? By employing a social welfare optimization method, AI systems can make decisions that lead to better outcomes for everyone, especially for those in disadvantaged groups.

The study focuses on "alpha fairness," a method of finding a balance between being fair and getting the most benefit for everyone. Alpha fairness can be adjusted to balance fairness and efficiency more or less, depending on the situation.

Hooker and his coauthors show how social welfare optimization can be used to compare different assessments for group fairness currently used in AI. By using this method, we can understand the benefits of applying different group fairness tools in different contexts. It also ties these group fairness assessment tools to the larger world of fairness-efficiency standards used in economics and engineering.

"Our findings suggest that social welfare optimization can shed light on the intensely discussed question of how to achieve group fairness in AI," Leben said.

The study is important for both AI system developers and policymakers. Developers can create more equitable and effective AI models by adopting a broader approach to fairness and understanding the limitations of fairness measures. It also highlights the importance of considering social justice in AI development, ensuring that technology promotes equity across diverse groups in society.

Related Terms

Environmental impact assessmentAn Environmental Impact Assessment (EIA) is an assessment of the likely human environmental health impact, risk to ecological health, and changes to nature's services that a project may have. The purpose of the assessment is to ensure that decision-makers consider environmental impacts before deciding whether to proceed with new projects. The US Environmental Protection Agency pioneered the use of pathway analysis to determine the likely human health impact of environmental factors. The technology for performing such analysis is properly labelled environmental science. The principal phenomena or pathways of impact are: soil contamination impacts, air pollution impacts, noise health effects, ecology impacts including endangered species assessment, geological hazards assessment and water pollution impacts.Social scienceSocial science is an academic discipline concerned with society and the relationships among individuals within a society, which often rely primarily on empirical approaches. It includes anthropology, economics, political science, psychology and sociology. In a wider sense, it may often include some fields in the humanities such as archaeology, history, law, and linguistics. Positivist social scientists use methods resembling those of the natural sciences as tools for understanding society, and so define science in its stricter modern sense. Interpretivist social scientists, by contrast, may use social critique or symbolic interpretation rather than constructing empirically falsifiable theories, and thus treat science in its broader sense. In modern academic practice, researchers are often eclectic, using multiple methodologies (for instance, by combining the quantitative and qualitative techniques). The term social research has also acquired a degree of autonomy as practitioners from various disciplines share…MicroeconomicsMicroeconomics is one of the main fields of the social science of economics.StatisticsStatistics is a mathematical science pertaining to the collection, analysis, interpretation or explanation, and presentation of data.JusticeJustice is a concept of moral rightness based ethics, rationality, law, natural law, religion, equity and fairness, as well as the administration of the law, taking into account the inalienable and inborn rights of all human beings and citizens, the right of all people and individuals to equal protection before the law of their civil rights, without discrimination on the basis of race, gender, sexual orientation, gender identity, national origin, color, ethnicity, religion, disability, age, wealth, or other characteristics, and is further regarded as being inclusive of social justice.TechnologyTechnology is a broad term dealing with the use and knowledge of humanity's tools and crafts.SocietyA society, or a human society, is a group of people involved with each other through persistent relations, or a large social grouping sharing the same geographical or social territory, typically subject to the same political authority and dominant cultural expectations.