CFP: A Reinforcement Learning Framework for Comprehensive Fairness-Performance Trade-Off in Machine Learning

Simiao Zhang, Jitao Bai, Menghong Guan, Yueling Zhang*, Jun Sun, Yihao Huang, Jiaping Wang, Cheng Cheng Wan, Ting Su, Geguang Pu*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Machine learning models are increasingly used for impactful decisions, such as loan approval, criminal sentencing, and resume filtering, raising concerns about ensuring fairness without sacrificing performance. However, fairness has multiple definitions, and existing techniques targeting specific metrics have limitations in improving multiple notions of fairness simultaneously. In this work, we establish a comprehensive measurement to simultaneously consider multiple fairness notions as well as performance, and propose new metrics through an in-depth analysis of the relationship between different fairness metrics. Based on the comprehensive measurement and new metrics, we present CFP, a reinforcement learning-based framework, to efficiently improve the fairness-performance trade-off in machine learning classifiers. We conduct extensive experiments to evaluate CFP on 6 tasks, 3 machine learning models, and 15 fairness-performance measurements. The results demonstrate that CFP can improve the classifiers on multiple fairness metrics without sacrificing its performance.

Original languageEnglish
Title of host publicationArtificial Neural Networks and Machine Learning – ICANN 2024 - 33rd International Conference on Artificial Neural Networks, Proceedings
EditorsMichael Wand, Jürgen Schmidhuber, Michael Wand, Kristína Malinovská, Jürgen Schmidhuber, Igor V. Tetko, Igor V. Tetko
PublisherSpringer Science and Business Media Deutschland GmbH
Pages463-477
Number of pages15
ISBN (Print)9783031723315
DOIs
StatePublished - 2024
Event33rd International Conference on Artificial Neural Networks, ICANN 2024 - Lugano, Switzerland
Duration: 17 Sep 202420 Sep 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume15016 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference33rd International Conference on Artificial Neural Networks, ICANN 2024
Country/TerritorySwitzerland
CityLugano
Period17/09/2420/09/24

Keywords

  • Ethics of AI
  • Fairness in machine learning
  • Fairness-performance trade-off
  • Reinforcement learning

Fingerprint

Dive into the research topics of 'CFP: A Reinforcement Learning Framework for Comprehensive Fairness-Performance Trade-Off in Machine Learning'. Together they form a unique fingerprint.

Cite this