Seungjae Shin, Byeonghu Na, HeeSun Bae, JoonHo Jang, Hyemi Kim, Kyungwoo Song, Youngjae Cho, and Il-Chul Moon, Improving Group-based Robustness and Calibration via Ordered Risk and Confidence Regularization, Workshop on Spurious Correlations, Invariance and Stability, International Conference on Machine Learning (ICML Workshop 2022), Baltimore, USA, Jul 22, 2022

Abstract 

Neural network trained via empirical risk minimization achieves high accuracy on average but low accuracy on certain groups, especially when there is a spurious correlation. To construct the unbiased model from spurious correlation, we build a hypothesis that the inference to the samples without spurious correlation should take relative precedence over the inference to the spuriously biased samples. Based on the hypothesis, we propose the relative regularization to induce the training risk of each group to follow the specific order, which is sorted according to the degree of spurious correlation for each group. In addition, we introduce the ordering regularization based on the predictive confidence of each group to improve the model calibration, where other robust models still suffer from large calibration errors. These result in our complete algorithm, Ordered Risk and Confidence regularization (ORC). Our experiments demonstrate that ORC improves both the group robustness and calibration performances against the various types of spurious correlation in both synthetic and real-world datasets. 

@inproceedings{ shin2022improving, 

title={Improving Group-based Robustness and Calibration via Ordered Risk and Confidence Regularization}, 

author={Seungjae Shin and Byeonghu Na and HeeSun Bae and JoonHo Jang and Hyemi Kim and Kyungwoo Song and Youngjae Cho and Il-Chul Moon}, 

booktitle={ICML 2022: Workshop on Spurious Correlations, Invariance and Stability}, 

year={2022}, 

url={https://openreview.net/forum?id=okCTFCRavwh} 

} 

Source Website:

https://openreview.net/forum?id=okCTFCRavwh