Yoon-Yeong Kim, Kyungwoo Song, JoonHo Jang, Il-chul Moon, LADA: Look-Ahead Data Acquisition via Augmentation for Deep Active Learning, Neural Information Processing Systems (NeurIPS 2021), Virtual Conference, Dec 7-10, 2021

Abstract

Active learning effectively collects data instances for training deep learning models when the labeled dataset is limited and the annotation cost is high. Data augmentation is another effective technique to enlarge the limited amount of labeled instances. The scarcity of labeled dataset leads us to consider the integration of data augmentation and active learning. One possible approach is a pipelined combination, which selects informative instances via the acquisition function and generates virtual instances from the selected instances via augmentation. However, this pipelined approach would not guarantee the informativeness of the virtual instances. This paper proposes Look-Ahead Data Acquisition via augmentation, or LADA framework, that looks ahead the effect of data augmentation in the process of acquisition. LADA jointly considers both 1) unlabeled data instance to be selected and 2) virtual data instance to be generated by data augmentation, to construct the acquisition function. Moreover, to generate maximally informative virtual instances, LADA optimizes the data augmentation policy to maximize the predictive acquisition score, resulting in the proposal of InfoSTN and InfoMixup. The experimental results of LADA show a significant improvement over the recent augmentation and acquisition baselines that were independently applied. 

@inproceedings{NEURIPS2021_c1b70d96, 

author = {Kim, Yoon-Yeong and Song, Kyungwoo and Jang, JoonHo and Moon, Il-Chul}, 

booktitle = {Advances in Neural Information Processing Systems}, 

editor = {M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan}, 

pages = {22919--22930}, 

publisher = {Curran Associates, Inc.}, 

title = {LADA: Look-Ahead Data Acquisition via Augmentation for Deep Active Learning}, 

url = {https://proceedings.neurips.cc/paper_files/paper/2021/file/c1b70d965ca504aa751ddb62ad69c63f-Paper.pdf}, 

volume = {34}, 

year = {2021} 

} 

Source Website:

https://proceedings.neurips.cc/paper_files/paper/2021/hash/c1b70d965ca504aa751ddb62ad69c63f-Abstract.html