메뉴 드롭다운
메뉴 드롭다운
KR EN

대학원 소개

연구성과

UNIST 인공지능대학원의 대학원 및 연구성과를 확인하실 수 있습니다.

Can We Find Strong Lottery Tickets in Generative Models? (AAAI 2023), Prof. Jaejun Yoo

Can We Find Strong Lottery Tickets in Generative Models?

Authors : Sangyeop Yeo , Yoojin Jang , Jy-yong Sohn , Dongyoon Han , Jaejun Yoo


Abstract 

Yes. In this paper, we investigate strong lottery tickets in generative models, the subnetworks that achieve good generative performance without any weight update. Neural network pruning is considered the main cornerstone of model compression for reducing the costs of computation and memory. Unfortunately, pruning a generative model has not been extensively explored, and all existing pruning algorithms suffer from excessive weight-training costs, performance degradation, limited generalizability, or complicated training. To address these problems, we propose to fnd a strong lottery ticket via moment-matching scores. Our experimental results show that the discovered subnetwork can perform similarly or better than the trained dense model even when only 10% of the weights remain. To the best of our knowledge, we are the frst to show the existence of strong lottery tickets in generative models and provide an algorithm to fnd it stably. Our code and supplementary materials are publicly available at https://lait-cvlab.github.io/SLT-in-Generative-Models/.