Skip to main content
placeholder image

Multi-SelfGAN: A Self-Guiding Neural Architecture Search Method for Generative Adversarial Networks with Multi-Controllers

Journal Article


Abstract


  • In recent years, Reinforcement Learning and Gradient optimization were applied with Neural Architecture Search algorithms in Generative Adversarial Network to achieve their state-of-the-art (SOTA) performance. However, the existing RL-based methods utilised the calculation of Inception Score or Fréchet Inception Distance as the reward value to guide the controller, which actually wasted much of searching time. In order to improve the search efficiency without degradation of performance, this paper proposes recycling the discriminator to evaluate the performance of architectures, in other words, we propose to self-guide the search process. In the mean time, we introduce new concept of multiple controllers and the method of reward shaping to independently and effectively search the cell architectures. The experiments demonstrate the effectiveness and efficiency of our Multi-Self GAN and the ablation study also exhibits its robustness.

Publication Date


  • 2022

Citation


  • Shi, J., Zhou, G., Bao, S., & Shen, J. (2022). Multi-SelfGAN: A Self-Guiding Neural Architecture Search Method for Generative Adversarial Networks with Multi-Controllers. IEEE Transactions on Cognitive and Developmental Systems. doi:10.1109/TCDS.2022.3160475

Scopus Eid


  • 2-s2.0-85126668264

Web Of Science Accession Number


Abstract


  • In recent years, Reinforcement Learning and Gradient optimization were applied with Neural Architecture Search algorithms in Generative Adversarial Network to achieve their state-of-the-art (SOTA) performance. However, the existing RL-based methods utilised the calculation of Inception Score or Fréchet Inception Distance as the reward value to guide the controller, which actually wasted much of searching time. In order to improve the search efficiency without degradation of performance, this paper proposes recycling the discriminator to evaluate the performance of architectures, in other words, we propose to self-guide the search process. In the mean time, we introduce new concept of multiple controllers and the method of reward shaping to independently and effectively search the cell architectures. The experiments demonstrate the effectiveness and efficiency of our Multi-Self GAN and the ablation study also exhibits its robustness.

Publication Date


  • 2022

Citation


  • Shi, J., Zhou, G., Bao, S., & Shen, J. (2022). Multi-SelfGAN: A Self-Guiding Neural Architecture Search Method for Generative Adversarial Networks with Multi-Controllers. IEEE Transactions on Cognitive and Developmental Systems. doi:10.1109/TCDS.2022.3160475

Scopus Eid


  • 2-s2.0-85126668264

Web Of Science Accession Number