SP-GAN

SP-GAN generates realistic images for bioinformatics applications by dynamically growing and pruning generator and discriminator convolutional architectures and adapting its loss function during training.


Key Features:

  • Dynamic Architecture Adjustment: SP-GAN begins with two seed networks—a generator and a discriminator—each comprising a minimal number of convolution kernels and modifies its structure in real time during training to scale capacity.
  • Self-Growing Mechanism: After initial training, SP-GAN replicates convolution kernels within each seed network to augment network scale and then fine-tunes the expanded architecture.
  • Pruning Strategy: SP-GAN applies pruning to remove redundant elements from the expanded network, reducing overgrowth and optimizing network size.
  • Adaptive Loss Function: SP-GAN uses an adaptive loss function whose hyperparameters dynamically adjust across training stages to improve stability and efficiency.

Scientific Applications:

  • Medical Imaging: Generation of high-fidelity synthetic medical images to support imaging research and algorithm development.
  • Image Synthesis: Creation of realistic images for bioinformatics and computational imaging tasks requiring precise visual representation.
  • Large-Scale and Rapid Iteration Workflows: Efficient training and adaptive capacity make SP-GAN suitable for applications involving large datasets or rapid model iteration.

Methodology:

Initial training with small-scale seed generator and discriminator networks; self-growing phase that replicates convolution kernels and fine-tunes the augmented networks; pruning phase to eliminate redundancy and optimize network size; use of an adaptive loss function with dynamically adjusting hyperparameters.

Topics

Details

Programming Languages:
Python
Added:
1/18/2021
Last Updated:
2/20/2021

Operations

Publications

Song X, Chen Y, Feng Z, Hu G, Yu D, Wu X. SP-GAN: Self-Growing and Pruning Generative Adversarial Networks. IEEE Transactions on Neural Networks and Learning Systems. 2021;32(6):2458-2469. doi:10.1109/tnnls.2020.3005574. PMID:32649282.

PMID: 32649282
Funding: - National Key Research and Development Program of China: 2017YFC1601800 - National Natural Science Foundation of China: 61772273, 61876072, 61902153 - U.K. Engineering and Physical Sciences Research Council (EPSRC) Programme: EP/N007743/1 - China Postdoctoral Science Foundation: 2018T110441 - Six Talent Peaks Project of Jiangsu Province: XYDXX-012