SP-GAN
SP-GAN generates realistic images for bioinformatics applications by dynamically growing and pruning generator and discriminator convolutional architectures and adapting its loss function during training.
Key Features:
- Dynamic Architecture Adjustment: SP-GAN begins with two seed networks—a generator and a discriminator—each comprising a minimal number of convolution kernels and modifies its structure in real time during training to scale capacity.
- Self-Growing Mechanism: After initial training, SP-GAN replicates convolution kernels within each seed network to augment network scale and then fine-tunes the expanded architecture.
- Pruning Strategy: SP-GAN applies pruning to remove redundant elements from the expanded network, reducing overgrowth and optimizing network size.
- Adaptive Loss Function: SP-GAN uses an adaptive loss function whose hyperparameters dynamically adjust across training stages to improve stability and efficiency.
Scientific Applications:
- Medical Imaging: Generation of high-fidelity synthetic medical images to support imaging research and algorithm development.
- Image Synthesis: Creation of realistic images for bioinformatics and computational imaging tasks requiring precise visual representation.
- Large-Scale and Rapid Iteration Workflows: Efficient training and adaptive capacity make SP-GAN suitable for applications involving large datasets or rapid model iteration.
Methodology:
Initial training with small-scale seed generator and discriminator networks; self-growing phase that replicates convolution kernels and fine-tunes the augmented networks; pruning phase to eliminate redundancy and optimize network size; use of an adaptive loss function with dynamically adjusting hyperparameters.
Topics
Details
- Programming Languages:
- Python
- Added:
- 1/18/2021
- Last Updated:
- 2/20/2021
Operations
Publications
Song X, Chen Y, Feng Z, Hu G, Yu D, Wu X. SP-GAN: Self-Growing and Pruning Generative Adversarial Networks. IEEE Transactions on Neural Networks and Learning Systems. 2021;32(6):2458-2469. doi:10.1109/tnnls.2020.3005574. PMID:32649282.