a52ec3b5d0607ca7.tex
1: \begin{abstract}
2:     % Diffusion models have emerged as a potential approach for high-fidelity image generation but a thousand-step sampling process prohibits them from scalability for high-resolution image generation. In this paper, we propose Wavelet Diffusion to further deduce the complexity of each sampling step. Furthermore, we build our framework upon Diffusion GAN with two new components including a reconstruction term and a frequency-aware generator.
3:     Diffusion models are rising as a powerful solution for high-fidelity image generation, which exceeds GANs in quality in many circumstances. However, their slow training and inference speed is a huge bottleneck, blocking them from being used in real-time applications. A recent DiffusionGAN method significantly decreases the models' running time by reducing the number of sampling steps from thousands to several, but their speeds still largely lag behind the GAN counterparts. This paper aims to reduce the speed gap by proposing a novel wavelet-based diffusion scheme. We extract low-and-high frequency components from both image and feature levels via wavelet decomposition and adaptively handle these components for faster processing while maintaining good generation quality. Furthermore, we propose to use a reconstruction term, which effectively boosts the model training convergence. Experimental results on CelebA-HQ, CIFAR-10, LSUN-Church, and STL-10 datasets prove our solution is a stepping-stone to offering real-time and high-fidelity diffusion models. Our code and pre-trained checkpoints are available at \url{https://github.com/VinAIResearch/WaveDiff.git}.
4: \end{abstract}
5: