Survey on Multi-modal Generative Models
By Hans Brouwer, Delft University of Technology.
This survey examines how generative models combine different data modalities. It compares modality-specific encoders and hand-designed information exchange with general-purpose architectures that learn to process multiple modalities together. It also discusses self-supervision and unpaired learning as ways to reduce dependence on explicitly paired training data.