Mode Collapse
2019-01-23
While writing my progressively grown GAN (and learning PyTorch), I ran into training instability issues quite frequently. This can be frustrating at times, but also led to some nice thematic images like the ones here.
2019-01-21
Sometimes the entire batch of images would collapse into a single theme like above (after a few more iterations converging to just one image altogether).
2019-01-23
Other times, there would be only a partial collapse and only a few images in a batch would be affected. Then a little cherry picking gives some nice palettes like these.
With a little bit of imagination you can find a lot fun, unexplored territories in latent space – even when your model has collapsed.
2019-01-23