On the Effects of Batch and Weight Normalization in Generative Adversarial Networks
Code for the paper “On the Effects of Batch and Weight Normalization in Generative Adversarial Networks“.
About the code
Here two versions are provided, one for torch and one for PyTorch.
The code used for the experiments in the paper was in torch and was a bit messy, with hand written backward pass of weight normalized layers and other staff used to test various ideas about GANs that are unrelated to the paper. So we decided to clean up the code and port it to PyTorch (read: autograd). However, we are not able to exactly reproduce the results in the paper with the PyTorch code. So we had to port it back to torch to see the difference.
We did find and fix a mathematical bug in