2020 12-04-shake shake

This document summarizes the Shake-Shake regularization technique presented in the paper "Shake-Shake Regularization". Shake-Shake regularization improves generalization in multi-branch networks by replacing standard summation of parallel branches with a stochastic affine combination. It applies data augmentation internally by stochastically blending the outputs of two residual units. Experiments on CIFAR-10 and CIFAR-100 show that Shake-Shake networks outperform ResNets and ResNeXt models and achieve state-of-the-art results, demonstrating the regularization effectiveness of the technique.