Initialization Of Deep Networks Case of Rectifiers

08 Aug 2016 This is the third of a three part series of posts that attempts to decipher the weight initialization algorithms as developed by various researchers as influenced by the evolution of neural network architecture. Read More...

Initialization Of Deep Feedfoward Networks

01 Aug 2016 This is the second of a three part series of posts that attempts to decipher the weight initialization algorithms as developed by various researchers as influenced by the evolution of neural network architecture. Read More...

Initialization Of Feedfoward Networks

27 Jul 2016 This is the first of a three part series of posts that attempts to decipher the weight initialization algorithms as developed by various researchers as influenced by the evolution of neural network architecture. Read More...