Category: deep

Initialization Of Deep Networks Case of Rectifiers

This is the third of a three part series of posts that attempts to decipher the weight initialization algorithms as developed by various researchers as influenced by the evolution of neural network architecture.

Initialization Of Deep Feedfoward Networks

This is the second of a three part series of posts that attempts to decipher the weight initialization algorithms as developed by various researchers as influenced by the evolution of neural network architecture.

Initialization Of Feedfoward Networks

This is the first of a three part series of posts that attempts to decipher the weight initialization algorithms as developed by various researchers as influenced by the evolution of neural network architecture.