The Price of Sparsity
Generalization and Memorization in Sparse Neural Networks
Two true things in the world: learning comes from compression, and models should be sparse. In this post, we will talk about the latter, focusing on the training techniques for sparse models.
0....
