Artikel ; Online: SeReNe: Sensitivity-Based Regularization of Neurons for Structured Sparsity in Neural Networks.
IEEE transactions on neural networks and learning systems
2022 Band 33, Heft 12, Seite(n) 7237–7250
Abstract: Deep neural networks include millions of learnable parameters, making their deployment over resource-constrained devices problematic. Sensitivity-based regularization of neurons (SeReNe) is a method for learning sparse topologies with a structure, ... ...
| Abstract | Deep neural networks include millions of learnable parameters, making their deployment over resource-constrained devices problematic. Sensitivity-based regularization of neurons (SeReNe) is a method for learning sparse topologies with a structure, exploiting neural sensitivity as a regularizer. We define the sensitivity of a neuron as the variation of the network output with respect to the variation of the activity of the neuron. The lower the sensitivity of a neuron, the less the network output is perturbed if the neuron output changes. By including the neuron sensitivity in the cost function as a regularization term, we are able to prune neurons with low sensitivity. As entire neurons are pruned rather than single parameters, practical network footprint reduction becomes possible. Our experimental results on multiple network architectures and datasets yield competitive compression ratios with respect to state-of-the-art references. |
|---|---|
| Mesh-Begriff(e) | Neural Networks, Computer ; Data Compression/methods ; Algorithms ; Neurons |
| Sprache | Englisch |
| Erscheinungsdatum | 2022-11-30 |
| Erscheinungsland | United States |
| Dokumenttyp | Journal Article |
| ISSN | 2162-2388 |
| ISSN (online) | 2162-2388 |
| DOI | 10.1109/TNNLS.2021.3084527 |
| Datenquelle | MEDical Literature Analysis and Retrieval System OnLINE |
Zusatzmaterialien
Kategorien
Über subito bestellen
Dieser Service ist kostenpflichtig (siehe Lieferbedingungen von subito). Bestellungen, die einen Artikel nebst Supplementary Material umfassen, werden grundsätzlich wie mehrfache Bestellungen bearbeitet. Gebühren fallen in diesen Fällen für jede einzelne Bestellung an.
Fernleihe an ZB MED
Sie können sich den gewünschten Titel als lokale Nutzerin oder lokaler Nutzer von ZB MED direkt an den Standort Köln schicken lassen.