Develop Tools & CodePaper and LLMs
Influence Function Based Second-Order Channel Pruning-Evaluating True Loss Changes For Pruning Is Possible Without Retraining
It motivates us to develop a technique to evaluate true loss changes without retraining, with which channels to prune can be selected more reliably and confidently.
Tags:Paper and LLMsPricing Type
- Pricing Type: Free
- Price Range Start($):
GitHub Link
The GitHub link is https://github.com/hrcheng1066/ifso
Introduce
The GitHub repository “IFSO” presents an approach for second-order channel pruning using influence functions. The method enables evaluating true loss changes without the need for retraining. The repository provides instructions to set up the environment, download the code, and replace certain files. It outlines steps for pre-training, pruning, and fine-tuning. The repository also acknowledges the contributions of related codes that served as the basis for this work.
Content
![Influence Function Based Second-Order Channel Pruning-Evaluating True Loss Changes For Pruning Is Possible Without Retraining](https://toolsfine.com/wp-content/themes/onenav/images/t.png)
Related
No comments...