I need to implement some state-of-the-art knowledge distillation (KD) methods to distill dark knowledge of the teacher network to the student network with Pytorch. I would really appreciated to any advice to find the state-of-the-art KD methods.
Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.
Sign up to join this community
Anybody can ask a question
Anybody can answer
The best answers are voted up and rise to the top
