I need to implement some state-of-the-art knowledge distillation (KD) methods to distill dark knowledge of the teacher network to the student network with Pytorch. I would really appreciated to any advice to find the state-of-the-art KD methods.



Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy