SPKDLOSS#

Classes#

class utils.spkdloss.SPKDLoss(reduction)[source]#

Bases: Module

“Similarity-Preserving Knowledge Distillation”

compute_spkd_loss(teacher_outputs, student_outputs)[source]#

forward(teacher_outputs, student_outputs)[source]#

matmul_and_normalize(z)[source]#