Use HugginFace Transfromers and Pracetice Knowledge distillation, quantization, ONNX, ORT
-
Updated
Feb 10, 2023 - Jupyter Notebook
Use HugginFace Transfromers and Pracetice Knowledge distillation, quantization, ONNX, ORT
Deep Learning Head Pose Estimation using PyTorch
Transfer Learning for Neural Topic Models using Knowledge Distillation
Multi-class image classification of Distilling Knowledge by Mimicking Features.
VisionTransformer for Tensorflow2
Tensorflow based framework for 3D-Unet with Knowledge Distillation
This is the repository for implementation of 'Knowledge Distillation for Multi-task Learning'
Implementation of several neural network compression techniques (knowledge distillation, pruning, quantization, factorization), in Haiku.
Official code for the paper "Domain Generalization for Crop Segmentation with Knowledge Distillation"
Knowledge distillation pytorch lightning template for image classification task
Improving Question Answering Performance Using Knowledge Distillation and Active Learning
This repository includes some detailed proofs of "Bias Variance Decomposition for KL Divergence".
Code for the Knowledge distillation work to enhance fine grained disease recognition.
Deep learning based color transfer between images.
Official implementation of AAAI22 paper "ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images"
cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation
Data-free Knowledge Distillation for Regression
Code for "Language Model Knowledge Distillation for Efficient Question Answering in Spanish" (ICLR 2024 Tiny Papers)
To understand the gender/social bias Bert KD model, more specifically TinyBert.
[CVPR 2023] PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection
Add a description, image, and links to the knowledge-distillation topic page so that developers can more easily learn about it.
To associate your repository with the knowledge-distillation topic, visit your repo's landing page and select "manage topics."