nlpie-research/Compact-Biomedical-Transformers

This repository contains the code used for distillation and fine-tuning of compact biomedical transformers that have been introduced in the paper "On The Effectiveness of Compact Biomedical Transformers"

语言：Python · GitHub 星标：19 · Fork：5

话题：biomedical-nlp · compact-biobert · compact-transformer · distilbiobert · knowledge-distillation

在 GitHub 上查看原仓库