Preprintnpj Digital Medicine2021
Med-BERT: pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction
Laila Rasmy, Yang Xiang, Ziqian Xie, et al.
Med-BERT adapts BERT to structured EHR data via pretraining on 28.5M patients, boosting disease prediction AUC by 1.21-6.14% and enabling small-dataset models to match those trained on tenfold larger data.
1.0kMay 20, 2021TransformersFine Tuning
arXiv