Model overview
**[news]** A cross-lingual extension of SapBERT will appear in the main onference of **ACL 2021**! **[news]** SapBERT will appear in the conference proceedings of **NAACL 2021**! SapBERT by Liu et al. (2020). Trained with UMLS 2020AA (English only), using microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext as the base model. The input should be a string of biomedical entity names, e.g., "covid infection" or "Hydroxychloroquine". The [CLS] embedding of the last layer is regarded as the output.
The summary below is compiled from sources by an AI model, not our own testing. Verify selection decisions against original sources and your workload.
Key features
- Specialized for biomedical entity name understanding using UMLS 2020AA (English-only) ontology
- Built on microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext, pretrained on PubMed abstracts and full-text articles
- Outputs the [CLS] token embedding from the last transformer layer for semantic similarity tasks
Limitations & considerations
- English-only; no multilingual capability despite ACL 2021 cross-lingual extension announcement (model itself is not cross-lingual)
- Trained exclusively on biomedical entity names—untested or unsupported for general domain text or sentence-level NLU
- Requires input as raw entity strings (e.g., "covid infection"); no built-in preprocessing, normalization, or disambiguation
Source prices & cost analysis
Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.
| Source / channel | Input | Output | Billing unit | Collected at |
|---|---|---|---|---|
| No verified prices yet. Check the source channel. | ||||
Estimate monthly base token costs
Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.
Public benchmarks & run configuration
暂无已采集的可核验公开评分。模型未上榜不代表能力较低。
View full indexed rankings →Frequently asked questions
Is this model multilingual?
No—this specific checkpoint (SapBERT-from-PubMedBERT-fulltext) is English-only. A cross-lingual extension was announced for ACL 2021, but it is a separate development not reflected in this model.
What biomedical knowledge source was used for training?
It was trained using the Unified Medical Language System (UMLS) 2020AA, an English-language biomedical ontology and terminology resource.
What is the output format of this model?
The model outputs the [CLS] token embedding from the last transformer layer—a fixed-dimensional vector suitable for similarity computation or downstream classification.
Do open weights permit free commercial use?
Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.
Are these real-time billing prices?
These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.
Sources & traceability
许可证:apache-2.0。模型介绍与第三方评测均以原来源的具体版本和方法为准。