go-v.orgdoi

An Ensemble Learning Strategy for Eligibility Criteria Text Classification for Clinical Trial Recruitment: Algorithm Development and Validation

Kun Zeng, Zhiwei Pan, Yibin Xu, Yingying Qu · JMIR Medical Informatics · 2020

  • DOI 10.2196/17832
  • Publisher JMIR Publications
  • Type article
  • Issued 2020

Not cached yet. This record was fetched live for this request and is stored after the lookup. Reopening the page should serve the cached copy.

JMIR Medical Informatics · JMIR Publications · article · 2020

Abstract

BACKGROUND: Eligibility criteria are the main strategy for screening appropriate participants for clinical trials. Automatic analysis of clinical trial eligibility criteria by digital screening, leveraging natural language processing techniques, can improve recruitment efficiency and reduce the costs involved in promoting clinical research. OBJECTIVE: We aimed to create a natural language processing model to automatically classify clinical trial eligibility criteria. METHODS: We proposed a classifier for short text eligibility criteria based on ensemble learning, where a set of pretrained models was integrated.

The pretrained models included state-of-the-art deep learning methods for training and classification, including Bidirectional Encoder Representations from Transformers (BERT), XLNet, and A Robustly Optimized BERT Pretraining Approach (RoBERTa). The classification results by the integrated models were combined as new features for training a Light Gradient Boosting Machine (LightGBM) model for eligibility criteria classification. RESULTS: Our proposed method obtained an accuracy of 0.846, a precision of 0.803, and a recall of 0.817 on a standard data set from a shared task of an international conference.

The macro F1 value was 0.807, outperforming the state-of-the-art baseline methods on the shared task. CONCLUSIONS: We designed a model for screening short text classification criteria for clinical trials based on multimodel ensemble learning. Through experiments, we concluded that performance was improved significantly with a model ensemble compared to a single model. The introduction of focal loss could reduce the impact of class imbalance to achieve better performance.

Open the resolved locator · 10.2196/17832

Metadata licence: OpenAlex metadata (CC0)

Registry
OpenAlex DOI index + API
Fetched
2026-11-20 03:40 UTC
Cache state
not cached yet (bulk-index+openalex)
Locator
https://medinform.jmir.org/2020/7/e17832
Metadata licence
OpenAlex metadata (CC0)
Scope
Metadata as returned by the resolver; abstracts are never generated here.