CSIROmed Team Report of TREC 2021 Clinical Trials track: Experiments with BERT Reranking Methods

A large body of clinical trials fail to attract enough eligible participants. TREC 2021 Clinical Trials track set a task to use patient data in the form of clinical notes as a way to identify patients eligible for clinical trials. We explore a number of reranking methods as well as query rewighting using Bidi-rectional Encoder Representations from Transformers (BERT). Our best method used BERT reranking trained on scientific literature.