beir/bioasq

목차

1. 사용법

1.1. 모든 데이터 순회

1.2. 개별 데이터 접근

2. 속성

2.1. doc

2.2. query

2.3. qrel

3. 통계

4. 인용

5. 출처

6. 라이센스



1. 사용법

1.1. 모든 데이터 순회

from hamu_tool.dataset import DataLoader

loader = DataLoader.load('beir/bioasq')

for doc in loader.get_docs():
    print(doc.id, doc.text, doc.title, doc.journal, doc.year, doc.pmid, doc.mesh_major)
    break

for query in loader.get_queries():
    print(query.id, query.text)
    break

for qrel in loader.get_qrels('[mode]'):
    print(qrel.qid, qrel.did, qrel.score)
    break

1.2. 개별 데이터 접근

from hamu_tool.dataset import DataLoader

loader = DataLoader.load('beir/bioasq')

doc = loader.get_doc('[did]')
print(doc)

query = loader.get_query('[qid]')
print(query)

qrel = loader.get_qrel('[mode]', '[qid]')
print(qrel)

2. 속성

2.1. doc

속성자료형
idstr
textstr
titlestr
journalstr
yearint
pmidstr
mesh_majorlist[str]

2.2. query

속성자료형
idstr
textstr

2.3. qrel

속성자료형
qidstr
didstr
scoreint
  • [mode]: test

3. 통계

수치
TaskBio-Medical Information Retrieval
DomainBio-Medical
# Query500
# Doc14,914,602
# Qreltest2,358
Average Rel D/Qtest4.72
Average Query Length (words)8.05
Average Doc Length (words)190.11

4. 인용

@article{tsatsaronis2015overview,
  title = "An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition",
  author = "Tsatsaronis, George and Balikas, Georgios and Malakasiotis, Prodromos and Partalas, Ioannis and Zschunke, Matthias and Alvers, Michael R and Weissenborn, Dirk and Krithara, Anastasia and Petridis, Sergios and Polychronopoulos, Dimitris and others",
  journal = "BMC bioinformatics",
  volume = "16",
  pages = "1--28",
  year = "2015",
  publisher = "Springer"
}
@article{Thakur2021Beir,
  title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models",
  author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", 
  journal = "arXiv preprint arXiv:2104.08663",
  month = "4",
  year = "2021",
  url = "https://arxiv.org/abs/2104.08663",
}

5. 출처


6. 라이센스