Overview
Open Academic Graph (OAG) is generated by linking two large academic graphs: Microsoft Academic Graph (MAG) and AMiner. This page collects OAG 2.1 generated in 2020. The statistics of OAG 2.1 are shown in the tables below. The two large graphs are both evolving and we take MAG July 2020 snapshot and AMiner October 2020 snapshot for this version.
Affiliation Collection
Table 1: statistics of OAG affiliation data
| Data set |
#Pairs/Affiliations |
Date |
|
Linking relations |
16,384 |
2020.10 |
|
AMiner affiliations |
173,882 |
2020.10 |
|
MAG affiliations |
25,776 |
2020.07 |
Venue Collection
Table 2: statistics of OAG venue data
| Data set |
#Pairs/Venues |
Date |
|
Linking relations |
29,948 |
2020.10 |
|
AMiner venues |
69,397 |
2020.10 |
|
MAG venues |
53,422 |
2020.07 |
Paper Collection
Table 3: statistics of OAG paper data
| Data set |
#Pairs/Affiliations |
Date |
|
Linking relations |
119,384,813 |
2020.10 |
|
AMiner papers |
183,808,111 |
2020.10 |
|
MAG papers |
240,255,240 |
2020.07 |
OAG v2.1 Download
Linking relations
| aff_linking_pairs_2020.zip | venue_linking_pairs_2020.zip |
| paper_linking_pairs_2020.zip | author_linking_pairs_2020.zip |
Affiliation Data
| aminer_affiliations.zip | mag_affiliations.zip |
Venue Data
| aminer_venues.zip | mag_venues.zip |
Author Data
| aminer_authors_0.zip | aminer_authors_1.zip |
| mag_authors_0.zip | mag_authors_1.zip |
Paper Data
| aminer_papers_0.zip | aminer_papers_1.zip | aminer_papers_2.zip |
| aminer_papers_3.zip | aminer_papers_4.zip | aminer_papers_5.zip |
Data Description
For linking relations, each pair is an “ID to ID” pair. More specifically, its JSON schema is:
{
"mid": "xxxx",
"aid": "yyyy"
}
where “mid” is MAG entity ID and “aid” is AMiner entity ID.
Other entity attributes are also provided, which can be used to do different types of research. The data schemas of affiliations, venues, papers and authors are described as below:
|
Field Name |
Field Type |
Description |
Example |
|
id |
string/long |
affiliation id |
136199984 |
|
DisplayName |
string |
affiliation name |
Harvard University |
|
NormalizedName |
string |
normalized affiliation name |
harvard university |
| type | string | affiliation type | university |
| url | string | official page | http://www.harvard.edu/ |
| WikiPage | string | Wikipedia page | http://en.wikipedia.org/wiki/Harvard_University |
| Latitude | string | latitude | 42.37444 |
| Longitude | string | longitude | -71.11694 |
Table 6: venue schema
|
Field Name |
Field Type |
Description |
Example |
|
id |
string/long |
venue id |
5bf574641c5a1dcdd96f817b |
|
JournalId |
long |
journal id |
137773608 |
|
ConferenceId |
long |
conference id |
|
|
DisplayName |
string |
venue name |
Nature |
|
NormalizedName |
string |
normalized venue name |
nature |
Table 7: paper schema
|
Field Name |
Field Type |
Description |
Example |
| id | string/long | paper ID | 53e9ab9eb7602d970354a97e |
|
title |
string |
paper title |
Data mining: concepts and techniques |
|
authors.name |
string |
author name |
Jiawei Han |
|
author.org |
string |
author affiliation |
Department of Computer Science, University of Illinois at Urbana-Champaign |
| author.org_id | long | author affiliation id | 157725225 |
|
author.id |
string/long |
author ID |
53f42f36dabfaedce54dcd0c |
|
venue.id |
string/long |
paper venue ID |
53e17f5b20f7dfbc07e8ac6e |
|
venue.name |
string |
paper venue name |
Inteligencia Artificial, Revista Iberoamericana de Inteligencia Artificial |
|
year |
int |
published year |
2000 |
|
keywords |
list of strings |
keywords |
["data mining", "structured data", "world wide web", "social network", "relational data"] |
| fos.name | string | paper fields of study | Web mining |
| fos.w | float | fields of study weight | 0.659690857 |
| references | list of long | paper references | [4909282, 16018031, 16159250, 19838944, ...] |
|
n_citation |
int |
citation number |
40829 |
|
page_start |
string |
page start |
11 |
|
page_end |
string |
page end |
18 |
|
doc_type |
string |
paper type: journal, book title... |
book |
|
lang |
string |
detected language |
en |
|
publisher |
string |
publisher |
Elsevier |
|
volume |
string |
volume |
10 |
|
issue |
string |
issue |
29 |
|
issn |
string |
issn |
0020-7136 |
|
isbn |
string |
isbn |
1-55860-489-8 |
|
doi |
string |
doi |
10.4114/ia.v10i29.873 |
|
|
string |
pdf URL |
//static.aminer.org/upload/pdf/1254/ 370/239/53e9ab9eb7602d970354a97e.pdf |
|
url |
list |
external links |
["http://dx.doi.org/10.4114/ia.v10i29.873", "http://polar.lsi.uned.es/revista/index.php/ia/ article/view/479"] |
|
abstract |
string |
abstract |
Our ability to generate... |
| indexed_abstract | string (JSON format) | indexed abstract | {"IndexLength": 164, "Inverte dIndex": {"Our": [0], "ability": [1], "to": [2, 7, ...]}} |
Table 8: author schema
|
Field Name |
Field Type |
Description |
Example |
|
id |
string/long |
author id |
53f42f36dabfaedce54dcd0c |
|
name |
string |
author name |
Jiawei Han |
|
normalized_name |
string |
normalized author name |
jiawei han |
|
orgs |
list of strings |
author affiliations |
[“Department of Computer Science, University of Illinois at Urbana-Champaign”] |
|
org |
string |
author organization |
Department of Computer Science, University of Illinois at Urbana-Champaign |
| last_known_aff_id | long | last known affiliation | 157725225 |
|
position |
string |
author position |
professor |
|
n_pubs |
int |
the number of author publications |
1217 |
|
n_citation |
int |
author citation count |
191526 |
|
h_index |
int |
author h-index |
175 |
|
tags.t |
string |
research interests |
“data mining” |
|
tags.w |
int |
weight of interests |
243 |
|
pubs.i |
string/long |
author paper id |
53e9b9fbb7602d97045f7bb8 |
|
pubs.r |
int |
author order in the paper |
0 |
Evaluation
We evaluated a small subset of matchings (around one thousand affiliation/venue/paper/author pairs). The estimated accuracy is shown in Table 9 below.
|
entity type |
affiliation |
venue |
paper |
author |
|
accuracy |
97.89% |
97.48% |
99.19% |
97.08% |
References
We kindly request that any published research that makes use of this data cites the following papers.
Jie Tang, Jing Zhang, Limin Yao, Juanzi Li, Li Zhang, and Zhong Su. ArnetMiner: Extraction and Mining of Academic Social Networks. In Proceedings of the Fourteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD'2008). pp.990-998. [PDF] [Slides] [System] [API]
Arnab Sinha, Zhihong Shen, Yang Song, Hao Ma, Darrin Eide, Bo-June (Paul) Hsu, and Kuansan Wang. 2015. An Overview of Microsoft Academic Service (MAS) and Applications. In Proceedings of the 24th International Conference on World Wide Web (WWW ’15 Companion). ACM, New York, NY, USA, 243-246.
Fanjin Zhang, Xiao Liu, Jie Tang, Yuxiao Dong, Peiran Yao, Jie Zhang, Xiaotao Gu, Yan Wang, Bin Shao, Rui Li, and Kuansan Wang. OAG: Toward Linking Large-scale Heterogeneous Entity Graphs. In Proceedings of the Twenty-Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'19).
Fanjin Zhang, Xiao Liu, Jie Tang, Yuxiao Dong, Peiran Yao, Jie Zhang, Xiaotao Gu, Yan Wang, Evgeny Kharlamov, Bin Shao, Rui Li, and Kuansan Wang. OAG: Linking Entities across Large-Scale Heterogeneous Knowledge Graphs. IEEE Transactions on Knowledge and Data Engineering (TKDE), 2022 (accepted).
Supported by 
