Open Academic Graph 2019

Overview

Open Academic Graph (OAG) is generated by linking two large academic graphs: Microsoft Academic Graph (MAG) and AMiner. This page collects the second version of OAG which was generated in Jan 2019. The statistics of OAG 2019 is listed as the three tables below. The two large graphs are both evolving and we take MAG November 2018 snapshot and AMiner July 2018 or January 2019 snapshot for this version.

Venue Collection

Table 1: statistics of OAG venue data
Data set	#Pairs/Venues	Date
Linking relations	29,841	2018.12
AMiner venues	69,397	2018.07
MAG venues	52,678	2018.11

Paper Collection

Table 2: statistics of OAG paper data
Data set	#Pairs/Papers	Date
Linking relations	91,137,597	2018.12
AMiner papers	172,209,563	2019.01
MAG papers	208,915,369	2018.11

Author Collection

Table 3: statistics of OAG author data
Data set	#Pairs/Authors	Date
Linking relations	1,717,680	2019.01
AMiner authors	113,171,945	2018.07
MAG authors	253,144,301	2018.11

Please note that for author matching, we only consider authors whose paper count is not less than 5. After filtering those authors with small paper count, there are 6,855,193 authors in AMiner and 13,173,936 authors in MAG.

OAG v2 Download

venue_linking_pairs.zip	paper_linking_pairs.zip	author_linking_pairs.zip
aminer_venues.zip	mag_venues.zip
mag_papers_0.zip	mag_papers_1.zip	mag_papers_2.zip
aminer_papers_0.zip	aminer_papers_1.zip
aminer_papers_2.zip	aminer_papers_3.zip
mag_authors_0.zip	mag_authors_1.zip	mag_authors_2.zip
aminer_authors_0.zip	aminer_authors_1.zip
aminer_authors_2.zip	aminer_authors_3.zip

MAG papers with references, fields of study, indexed abstract and author organization added: OneDrive Link

Data Description

For linking relations, each pair is an “ID to ID” pair. More specifically, its JSON schema is:

{
"mid": "xxxx",
"aid": "yyyy"
}

where “mid” is MAG entity ID and “aid” is AMiner entity ID.

Other entity attributes are also provided, which can be used to do different types of research. The data schemas of venues, papers and authors are described as below:

Table 4: venue schema
Field Name	Field Type	Description	Example
id	string	venue id	5bf574641c5a1dcdd96f817b
JournalId	string	journal id	137773608
ConferenceId	string	conference id
DisplayName	string	venue name	Nature
NormalizedName	string	normalized venue name	nature

Table 5: paper schema
Field Name	Field Type	Description	Example
id	string	paper ID	53e9ab9eb7602d970354a97e
title	string	paper title	Data mining: concepts and techniques
authors.name	string	author name	Jiawei Han
author.org	string	author affiliation	Department of Computer Science, University of Illinois at Urbana-Champaign
author.id	string	author ID	53f42f36dabfaedce54dcd0c
venue.id	string	paper venue ID	53e17f5b20f7dfbc07e8ac6e
venue.raw	string	paper venue name	Inteligencia Artificial, Revista Iberoamericana de Inteligencia Artificial
year	int	published year	2000
keywords	list of strings	keywords	["data mining", "structured data", "world wide web", "social network", "relational data"]
fos.name	string	paper fields of study	Web mining
fos.w	float	fields of study weight	0.659690857
references	list of strings	paper references	["4909282", "16018031", "16159250", "19838944", ...]
n_citation	int	citation number	40829
page_start	string	page start	11
page_end	string	page end	18
doc_type	string	paper type: journal, book title...	book
lang	string	detected language	en
publisher	string	publisher	Elsevier
volume	string	volume	10
issue	string	issue	29
issn	string	issn	0020-7136
isbn	string	isbn	1-55860-489-8
doi	string	doi	10.4114/ia.v10i29.873
pdf	string	pdf URL	//static.aminer.org/upload/pdf/1254/ 370/239/53e9ab9eb7602d970354a97e.pdf
url	list	external links	["http://dx.doi.org/10.4114/ia.v10i29.873", "http://polar.lsi.uned.es/revista/index.php/ia/ article/view/479"]
abstract	string	abstract	Our ability to generate...
indexed_abstract	dict	indexed abstract	{"IndexLength": 164, "Inverte dIndex": {"Our": [0], "ability": [1], "to": [2, 7, ...]}}

(Note: MAG paper attributes are incomplete. If you would like more attributes, please refer to this link to get MAG on Azure.)

Table 6: author schema
Field Name	Field Type	Description	Example
id	string	author id	53f42f36dabfaedce54dcd0c
name	string	author name	Jiawei Han
normalized_name	string	normalized author name	jiawei han
orgs	list of strings	author affiliations	[“Department of Computer Science, University of Illinois at Urbana-Champaign”]
org	string	last known affiliation	Department of Computer Science, University of Illinois at Urbana-Champaign
position	string	author position	professor
n_pubs	int	the number of author publications	1217
n_citation	int	author citation count	191526
h_index	int	author h-index	175
tags.t	string	research interests	“data mining”
tags.w	int	weight of interests	243
pubs.i	string	author paper id	53e9b9fbb7602d97045f7bb8
pubs.r	int	author order in the paper	0

Evaluation

We evaluated a small subset of matchings (around one thousand venue/paper/author pairs). The estimated accuracy is shown in Table 7.

entity type	venue	paper (newly matched)	author
accuracy	99.26%	99.10%	97.41%

Reference

We kindly request that any published research that makes use of this data cites the following papers.

Jie Tang, Jing Zhang, Limin Yao, Juanzi Li, Li Zhang, and Zhong Su. ArnetMiner: Extraction and Mining of Academic Social Networks. In Proceedings of the Fourteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD'2008). pp.990-998. [PDF] [Slides] [System] [API]

Arnab Sinha, Zhihong Shen, Yang Song, Hao Ma, Darrin Eide, Bo-June (Paul) Hsu, and Kuansan Wang. 2015. An Overview of Microsoft Academic Service (MAS) and Applications. In Proceedings of the 24th International Conference on World Wide Web (WWW ’15 Companion). ACM, New York, NY, USA, 243-246.

Supported by