Scalable Access and Integration of Statistical Data for Digital Government

The massive amount of statistical and text data available from government agencies has created a set of daunting challenges to both the research and analysis communities. These problems include heterogeneity, size, distribution, and control of terminology. At the Digital Government Research Center ( www.dgrc.org ) we are investigating solutions to these key problems. In this paper we focus on scalability of data integration across multiple databases and web sources, and ontology construction and mapping for terminology standardization. This collaboration between researchers from the Information Sciences Institute of the University of Southern California and the Department of Computer Science of Columbia University employs technology developed at both locations, in particular the SIMS multi-database access planner (AKH96,AK00), the SENSUS ontology (KL94,SPKR96,H98) and the LEXING automated dictionary and terminology analysis system (KM00,KW01). Our application targets gasoline data from the Bureau of Labor Statistics, the Energy Information Administration of the Department of Energy, the Census Bureau, and other government agencies (see (AAPH+01) for an overview of the project).