Sign in to view more
Sign in to view more
I am an Applied Researcher at Bing in Bellevue Washington, working on core relevance. I also lead a small team of Applied Researchers who are embedded in Microsoft Research Cambridge in the UK. I'm a coordinator of the TREC-2009 Web Track, which evaluates search relevance on a 1 billion page web crawl [ ClueWeb09 ]. This year we are conducting a "TREC adhoc" evaluation and a diversity-aware evaluation. Workshop: Web Search Click Data 2009 was held in conjunction with WSDM2009 in Barcelona, February 2009. Research Overview I am interested in Web search evaluation. I built the VLC, VLC2, WT2g and .GOV test collections, which have been made available to research groups around the world. David Hawking and I coordinated the TREC Web Track experiments. Some publications: Book chapter preprint (pdf), IR'01 (citeseer) and CSIRO'01 (pdf). I also work on effective Web search, which means making use of information in pages, link structure and URL structure to generate more useful Web search results. Some papers: SIGIR'05 (pdf), SIGIR'01 (pdf), TOIS'03 (pdf) (copying is by permission of ACM, Inc.) and ADCS'03 (pdf). My PhD was in distributed information retrieval (thesis pdf) which means building a system on top of multiple engines/databases that already exist. My recent work in the area has considered whether (or when) DIR is really practical. Some papers: ADC'99 (ps), DL'00 (pdf), ADC'03 (pdf) and ADC'04 (pdf). Publications 2016 Eric Nalisnick, Bhaskar Mitra, Nick Craswell, and Rich Caruana, Improving Document Ranking with Dual Word Embeddings, in WWW'16, WWW – World Wide Web Consortium (W3C), 11 April 2016. Milad Shokouhi, Umut Ozertem, and Nick Craswell, Did You Say U2 or Youtube? Inferring Implicit Transcripts from Voice Search Logs, in Proceedings of the 25th International World Wide Web Conference (WWW2016), ACM – Association for Computing Machinery, April 2016. Bhaskar Mitra, Eric Nalisnick, Nick Craswell, and Rich Caruana, A Dual Embedding Space Model for Document Ranking, arXiv preprint arXiv:1602.01137, 4 February 2016. 2015 Bhaskar Mitra and Nick Craswell, Query Auto-Completion for Rare Prefixes, in Proceedings of the 24th ACM International Conference on Information and Knowledge Management (CIKM), ACM – Association for Computing Machinery, October 2015. 2014 Emine Yilmaz, Manisha Verma, Nick Craswell, Filip Radlinski, and Peter Bailey, Relevance and Effort: An Analysis of Document Utility, in Proceedings of the 23rd ACM International Conference on Information and Knowledge Management (CIKM), ACM – Association for Computing Machinery, November 2014. 2013 Ahmed Hassan, Xiaolin Shi, Nick Craswell, and Bill Ramsey, Beyond Clicks: Query Reformulation as a Predictor of Search Satisfaction, ACM International Conference on Information and Knowledge Management (CIKM), October 2013. Nick Craswell, Bodo Billerbeck, Dennis Fetterly, and Marc Najork, Robust Query Rewriting using Anchor Data, in 6th ACM International Conference on Web Search and Data Mining (WSDM), ACM, February 2013. Filip Radlinski and Nick Craswell, Optimized Interleaving for Online Retrieval Evaluation, in ACM International Conference on Web Search and Data Mining (WSDM), ACM, February 2013.