Experience
Education
Bio
I am an Applied Researcher working in the Bing Core Relevance team. I collaborate closely with a number of researchers at MSR and Bing. I have several abiding interests in Information Retrieval, including Evaluation and Measurement, Personalization and User Modeling, and Ranking. I have been involved over the years in TREC as a co-coordinator of the Web track (in the period 1999-2000) where I worked with David Hawking and Nick Craswell in developing and releasing a number of widely-used test collections, including WT10g. More recently, I was a co-coordinator of the Enterprise track (in 2007-2008), where we developed the CERC test collection. I also review papers for several conferences, including SIGIR, WWW, WSDM. I wrote a short series of tips on paper writing for SIGIR, and occasionally try to publish papers and posters with colleagues. While at Microsoft I have worked on a number of measurement, ranking and recommmendation problems at the heart of Bing, including measurement of whole page relevance, and a slew of issues related to personalization of ranking. For about 3 years, I was the dev manager for the Bing Contextual Relevance team, which introduced personalized and contextual Web ranking to Bing's results for the first time. We collaborated closely with the MSR CLUES team, helping to carry out tech transfer of various user modeling techniques. My current research interests centre on semantic comprehension of text, with especial application to information interaction technologies like search. Publications Alistair Moffat, Peter Bailey, Falk Scholer, and Paul Thomas, INST: An Adaptive Metric for Information Retrieval Evaluation, in Proceedings of the 20th Australasian Document Computing Symposium (ADCS'15), ACM – Association for Computing Machinery, 8 December 2015. Paul Thomas, Peter Bailey, Alistair Moffat, and Falk Scholer, Towards Nuanced System Evaluation Based on Implicit User Expectations, in Proceedings of the 11th Asia Information Retrieval Societies Conference, Springer, 2 December 2015. Alistair Moffat, Falk Scholer, Paul Thomas, and Peter Bailey, Pooled Evaluation Over Query Variations: Users are as Diverse as Systems, in Proceedings of the 24th ACM International Conference on Information and Knowledge Management (CIKM), ACM – Association for Computing Machinery, October 2015. Peter Bailey, Alistair Moffat, Falk Scholer, and Paul Thomas, User Variability and IR System Evaluation, in Proceedings of the 38th Annual ACM SIGIR Conference (SIGIR 2015), ACM – Association for Computing Machinery, 9 August 2015. Sarah K. Tyler, Jaime Teevan, Peter Bailey, Sebastian de la Chica, and Nikhil Dandekar, Large Scale Log Analysis of Individuals’ Domain Preferences in Web Search, no. MSR-TR-2015-48, June 2015. Emine Yilmaz, Manisha Verma, Nick Craswell, Filip Radlinski, and Peter Bailey, Relevance and Effort: An Analysis of Document Utility, in Proceedings of the 23rd ACM International Conference on Information and Knowledge Management (CIKM), ACM – Association for Computing Machinery, November 2014. Alistair Moffat, Falk Scholer, Paul Thomas, and Peter Bailey, Modeling Decision Points in User Search Behavior, in Proceedings of the 5th Information Interaction in Context (IIiX'14), ACM – Association for Computing Machinery, 26 August 2014. Peter Bailey, Liwei Chen, Scott Grosenick, Li Jiang, Yan Li, Paul Reinholdtsen, Charles Salada, Haidong Wang, and Sandy Wong, User task understanding: a web search engine perspective, , 8 October 2012.