ACM SIGIR ICTIR 2016

September 13–16

TABLE of CONTENTS 4

Chairs’ welcome

6

Sponsors and supporters

7

Conference organization

9

Clayton Hall floor plan

10

Overview of schedule

11

Tuesday schedule

12–18

Tutorials

19

Wednesday schedule

22

Keynote

23–25

Posters

26

Thursday schedule

30

Banquet location and directions

31

Friday schedule

34

Newark area maps

36

Local restaurants

38

Ad for ICTIR 2017

University of Delaware

3

I

t is our pleasure to welcome you to the International Conference on the Theory of Information Retrieval (ICTIR), the 6th overall and the second to be fully sponsored by the ACM Special Interest Group on Information Retrieval (SIGIR). We are also happy to welcome you to Delaware and its flagship University.

As a land-, sea-, and spacegrant institution, University of Delaware is the site of ground-breaking research across all disciplines. We believe that the university setting is ideal for stimulating ideas, discussion, and collaborations to come. In addition, as far as we know, this is the first ACMsponsored conference to be held in Delaware, the so-called “First State” for being the first to ratify the U.S. Constitution in 1787.

4

The call for papers attracted submissions from all over the world. The program committee reviewed 79 contributions—44 full papers and 35 short—and accepted 22 long papers and 19 short papers, all of which will be presented orally during the conference.

We received four excellent tutorial proposals as well, and we hope those will aid in laying down foundational ideas in information retrieval research.

ICTIR aims to promote innovative and original ideas for IR. This aspect has been the most important criterion in paper reviewing.

In addition, the reviewing process also included a period of author rebuttals to ensure the quality of paper reviewing. The author rebuttals have been ICTIR 2016

taken into account in the discussions by the PC and for the final decisions.

We thank everyone that helped us organize the conference: short paper chairs Fernando Diaz and Stefano Mizzaro, tutorial chair Grace Hui Yang, and the members of the program committee who worked hard to review papers and provide feedback for authors. We also thank our sponsors and supporters: ACM SIGIR, Microsoft Research, J.P. Morgan Chase, and the University of Delaware. Finally, we thank the authors for providing the superb technical content, and our keynote speaker Sandra Carberry for opening the conference.

We hope that you can take some time to explore the University campus, downtown Newark, the University of Delaware

Delaware Valley, and the Mid-Atlantic U.S. The University is only two hours away (by train) from both New York City and Washington D.C., and the weather in September is warm and sunny, so you should be able to find plenty to do outside the conference.

ENJOY THE CONFERENCE! Ben Carterette & Hui Fang ICTIR’16 General Chairs University of Delaware, USA Mounia Lalmas & Jian-Yun Nie ICTIR’16 Program Chairs Yahoo UK & University of Montreal

5

ICTIR 2016 SPONSORS & SUPPORTERS

SPONSORS

ORGANIZER

SUPPORTERS

6

ICTIR 2016

2016 ACM International Conference on the Theory of Information Retrieval (ICTIR) Organization

General Chairs Ben Carterette | University of Delaware, USA Hui Fang | University of Delaware, USA Program Chairs Mounia Lalmas | Yahoo! Labs, UK Jian-Yun Nie | University of Montreal, Canada

Short Paper Chairs Fernando Diaz (Microsoft Research, USA) Stefano Mizzaro (University of Udine, Italy) Tutorial Chair Grace Hui Yang | Georgetown University, USA Local Arrangements Chair Karankumar Sabhnani | University of Delaware, USA Volunteer Coordinator Ashraf Bah | University of Delaware, USA) Registration Co-Chairs Mustafa Zengin | University of Delaware, USA Mohammad Alsulmi | University of Delaware, USA Steering Committee Chair Leif Azzopardi | University of Strathclyde, Glasgow, UK Steering Committee Peter Bruza | Queensland University of Technology, Australia Susan Dumais | Microsoft Research, USA Jaap Kamps | University of Amsterdam, Netherlands Oren Kurland | Technion, Israel Birger Larson | Aalborg University, Denmark Don Metzler | Google, USA Stefan Rueger | The Open University, UK

University of Delaware

7

2016 ACM International Conference on the Theory of Information Retrieval (ICTIR) Organization

Program Committee Enrique Amigó UNED, Spain Jaime Arguello University of North Carolina at Chapel Hill, USA Leif Azzopardi University of Strathclyde, Glasgow, UK Krisztian Balog University of Stavanger, Norway Klaus Berberich Max Planck Institute for Informatics, Germany Peter Bruza Queensland University of Technology, Australia Jamie Callan Carnegie Mellon University, USA Claudio Carpineto Fondazione Ugo Bordoni, Italy Pablo Castells Universidad Autónoma de Madrid, Spain Yi Chang Yahoo Research, USA Kevyn Collins-Thompson University of Michigan, USA Ronan Cummins University of Cambridge, UK Jeffrey Dalton Google, USA Gianluca Demartini University of Sheffield, UK Thomas Demeester Ghent University, Belgium Ingo Frommholz University of Bedfordshire, UK Norbert Fuhr University of Duisburg-Essen, Germany Julio Gonzalo UNED, Spain 8

Jiafeng Guo Institute of Computing Technology, CAS, China Ben He University of Chinese Academy of Sciences, China Djoerd Hiemstra University of Twente, Netherlands Jimmy Huang York University, Canada Hideo Joho University of Tsukuba, Japan Jaap Kamps University of Amsterdam, Netherlands Jussi Karlgren Gavagai & KTH, Sweden Diane Kelly University of North Carolina at Chapel Hill, USA Oren Kurland Technion, Israel Wai Lam The Chinese University of Hong Kong, Hong Kong Birger Larsen Aalborg University Copenhagen, Denmark Christina Lioma University of Copenhagen, Denmark Yiqun Liu Tsinghua University, China Massimo Melucci University of Padua, Italy Bhaskar Mitra Microsoft, UK Alistair Moffat (The University of Melbourne, Australia) Gabriella Pasi Universita degli Studi di Milano Bicocca, Italy Benjamin Piwowarski \ Université Pierre et Marie Curie, France

Stefan Rueger The Open University, UK Tetsuya Sakai Waseda University, Japan Rodrygo Santos Universidade Federal de Minas Gerais, Brazil Mark D. Smucker University of Waterloo, Canada Benno Stein Bauhaus-Universität Weimar, Germany Adith Swaminathan Cornell University, USA Theodora Tsikrika CERTH, Greece Ellen M. Voorhees National Institute of Standards and Technology, USA Bin Wang Institute of Information Engineering, Chinese Academy of Sciences, China Ke Zhou Yahoo, UK Guido Zuccon Queensland University of Technology, Australia

ICTIR 2016

Clayton Hall Floor Plan

University of Delaware

9

SCHEDULEOverview Tuesday 9/13

Thursday 9/15

Friday 9/16

9 AM Welcome and keynote address

9 AM Dealing with Bias in IR Evaluation

9 AM Query Understanding

AM break

AM break

10:45 AM Retrieval and Ranking

10:45 AM Word Embedding for IR

12:30 PM Lunch (on your own)

12:30 PM Lunch (on your own)

12:30 PM Lunch (on your own)

2 PM Afternoon tutorials (three in parallel)

2 PM Understanding the Search Engine

2 PM Learning to Rank

PM break

PM break

PM break

4 PM Afternoon tutorials (three in parallel)

4 PM Frameworks & Platforms for IR Evaluation

4 PM Exploiting Structure

9 AM Morning tutorials (two in parallel)

Wednesday 9/14

AM break 11 AM Morning tutorials (two in parallel)

AM break 11:15 AM Location & Events 12:45 PM Lunch (provided)

2:45 AM Social Media

5:30 PM Women in IR 6 PM Welcome reception

10

6:30 PM Poster reception

6 PM Banquet Dinner

ICTIR 2016

w

TUESDAY

September 13

Registration desk opens Location: Clayton Hall Lobby 9:00 am–12:30 pm AM break 10:30 – 11:00

Tutorial 1: Advances in Formal Models of Search and Search Behavior Presenters: Leif Azzopardi and Guido Zuccon Location: Room 124 Tutorial 2: Topic Set Design and Power Analysis in Practice Presenter: Tetsuya Sakai Location: Room 122

12:30 pm– 2 pm 2 pm–5:30pm PM break 3:30 – 4:00

Lunch (on your own) Tutorial 1: Advances in Formal Models of Search and Search Behavior Presenters: Leif Azzopardi and Guido Zuccon Location: Room 124 Tutorial 3: Utilizing Knowledge Bases in Text-centric Information Retrieval Presenters: Laura Dietz, Alexander Kotov, and Edgar Meij Location: Room 122 Tutorial 4: Collaborative Information Retrieval: Frameworks, Theoretical Models, and Emerging Topics Presenters: Lynda Tamine and Laure Soulier Location: Room 123

6:00 pm University of Delaware

Welcome Reception Location: Clayton Hall Lobby

11

TUTORIAL 1: Advances in Formal Models of Search Behavior

Leif Azzopardi

University of Strathclyde, Glasgow, UK

Guido Zuccon

Queensland University of Technology, Australia

12

ABSTRACT: Searching is performed in the context of a task and as such the value of the information found is with respect to the task.

Recently, there has been a drive to developing formal models of information seeking and retrieval that consider the costs and benefits arising through the interaction with the interface/ system and the information surfaced during that interaction.

In this full day tutorial we will focus on describing and explaining some of the more recent and latest formal models of Information Seeking and Retrieval. The tutorial is structured into two parts. In the first part we will present a series of models that have been developed based on: (i) economic theory, (ii) decision theory (iii) game theory and (iv) optimal foraging theory. The second part of the day will be dedicated to building models where we will discuss different techniques to build and develop models from which we can draw testable hypotheses from. During the tutorial participants will be challenged to develop various formals models, applying the techniques learnt during the day. We will then conclude with presentations on solutions followed by a summary and overview of challenges and future directions. This tutorial is aimed at participants wanting to know more about the various formal models of information seeking, search and retrieval, that have been proposed. The tutorial will be presented at an intermediate level, and is designed to support participants who want to be able to understand and build such models.

PRESENTER BIOS: Dr. Leif Azzopardi has been recently awarded a Chancellor's Fellowship at the University of Strathclyde within the Department of Computer and Information Sciences. Prior to this appointment, he was a Senior Lecturer in the School of Computing Science at the University of Glasgow. His research focuses on building formal models for Information Retrieval - usually drawing upon different disciplines for inspiration, such as Quantum Mechanics, Operations Research, Microeconomics, Transportation Planning and Gamification.

ICTIR 2016

He received his Ph.D. in Computing Science from the University of Paisley in 2006, and he received a First Class Honours Degree in Information Science from the University of Newcastle, Australia, 2001. In 2010, he received a PostGraduate Certificate in Academic Practice and has been lecturing at the University of Glasgow since then. He has given numerous invited talks on Formal Models of Information Seeking and Retrieval throughout the world and lectured at the Information Foraging Summer School (2011, 2012 and 2013) and Symposium of Future Directions in Information Access (2007-2013).

Dr. Guido Zuccon is a lecturer within the School of Information Systems at the Queensland University of Technology. His research interests include formal models of search, ranking principles for information retrieval, and retrieval models for health search. Guido has actively contributed to the area of document ranking and search result diversification. During his Ph.D. he performed an extensive analysis of document ranking principles and introduced the quantum probability ranking principle and was the first to empirically evaluate the interactive PRP. His work on formal models of search result diversification based on facility location analysis received the best paper award at ECIR 2013 and then in 2014 he received a best reviewer award at ECIR. He received a Ph.D. in Computing Science from the University of Glasgow in 2012, and he received a Master in Computer Engineering with summa cum laude from the University of Padua, Italy, in 2007. Before joining the Queensland University of Technology as a lecturer in 2014, he was a postdoctoral research fellow at the CSIRO, Australia.

University of Delaware

13

TUTORIAL 2: Topic Set Design and Power Analysis in Practice

Tetsuya Sakai Waseda University, Japan

ABSTRACT: Topic set size design methods provide principles and procedures for test collection builders to decide on the number of topics to create. These methods can then help us keep improving the test collection design based on accumulated data. Simple Excel tools are available for such purposes.

Post-hoc power analysis tools, available as simple R scripts, can help IR researchers examine the achieved power of a reported experiment and determine future sample sizes for ensuring high power. Thus, for example, underpowered user experiments can be detected, and a larger sample size can be proposed. If used appropriately,these Excel and R tools should be able to provide the IR community with better experimentation practices. The main objective of this tutorial is to let IR researchers familiarise themselves with these tools and understand the basic ideas behind them.

Based on the reviewers' comments I received, I will start from the basics of statistical significance testing.

PRESENTER BIO: Tetsuya Sakai is a professor at the Department of Computer Science and Engineering, Waseda University, Japan. He is also an Associate Dean at the IT Strategies Division of Waseda, and a visiting professor at the National Institute of Informatics.

He joined Toshiba in 1993. He obtained a Ph.D from Waseda in 2000. From 2000 to 2001, he was a visiting reseacher at the Computer Laboratory, University of Cambridge, where he was supervised by the late Karen Sparck Jones. In 2007, he joined a startup as the director of the Natural Language Processing Lab. In 2009, he joined Microsoft Research Asia. He joined the Waseda faculty in 2013. He is an editor-in-chief of the Information Retrieval Journal (Springer), an associate editor of ACM TOIS. He is a general co-chair of NTCIR. He is also a general co-chair of ACM SIGIR 2017.

14

ICTIR 2016

TUTORIAL 3: Utilizing Knowledge Bases for Text-centric Information Retrieval

Laura Dietz

University of New Hampshire, USA

Alexander Kotov

Wayne State University, US

Edgar Meij Bloomberg L.P., UK University of Delaware

ABSTRACT: General-purpose knowledge bases are increasingly growing in terms of depth (content) and width (coverage). Moreover, algorithms for entity linking and entity retrieval have improved tremendously in the past years. These developments give rise to a new line of research that exploits and combines these developments for the purposes of text-centric information retrieval applications.

This tutorial focuses on a) how to retrieve a set of entities for an ad-hoc query, or more broadly, assessing relevance of KB elements for the information need, b) how to annotate text with such elements, and c) how to use this information to assess the relevance of text. We discuss different kinds of information available in a knowledge graph and how to leverage each most effectively.

PRESENTER BIOS: Prof. Dr. Laura Dietz is a professor at University of New Hampshire, where she teaches Information Retrieval and Machine Learning. Before that she was working in the Data and Web Science group at Mannheim University, with Prof.

Bruce Croft and Prof. Andrew McCallum at University of Massachusetts, and obtained her Ph.D. from the Max Planck Institute for Informatics. Her research focuses on text processing and information retrieval with knowledge bases.

Her scientific contributions span from entity linking to the prediction of influences in citation graphs. In this tutorial, she will cover her seminal publication on entity query feature expansion and her work on finding relevant relations.

Prof. Dr. Alexander Kotov is an Assistant Professor in the Department of Computer Science at Wayne State University.

His general research interests lie at the intersection of information retrieval, textual data mining and health informatics. Before joining Wayne State, he was a postdoctoral fellow at Emory University working with Prof.

Eugene Agichtein. Dr. Kotov obtained his PhD from the 15

University of Illinois at Urbana-Champaign, under the supervision of Professor ChengXiang Zhai. At Wayne State has been teaching graduate courses on Information Retrieval and NoSQL databases as well as undergraduate courses. This tutorial will cover his work on using semantic networks for query expansion and his recent work on entity retrieval from knowledge graphs.

Dr. Edgar Meij is a senior scientist at Bloomberg. Before this, he was a research scientist at Yahoo Labs and a postdoc at the University of Amsterdam, where he also obtained his Ph.D. He regularly teaches at the (post-)graduate level, including university courses and conference tutorials, e.g., at EACL 2009, SIGIR 2013, WWW 2013, and WSDM 2014. His research focuses on all applications and aspects of knowledge graphs, entity linking, and semantic search. This tutorial will cover his contributions on entity aspect mining and finding support passages for relations.  

16

ICTIR 2016

TUTORIAL 4: Collaborative Information Retrieval: Frameworks, Theoretical Models, and Emerging Topics

Lynda Tamine

University of Toulouse UPS – IRIT, France

Laure Soulier

Sorbonne Universites, UPMC Univ Paris 06 – LIP6

ABSTRACT: A great amount of research in the IR domain mostly dealt with both the design of enhanced document ranking models allowing search improvement through user-to-system collaboration. The latter is perceived as part of the search process leading to an interactive process where the system learns from the user and adapts the search accordingly.

However, in addition to user-to-system form of collaboration, user-to-user collaboration is increasingly acknowledged as an effective means for gathering the complementary skills and/ or knowledge of individual users in order to solve complex search tasks, such as fact-finding tasks (e.g., travel planning) or exploratory search tasks. Collaboration allows the group achieving a result that is more effective than the simple aggregation of the individual results. This tutorial will first give an overview of the ways into collaboration has been implemented in IR models with the attempt of improving the search outcomes with respect to several tasks and related frameworks (ad-hoc search, group-based recommendations, social search, collaborative search). Second, as envisioned in collaborative IR domain (CIR), we will focus on the theoretical models that support and drive user-to-user collaboration in order to perform shared IR tasks. Third, we will develop a road map on emerging and relevant topics addressing issues related to collaboration design. Our goal is to provide participants with concepts and motivation to allow them to investigate this emerging IR domain as well as giving them some clues on how to tackle issues related to the optimization of collaborative tasks. The participants will also have an opportunity to share their experience within orthogonal research domains.

More specifically, the tutorial aims to: 1. Give an overview of the key concept of collaboration in IR and related research topics; 2. Present state-of-the art CIR techniques and models; 3. Discuss about the emerging topics that deal with collaboration; 4. Point out some challenges ahead.

University of Delaware

17

PRESENTERS BIOS: Lynda Tamine is a full Professor at Paul Sabatier University and member of the Institut de Recherche en Informatique de Toulouse, France. Her research interests include modeling and evaluation of contextual, collaborative, social, and medical IR. Since May 2015, she is the head of the IRIT research theme on ”Information Retrieval and indexing” and was a member of the French association on IR and applications (ARIA) during the period 2007-2014. She leads and/or is involved in several IR related research projects. She coorganized several IR related scientific events including the CIRSE international workshop 2009-2010 on the evaluation of contextual IR (with Joemon Jose, Massimo Melucci and Biech Lien), french autumn school on IR EARIA 2012 (with Eric Gaussier), french workshop on social IR 2010-2012 (with Eric Gaussier and Gregory Grefenstette) and recently, on march 2016, the french conference on IR SDNRI 2016 (with Gilles Hubert and Nadine Jessel). She has a relevant record of publications within the tutorial topic including sub-topics related to the design of system-driven CIR (CIR) models (IP&M 2014, SIGIR 2014, IP&M accepted in april 2016) and user’s behaviour understanding within a CIR framework (CIKM 2015). She has co-organized, with Laure Soulier, Leif Azzopardi, Testsuya Sakai and Jeremy Pickens, the 1st workshop on the Evaluation of Collaborative Information Retrieval and Seeking (Ecol) in conjunction with the 24th Conference on Information and Knowledge Management (CIKM’2015) Laure is an associate professor at the Pierre and Marie Curie University and joined the “Laboratoire d’Informatique de Paris 6” (LIP6) since September 2015. She is interested in Information Retrieval and more particularly in the CIR research field in which she obtained her PhD in 2014 in Paul Sabatier University (Toulouse). With Lynda Tamine, she proposed several contributions dealing with collaborative ranking models relying either on the domain expertise of users as well as their roles. Significant publications have been accepted at AIRS 2013 (Best paper Award), IP&M 2014 and 2016 (recently accepted), SIGIR 2014 and CIKM 2015. Laure has collaborated with Chirag Shah at the University of Rutgers for a 3-month internship where she worked on role analysis and detection for CIR. She co-organizes with Lynda Tamine, Leif Azzopardi, Tetsuya Sakai, and Jeremy Pickens a CIKM workshop (ECol 2015) dealing with the Evaluation of Collaborative Information Retrieval and Seeking. She also co-presented with Lynda Tamine a tutorial at ECIR 2016 on Collaborative Information Retrieval (CIR 2016).

18

ICTIR 2016

WEDNESDAY

September 14

8:00 am 9:00 am–10:15 am

10:15 am– 10:45 am

10:45 am–12:30pm

Registration desk opens Location: Clayton Hall Lobby Conference welcome and keynote address Keynote title: Applying User Modeling and Computational Linguistics to Graph Retrieval Keynote speaker: Prof. Sandra Carberry University of Delaware Location: Auditorium 125 AM break Location: Clayton Hall Lobby Session 1: Retrieval and Ranking Location: Auditorium 125 10:45am: Exploiting the Bipartite Structure of Entity Grids for Document Coherence and Retrieval Christina Lioma University of Copenhagen Fabien Tarissan CNRS Jakob Grue Simonsen University of Copenhagen Casper Petersen University of Copenhagen Birger Larsen University of Aalborg in Copenhagen 11:15am: Efficient and Effective Higher Order Proximity Modeling Xiaolu Lu RMIT University Alistair Moffat The University of Melbourne J. Shane Culpepper RMIT University

University of Delaware

19

10:45 am–12:30 pm continued

11:45am: PDF: A Probabilistic Data Fusion Framework for Retrieval and Ranking Ashraf Bah University of Delaware Ben Carterette University of Delaware 12:15pm: Axiomatic Learning to Rank Fernando Diaz Microsoft

12:30 pm–2 pm 2:00 pm–3:30 pm

Lunch (on your own) Session 2: Understanding the Search Experience Location: Auditorium 125 2pm: Total Recall: Blue Sky on Mars Charles Clarke University of Waterloo Gordon Cormack University of Waterloo Jimmy Lin University of Waterloo Adam Roegiest University of Waterloo 2:15pm: Classifying User Search Intents for Auto-Completion Jyun-Yu Jiang National Taiwan University Pu-Jen Cheng National Taiwan University 2:45pm: An Analysis of the Cost and Benefit of Search Interactions Leif Azzopardi University of Glasgow Guido Zuccon Queensland University of Technology (QUT) 3:15pm: Lexical Query Modeling in Session Search Christophe Van Gysel The University of Amsterdam Evangelos Kanoulas The University of Amsterdam Maarten de Rijke The University of Amsterdam

20

ICTIR 2016

3:30 pm–4:00 pm

PM break Location: Clayton Hall Lobby Session 3: Frameworks & Platforms for IR Evaluation Location: Auditorium 125

4:00 pm–5:15 pm

4:00pm: The Effect of Document Order and Topic Difficulty on Assessor Agreement Tadele Tedla Damessie RMIT University Falk Scholer RMIT University Kalervo Järvelin University of Tampere J. Shane Culpepper RMIT University 4:15pm: A Reproducibility Study of Information Retrieval Methods Peilin Yang University of Delaware Hui Fang University of Delaware 4:45pm: Experimental Design for Online Evaluation Using Offline Evaluation Measures Hosein Azarbonyad The University of Amsterdam Evangelos Kanoulas The University of Amsterdam 5:00pm: Retrievability in API-Based “Evaluation as a Service” Jiaul Hoque Paik IIT Kharagpur Jimmy Lin University of Waterloo

5:30 pm–6:30 pm

6:30 pm

University of Delaware

Women in IR Meeting Location: TBD Poster reception Location: Clayton Hall Lobby

21

KEYNOTE ADDRESS Applying User Modeling and Computational Linguistics to Graph Retrieval

Sandra Carberry Dept. of Computer Science University of Delaware

22

Infographics (bar charts, line graphs, etc.) are prevalent in popular media and constitute a rich knowledge source.

While a great deal of research has dealt with retrieval of textual documents, relatively little attention has been given to the retrieval of infographics. In this talk, I will show how user modeling and computational linguistics can be used to identify the high-level content of an infographic and how computational linguistics can be used to extract a user's information need from a full-sentence query. I will then present a mixture model that utilizes features of an infographic, including its high-level content, to retrieve infographics that satisfy a user's information need as expressed in a query.

Sandra Carberry has been a Professor of Computer Science at the University of Delaware and served as Department Chair. She is one of the founders of the User Modeling research area at the first workshop in Maria Laach, 1986. Her areas of research are natural language understanding, user modelling, graph retrieval, intelligent interfaces, and plan recognition. She has twice served as program chair of the user modeling conference, has been an editorial board member of the the journal User Modeling and User Adapted Interaction since its inception, has been the program chair for the ACL (Association for Computational Linguistics) conference and on the ACL Executive Board, and has served on the editorial board of the journal Computational Linguistics and as an associate editor of the International Journal of Human Computer Studies.

ICTIR 2016

POSTERS From 'More Like This' to 'Better Than This' Haggai Roitman IBM Research - Haifa Doron Cohen IBM Research - Haifa Shay Hummel IBM Research - Haifa Lexical Query Modeling in Session Search Christophe Van Gysel The University of Amsterdam Evangelos Kanoulas The University of Amsterdam Maarten de Rijke The University of Amsterdam Bag-of-Entity Representation for Ranking Chenyan Xiong Carnegie Mellon University Jamie Callan Carnegie Mellon University Tie-Yan Liu Microsoft Temporal Query Expansion with Continuous Hidden Markov Model Jinfeng Rao University of Maryland at College Park Jimmy Lin University of Waterloo Joint Estimation of Topics and Hashtag Relevance in Cross-Lingual Tweets Procheta Sen Indian Statistical Institute Debasis Ganguly Dublin City University Gareth Jones Dublin City University Nearest Neighbour based Transformation Functions for Text Classification: A case study with StackOverflow Piyush Arora Dublin City University Debasis Ganguly Dublin City University Gareth Jones Dublin City University Retrievability in API-Based “Evaluation as a Service�

Jiaul Hoque Paik IIT Kharagpur Jimmy Lin University of Waterloo University of Delaware

23

POSTERS Continued

Retrieval Performance Bound Analysis for Single Term Queries Peilin Yang University of Delaware Hui Fang University of Delaware The Impact of Fixed-Cost Pooling Strategies on Test Collection Bias Aldo Lipani Vienna University of Technology Guido Zuccon Queensland University of Technology, Brisbane Mihai Lupu Vienna University of Technology Bevan Koopman Australian e-Health Research Centre, CSIRO, Brisbane Allan Hanbury Vienna University of Technology Total Recall: Blue Sky on Mars Charles Clarke University of Waterloo Gordon Cormack University of Waterloo Jimmy Lin University of Waterloo Adam Roegiest University of Waterloo The Effect of Document Order and Topic Difficulty on Assessor Agreement Tadele Tedla Damessie RMIT University Falk Scholer RMIT University Kalervo Järvelin University of Tampere J. Shane Culpepper RMIT University Experimental Design for Online Evaluation Using Offline Evaluation Measures Hosein Azarbonyad The University of Amsterdam Evangelos Kanoulas The University of Amsterdam Fast Feature Selection for Learning to Rank Andrea Gigli University of Pisa Claudio Lucchese ISTI-CNR Franco Maria Nardini ISTI-CNR Raffaele Perego ISTI-CNR 24

ICTIR 2016

Rank-at-a-Time Query Processing Matthew Crane University of Waterloo Ahmed Elbagoury University of Waterloo Jimmy Lin University of Waterloo Axiomatic Learning to Rank Fernando Diaz Microsoft Cross-Language Microblog Retrieval using Latent Semantic Modeling Archana Godavarthy Santa Clara University Yi Fang Santa Clara University A Topical Approach to Retrievability Bias Estimation Colin Wilkie University of Glasgow Leif Azzopardi University of Glasgow End to End Long Short Term Memory Networks for Non-Factoid Question Answering Daniel Cohen UMASS Amherst W. Bruce Croft UMASS Amherst A Study of Document Expansion using Translation Models and Dimensionality Reduction Methods Saeid Balaneshin-kordan Wayne State University Alexander Kotov Wayne State University

University of Delaware

25

THURSDAY

September 15

8:00 am 9:00 am–10:30 am

Registration desk opens Location: Clayton Hall Lobby Session 4: Dealing with Bias in IR Evaluation Location: Auditorium 125 9:00am: A Simple and Effective Approach to Score Standardisation Tetsuya Sakai Waseda University 9:30am: The Impact of Fixed-Cost Pooling Strategies on Test Collection Bias Aldo Lipani Vienna University of Technology Guido Zuccon Queensland University of Technology, Brisbane Mihai Lupu Vienna University of Technology Bevan Koopman Australian e-Health Research Centre, CSIRO, Brisbane Allan Hanbury Vienna University of Technology 9:45am: Unbiased Comparative Evaluation of Ranking Functions Tobias Schnabel Cornell University Adith Swaminathan Cornell University Peter Frazier Cornell University Thorsten Joachims Cornell University 10:15am: A Topical Approach to Retrievability Bias Estimation Colin Wilkie University of Glasgow Leif Azzopardi University of Glasgow

26

ICTIR 2016

10:30 am–11:00 am

AM break Location: Clayton Hall Lobby

11:00 am–12:45 pm

Session 5: Word Embedding for IR Location: Auditorium 125 11:00am: Estimating Embedding Vectors for Queries Hamed Zamani University of Massachusetts Amherst W. Bruce Croft University of Massachusetts Amherst 11:30am: Analysis of the Paragraph Vector Model for Information Retrieval Qingyao Ai University of Massachusetts Amherst Liu Yang University of Massachusetts Amherst Jiafeng Guo Institute of Computing Technology, Chinese Academy of Sciences W. Bruce Croft University of Massachusetts Amherst 12:00pm: End to End Long Short Term Memory Networks for Non-Factoid Question Answering Daniel Cohen UMASS Amherst W. Bruce Croft UMASS Amherst 12:15pm: Embedding-based Query Language Models Hamed Zamani University of Massachusetts Amherst W. Bruce Croft University of Massachusetts Amherst

12:45 pm–2:15 pm 2:15 pm–3:45 pm

University of Delaware

Lunch (on your own) Session 6: Learning to Rank Location: Auditorium 125 27

2:15 pm–3:45 pm Continued

2:15pm: Learning to Rank User Queries to Detect Search Tasks Claudio Lucchese ISTI-CNR, Pisa Franco Maria Nardini ISTI-CNR, Pisa Salvatore Orlando Université Ca' Foscari Venezia Gabriele Tolomei Yahoo, London 2:45pm: Fast Feature Selection for Learning to Rank Andrea Gigli University of Pisa Claudio Lucchese ISTI-CNR Franco Maria Nardini ISTI-CNR Raffaele Perego ISTI-CNR 3:00pm: A Unified Energy-based Framework for Learning to Rank Yi Fang Santa Clara University Mengwen Liu Drexel university 3:30pm: Bag-of-Entity Representation for Ranking Chenyan Xiong Carnegie Mellon University Jamie Callan Carnegie Mellon University Tie-Yan Liu Microsoft

3:45 pm–4:15 pm

PM break Location: Clayton Hall Lobby

4:15 pm–6:00 pm

Session 7: Exploiting Structure Location: Auditorium 125 4:15pm: On Horizontal and Vertical Separationin Hierarchical Text Classification Mostafa Dehghani The University of Amsterdam Hosein Azarbonyad The University of Amsterdam Jaap Kamps The University of Amsterdam Maarten Marx The University of Amsterdam

28

ICTIR 2016

4:15 pm–6:00 pm Continued

4:45pm: From 'More Like This' to 'Better Than This' Haggai Roitman IBM Research - Haifa Doron Cohen IBM Research - Haifa Shay Hummel IBM Research - Haifa 5:00pm: Understanding the Message of Images with Knowledge Base Traversals Lydia Weiland University of Mannheim Ioana Hulpus University of Mannheim Simone Paolo Ponzetto University of Mannheim Laura Dietz University of Mannheim 5:30pm: Exploiting Entity Linking in Queries for Entity Retrieval Faegheh Hasibi Norwegian University of Science and Technology Krisztian Balog University of Stavanger Svein Erik Bratsberg Norwegian University of Science and Technology

6:30 pm

10:00 pm

University of Delaware

Travel from hotel to banquet Location: Outside of Courtyard Marriott Travel from banquet to hotel

29

BANQUET LOCATION and Directions The conference banquet will be held at the World CafĂŠ Live at the Queen in downtown Wilmington. All attendees are welcome to attend (but guests of attendees need to purchase a ticket at the registration desk). A bus will depart the Courtyard Marriott for the Queen at 6:30pm on Thursday the 15th, and will return to the hotel at 10pm.

The Queen is at 500 N. Market St in Wilmington, DE. If you are using your own transportation, you will want to

30

get on I-95 North (head south from the hotel and follow signs to 95).

Stay on 95 until exit 6 (M.L. King Jr. Blvd). Continue straight through three intersections, then turn right on 4th St. Take 4th St to N Market St and turn left. The Queen will be on the left after one block. Street parking will probably be available, and there are parking garages nearby.  

ICTIR 2016

FRIDAY

September 16

8:00 am 9:00 am–10:45 am

Registration desk opens Location: Clayton Hall Lobby 9:00am – 10:45am Session 8: Query Understanding Location: Auditorium 125 9:00am: Query Anchoring Using Discriminative Query Models Saar Kuzi Technion Anna Shtok Technion Oren Kurland Technion 9:30am: Rank-at-a-Time Query Processing Matthew Crane University of Waterloo Ahmed Elbagoury University of Waterloo Jimmy Lin University of Waterloo 9:45am: A Study of Document Expansion using Translation Models and Dimensionality Reduction Methods Saeid Balaneshin-kordan Wayne State University Alexander Kotov Wayne State University 10:00am: Retrieval Performance Bound Analysis for Single Term Queries Peilin Yang University of Delaware Hui Fang University of Delaware

University of Delaware

31

9:00 am–10:45 am Continued

10:15am: Optimization Method for Weighting Explicit and Latent Concepts in Clinical Decision Support Queries Saeid Balaneshin-kordan Wayne State University Alexander Kotov Wayne State University

10:45 am–11:15 am

AM break Location: Clayton Hall Lobby

11:15 am–12:45 pm

Session 9: Locations and Events Location: Auditorium 125 11:15am: Exploring Urban Lifestyles Using a Nonparametric Temporal Graphical Model Shoaib Jameel Cardiff University Yi Liao The Chinese University of Hong Kong Wai Lam The Chinese University of Hong Kong Steven Schockaert Cardiff University Xing Xie Microsoft Research 11:45am: EventMiner: Mining Events from Annotated Documents Dhruv Gupta Max Planck Institute for Informatics Klaus Berberich Max Planck Institute for Informatics Jannik Stroetgen Max Planck Institute for Informatics 12:15pm: Who Wants to Join Me? Companion Recommendation in Location Based Social Networks Yi Liao The Chinese University of Hong Kong Wai Lam The Chinese University of Hong Kong Shoaib Jameel Cardiff University Steven Schockaert Cardiff University Xing Xie Microsoft Research

32

ICTIR 2016

12:45 pm–2:45 pm

2:45 pm–4:15 pm

Business lunch Location: TBD Session 10: Social Media Location: Auditorium 125 2:45pm: A Utility Maximization Framework for Privacy Preservation of User Generated Content Yi Fang Santa Clara University Archana Godavarthy Santa Clara University Haibing Lu Santa Clara University 3:15pm: Joint Estimation of Topics and Hashtag Relevance in Cross-Lingual Tweets Procheta Sen Indian Statistical Institute Debasis Ganguly Dublin City University Gareth Jones Dublin City University 3:30pm: Temporal Query Expansion with Continuous Hidden Markov Model Jinfeng Rao Univ of maryland at college park Jimmy Lin University of Waterloo 3:45pm: Nearest Neighbour based Transformation Functions for Text Classification: A case study with StackOverflow Piyush Arora Dublin City University Debasis Ganguly Dublin City University Gareth Jones Dublin City University 4:00pm: Cross-Language Microblog Retrieval using Latent Semantic Modeling Archana Godavarthy Santa Clara University Yi Fang Santa Clara University

University of Delaware

33

NORTH COLLEGE AVE

11

12

14 1 9 10 4 6

EAST MAIN STREET

GETTING AROUND

NEWARK

34

ICTIR 2016

8

15

13 2

8 7

5

3

The conference venue and hotel are next door to each other on the University of Delaware’s Laird campus, just north of the main campus.

There is a walking path that will take you to N. College Avenue, which you can follow south to E. Main Street, where the majority of restaurants and bars are located.

University of Delaware

The University’s main campus is just south of Main Street; follow S. College Avenue to see it.

35

LOCAL RESTAURANTS 1) Home Grown Cafe

(0.9 miles from hotel) - [Lunch, Dinner] Colorful eatery with vegetarian-friendly meals features local art on the walls & regular live music.

126 E Main St, Newark, DE 19711 Daily: 11AM-1AM www.homegrowncafe.com

2) Ali Baba Mid Eastern Restaurant

(1.1 miles from hotel) [Lunch (Thursday-Friday), Dinner] Middle Eastern platters of traditional fare & hookah served amid festive Moroccan decor.

75 E Main St, Newark, DE 19711 Saturday-Wednesday: 4PM-11PM Thursday-Friday: 11:30AM-11PM

3) Ramen Kumamoto

(1.0 miles from hotel) - [Lunch, Dinner] Cuisine: Japanese 165 E Main St, Newark, DE 19711 Daily: 11:30AM - 10PM

4) Taverna

(0.9 miles from hotel) - [Lunch, Dinner] Brick-walled bar & eatery preparing coal-fired pizzas, homemade pastas & other Italian meals.

121 E Main St, Newark, DE 19711 Monday-Saturday: 11:30AM - 1:30AM Sunday: 11:30AM - 10PM http://www.tavernamainstreet.com

5) Grain Craft Bar+Kitchen

(1.3 miles from hotel) - [Lunch, Dinner] Rustic-chic gastropub with USB chargers at the bar offering craft beer, upscale bar eats & music.

270 E Main St, Newark, DE 19711 Monday-Saturday: 11:30AM - 1AM Sunday: 10:30AM - 11PM www.grainonmain.com

36

6) Stone Balloon Ale House

(0.9 miles from hotel) - [Lunch, Dinner] Stone Balloon Ale House is a new twist on an old name, featuring a terrific selection of craft beers and comfort food...playfully reimagined.

115 E Main St, Newark, DE 19711 Tuesday-Saturday: 11AM - 11PM Sunday: 10:30AM - 9PM (Closed on Monday's) www.stoneballoon.com

7) Iron Hill Brewery & Restaurant

(1.0 miles from hotel) - [Lunch, Dinner] Regional brewpub chain dispensing housemade beers & elevated American comfort fare.

147 E Main St, Newark, DE 19711 Monday: 11:30AM - 11PM Tuesday: 11:30AM - 12AM Wednesday-Friday: 11:30AM - 1AM Saturday: 11AM - 1AM Sunday: 11AM- 11PM www.ironhillbrewery.com

8) Klondike Kate's Restaurant and Bar

(1.0 miles from hotel) - [Lunch, Dinner] Classic American fare & drinks in a circa-1880 building featuring vintage railroad station decor.

158 E Main St, Newark, DE 19711 Monday-Saturday: 11AM - 1AM Sunday: 10AM - 1AM www.klondikekates.com

9) Del Pez Mexican Gastropub

(0.8 miles from hotel) - [Lunch, Dinner] Cuisine: Mexican, Latin American.

76 E Main St, Newark, DE 19711 Monday-Wednesday: 11AM - 10PM Thursday-Saturday: 11AM - 1AM Sunday: 11AM - 9:30PM http://www.hakunahospitalitygroup.com/del-pezsea-mex/

ICTIR 2016

10) Caffe Gelato Restaurant

(0.8 miles from hotel) - [Lunch, Dinner] Welcoming cafe features gourmet Italian-American fare, a robust wine list, desserts & patio seating.

90 E Main St, Newark, DE 19711 Monday-Thursday: 11AM - 9:30PM Friday-Saturday: 11AM - 10PM Sunday: 10:30AM - 3PM, 4PM - 8PM www.caffegelato.net

11) Deer Park Tavern

(0.5 miles from hotel) - [Lunch, Dinner] Landmark spot on site with Revolutionary War roots features a bar, American fare & trivia nights.

108 W Main St, Newark, DE 19711 Monday-Friday: 11:30AM - 1AM Saturday: 10AM - 1AM Sunday: 9AM - 1AM www.deerparktavern.com

12) Newark Deli & Bagels

(0.7 miles from hotel) - [Breakfast, Lunch] Cuisine: Delis, Bagels, Breakfast & Brunch.

36 E Main St, Newark, DE 19711 Daily: 7AM - 5PM www.newarkdeliandbagels.com

13) Santa Fe Mexican Grill

(1.1 miles from hotel) - [Lunch, Dinner] South-of-the-border style taqueria & bar plating hefty portions of Mexican favorites.

190 E Main St, Newark, DE 19711 Monday-Thursday: 11AM - 11PM Friday: 11AM - 1AM Saturday: 10AM - 1AM Sunday: 10AM -11PM www.santafemexicangrill.com/newark

14) Catherine Rooney's Irish Pub and Restaurant

(0.9 miles from hotel) - [Lunch, Dinner] Cuisine: Irish.

102 E Main St, Newark, DE 19711 Monday-Friday: 11AM - 1AM Saturday-Sunday: 10AM - 1AM www.catherinerooneys.com

University of Delaware

15) Churrascaria Saudades Brazilian Steakhouse

(1.2 miles from hotel) - [Dinner] Cuisine: Barbeque, Brazilian.

230 E Main St, Newark, DE 19711 Monday-Thursday: 5PM - 9PM Friday: 5PM 10PM Saturday: 4PM - 10PM Sunday: 3:30PM - 8PM www.eatsteaks.com

16) Godavari

(8.0 miles from hotel) - [Lunch, Dinner] Cuisine: Indian.

3615 Kirkwood Hwy, Wilmington, DE 19808 Monday-Thursday: 11:30AM - 2:30PM, 5:30PM -10PM Firday: 11:30AM - 2:30PM, 5:30PM -10.30PM Saturday: 12PM - 3:30PM, 5:30PM -10:30PM Sunday: 12PM - 3:30PM, 5:30PM -10PM www.godavarius.com

17) Border Cafe

(7.1 miles from hotel) - [Lunch, Dinner] Festive spot offering Cajun & Tex-Mex chow (including veggie options), plus margaritas, beer & wine.

483 Stanton Christiana Rd, Newark, DE 19713 Sunday-Wednesday: 11:30AM - 10PM Thursday-Saturday: 11:30AM - 11PM www.bordercafe.com

18) Bamboo House

(2.1 miles from hotel) - [Lunch, Dinner] Chinese dishes, sushi bar & cocktails served in a no-frills space with curtained walls & plants.

721 College Square, Newark, DE 19711 Monday-Thursday: 11:30AM - 3PM, 4:30PM - 9:30PM Friday-Saturday: 11:30AM - 3PM, 4:30PM - 10:30PM Sunday: 12PM - 9:30PM

37

General chairs ✖ Jaap Kamps

Publicity chair

✖ Evangelos Kanoulas ✖ Maarten de Rijke

✖ Julia Kiseleva Sponsorship chair ✖ Rianne Kaptein

PC chairs ✖ Emine Yilmaz

✖ Vacancy Important dates

✖ Hui Fang Short paper chairs

✖ Submissions: mid April 2017 ✖ Notifications: late May 2017

✖ Christina Lioma ✖ Katja Hofmann

✖ Conference: October 1–4, 2017 Special topic

Workshops chair

✖ Deep learning theory and IR

✖ Grace Hui Yang Tutorials chair ✖ Josiane Mothe

Amsterdam