This report summarizes the 37th European Conference on Information Retrieval (ECIR 2015), held in Vienna, Austria. It covers the conference's keynotes, program, industry day, tutorials, and workshops, offering a glimpse into the state of Information Retrieval (IR) research and its applications in 2015.
TL;DR
The ECIR 2015 conference report highlights key innovations like the Reproducible IR Research Track, emphasizing the growing importance of verifiable research in the field. It also details a new Industry Day format that focused on startups, fostering discussions on innovation and investment in IR.
What Problem Does This Paper Address?
This paper is a conference report, not a research paper with a specific problem statement. Instead, it serves to document and summarize the proceedings of the ECIR 2015 conference. The implicit goal is to inform the IR community about the key themes, discussions, and outcomes of the conference, thereby contributing to the dissemination of knowledge and the advancement of the field.
Methods
As a conference report, this document does not present novel research methods. Instead, it describes the methods and approaches discussed and presented at the conference. Key aspects include:
- Reproducible IR Research Track: This track introduced a new focus on the reproducibility of experimental results in IR. The report outlines the criteria for this track, emphasizing the scientific aspect of independent reproduction of experimental results.
- Industry Day Format: A departure from previous years, the Industry Day was a standalone event focusing on startups and niche companies, aiming to bridge the gap between academia and industry innovation.
- Keynote Presentations: The report summarizes the talks given by prominent researchers, covering topics from unsolved search problems to user behavior analysis in online environments.
- Tutorials and Workshops: The report details the various tutorials and workshops offered, covering a wide range of IR sub-fields, from effectiveness metrics and retrievability to complex search tasks and multimodal retrieval.
Datasets
Not discussed in the paper.
Key Insights and Ideas
- The Imperative of Reproducibility: The introduction of the Reproducible IR Research Track signals a significant shift towards valuing and verifying research findings. The discussion around the "scientific aspect" of reproducibility (independent reproduction of results) highlights a core concern for the field's credibility.
- Bridging Academia and Industry: The revamped Industry Day, with its focus on startups, suggests a growing recognition of the dynamic nature of IR innovation and the need for closer collaboration between academic researchers and emerging companies.
- The "Long Tail" of Research Challenges: One keynote emphasized that many fundamental search problems remain unsolved, providing a rich landscape for future research and student inspiration.
- Understanding User Behavior: The conference showcased work on analyzing user behavior in various contexts, from online health searches to complex interactions in virtual worlds, underscoring the human-centric aspect of IR.
- The Evolving Landscape of Evaluation: Discussions around evaluation metrics and the introduction of visual analytics for IR evaluation point to a continuous effort to refine how we measure the success of IR systems.
Key Results
This report does not present quantitative results from a specific experiment. Instead, it summarizes the outcomes and themes of the conference:
- Submissions: ECIR 2015 received 305 submissions (190 full papers, 103 short papers, 12 demonstrations).
- Acceptance Rates: 23% of full papers were accepted for oral presentation, 38% of short papers for poster presentation, and 58% of demonstrations were accepted.
- Attendance: A total of 230 people attended the conference.
- Reproducible IR Research Track: Seven papers were submitted, with three accepted for oral presentation.
- Industry Day Attendance: Over 70 people attended the Industry Day at its peak.
- Student Support: 22 students received registration fee waivers, and 19 of those also received travel and accommodation support.
Limitations and Future Work
- Reproducibility Track Expansion: The report suggests that future iterations of the Reproducible IR Research Track could expand to include requirements for "impact aspect" (reproducing surprising results or results on proprietary data) and "further reproducibility aspect" (making all materials available).
- Industry Day Structure: A suggestion for future ECIR conferences is to implement a more structured way of connecting companies looking to hire with job seekers.
- Continued Focus on Reproducibility: The report explicitly states that the Reproducible IR Research Track will continue at ECIR 2016, indicating its perceived importance and success.
- New Directions in IR: The various workshops and tutorials covered emerging areas like gamification, complex search tasks, context-awareness, bibliometric-enhanced IR, and multimodal retrieval in specialized domains (like medicine), pointing towards future research trajectories.
Summary updated