skip to main content
research-article

Report on the 6th workshop on search-oriented conversational AI (SCAI 2021)

Published:17 March 2022Publication History
Skip Abstract Section

Abstract

The 6th edition of the Search-Oriented Conversational AI workshop (SCAI 2021) was organised as a discussion platform on conversational AI for intelligent information access. The workshop was designed to be multidisciplinary, bringing together researchers and practitioners across the fields of natural language processing (NLP), information retrieval (IR), machine learning (ML) and human-computer interaction (HCI). The workshop included four sessions featuring invited talks, a separate poster session, and a session discussing the results of a shared task on conversational question answering (SCAI-QReCC).

Date: 8 October, 2021.

Website: https://scai.info.

References

  1. Vaibhav Adlakha, Shehzaad Dhuliawala, Kaheer Suleman, Harm de Vries, and Siva Reddy. Topiocqa: Open-domain conversational question answeringwith topic switching, 2021.Google ScholarGoogle Scholar
  2. Francesca Alloatti, Luigi Di Caro, and Alessio Bosca. Conversation analysis, repair sequences and human computer interaction. In Proceedings of DEEP-DIAL, 2021. URL https://hdl.handle.net/2318/1795726.Google ScholarGoogle Scholar
  3. Raviteja Anantha, Svitlana Vakulenko, Zhucheng Tu, Shayne Longpre, Stephen Pulman, and Srinivas Chappidi. Open-domain question answering goes conversational via question rewriting. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021, Online, June 6--11, 2021, pages 520--534, 2021. Google ScholarGoogle ScholarCross RefCross Ref
  4. Jifan Chen, Eunsol Choi, and Greg Durrett. Can NLI models verify QA systems' predictions? In Findings of the Association for Computational Linguistics: EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 16--20 November, 2021, pages 3841--3854, 2021. URL https://aclanthology.org/2021.findings-emnlp.324.Google ScholarGoogle ScholarCross RefCross Ref
  5. Christian Geishauser, Songbo Hu, Hsien-chin Lin, Nurul Lubis, Michael Heck, Shutong Feng, Carel van Niekerk, and Milica Gašić. What does the user want? information gain for hierarchical dialogue policy optimisation. In Proceedings of ASRU, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  6. Farnaz Ghassemi Toudeshki, Philippe Jolivet, Alexandre Durand-Salmon, and Anna Liednikova. Zero-shot clinical questionnaire filling from human-machine interactions. In Proceedings of the 3rd Workshop on Machine Reading for Question Answering, pages 51--62, November 2021. URL https://aclanthology.org/2021.mrqa-1.5.Google ScholarGoogle ScholarCross RefCross Ref
  7. Vojtěch Hudeček, Ondřej Dušek, and Zhou Yu. Discovering dialogue slots with weak supervision. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 2430--2442, August 2021. URL https://aclanthology.org/2021.acl-long.189. Google ScholarGoogle ScholarCross RefCross Ref
  8. Zhen Jia, Soumajit Pramanik, Rishiraj Saha Roy, and Gerhard Weikum. Complex temporal question answering on knowledge graphs. In CIKM '21: The 30th ACM International Conference on Information and Knowledge Management, Virtual Event, Queensland, Australia, November 1 - 5, 2021, pages 792--802, 2021. URL https://doi.org/10.1145/3459637.3482416. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Magdalena Kaiser, Rishiraj Saha Roy, and Gerhard Weikum. Reinforcement learning from reformulations in conversational question answering over knowledge graphs. In SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11--15, 2021, pages 459--469, 2021. URL https://doi.org/10.1145/3404835.3462859. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Abhishek Kaushik and Gareth J. F. Jones. A conceptual framework for implicit evaluation of conversational search interfaces. CoRR, abs/2104.03940, 2021. URL https://arxiv.org/abs/2104.03940.Google ScholarGoogle Scholar
  11. Kalpesh Krishna, Aurko Roy, and Mohit Iyyer. Hurdles to progress in long-form question answering. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 4940--4957, June 2021. URL https://aclanthology.org/2021.naacl-main.393. Google ScholarGoogle ScholarCross RefCross Ref
  12. Anna Liednikova, Philippe Jolivet, Alexandre Durand-Salmon, and Claire Gardent. Gathering information and engaging the user ComBot: A task-based, serendipitous dialog model for patient-doctor interactions. In Proceedings of the Second Workshop on Natural Language Processing for Medical Conversations, pages 21--29, June 2021. URL https://aclanthology.org/2021.nlpmc-1.3. Google ScholarGoogle ScholarCross RefCross Ref
  13. Hsien-chin Lin, Nurul Lubis, Songbo Hu, Carel van Niekerk, Christian Geishauser, Michael Heck, Shutong Feng, and Milica Gasic. Domain-independent user simulation with transformers for task-oriented dialogue systems. In Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 445--456, July 2021. URL https://aclanthology.org/2021.sigdial-1.47.Google ScholarGoogle Scholar
  14. Aldo Lipani, Ben Carterette, and Emine Yilmaz. How am i doing?: Evaluating conversational search systems offline. ACM Trans. Inf. Syst., 39(4), August 2021. ISSN 1046-8188. URL https://doi.org/10.1145/3451160. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Linqing Liu, Patrick Lewis, Sebastian Riedel, and Pontus Stenetorp. Challenges in generalization in open domain question answering, 2021a.Google ScholarGoogle Scholar
  16. Zeyang Liu, Ke Zhou, and Max L. Wilson. Meta-evaluation of conversational search evaluation metrics. ACM Trans. Inf. Syst., 39(4), August 2021b. ISSN 1046-8188. URL https://doi.org/10.1145/3445029. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Cataldo Musto, Fedelucio Narducci, Marco Polignano, Marco De Gemmis, Pasquale Lops, and Giovanni Semeraro. Myrrorbot: A digital assistant based on holistic user models for personalized access to online services. ACM Trans. Inf. Syst., 39(4), August 2021. ISSN 1046-8188. URL https://doi.org/10.1145/3447679. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Alexandros Papangelis, Karthik Gopalakrishnan, Aishwarya Padmakumar, Seokhwan Kim, Gokhan Tur, and Dilek Hakkani-Tur. Generative conversational networks. In Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 111--120, July 2021. URL https://aclanthology.org/2021.sigdial-1.12.Google ScholarGoogle Scholar
  19. Gustavo Penha and Claudia Hauff. On the calibration and uncertainty of neural learning to rank models for conversational search. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 160--170, April 2021. URL https://aclanthology.org/2021.eacl-main.12. Google ScholarGoogle ScholarCross RefCross Ref
  20. Soumajit Pramanik, Jesujoba Alabi, Rishiraj Saha Roy, and Gerhard Weikum. UNIQORN: unified question answering over RDF knowledge graphs and natural language text. CoRR, abs/2108.08614, 2021. URL https://arxiv.org/abs/2108.08614.Google ScholarGoogle Scholar
  21. Abhilasha Ravichander, Siddharth Dalmia, Maria Ryskina, Florian Metze, Eduard H. Hovy, and Alan W. Black. Noiseqa: Challenge set evaluation for user-centric question answering. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, EACL 2021, Online, April 19 - 23, 2021, pages 2976--2992, 2021. URL https://aclanthology.org/2021.eacl-main.259/.Google ScholarGoogle ScholarCross RefCross Ref
  22. Julian Risch, Timo Möller, Julian Gutsch, and Malte Pietsch. Semantic answer similarity for evaluating question answering models. In Proceedings of the 3rd Workshop on Machine Reading for Question Answering, pages 149--157, November 2021. URL https://aclanthology.org/2021.mrqa-1.15.Google ScholarGoogle ScholarCross RefCross Ref
  23. Alexandre Salle, Shervin Malmasi, Oleg Rokhlenko, and Eugene Agichtein. Studying the effectiveness of conversational search refinement through user simulation. In Proceedings of ECIR, pages 587--602, 2021.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Léon-Paul Schaub, Vojtech Hudecek, Daniel Stancl, Ondrej Dusek, and Patrick Paroubek. Defining and detecting inconsistent system behavior in task-oriented dialogues. In Actes de la 28e Conférence sur le Traitement Automatique des Langues Naturelles. Volume 1 : conférence principale, pages 142--152, 6 2021. URL https://aclanthology.org/2021.jeptalnrecital-taln.13.Google ScholarGoogle Scholar
  25. Weiwei Sun, Shuo Zhang, Krisztian Balog, Zhaochun Ren, Pengjie Ren, Zhumin Chen, and Maarten de Rijke. Simulating user satisfaction for the evaluation of task-oriented dialogue systems. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '21, page 2499--2506, 2021. ISBN 9781450380379. URL https://doi.org/10.1145/3404835.3463241. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Ghazaleh H. Torbati, Andrew Yates, and Gerhard Weikum. You get what you chat: Using conversations to personalize search-based recommendations. In Advances in Information Retrieval, pages 207--223, 2021. ISBN 978-3-030-72113-8.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Svitlana Vakulenko, Shayne Longpre, Zhucheng Tu, and Raviteja Anantha. Question rewriting for conversational question answering. In WSDM '21, The Fourteenth ACM International Conference on Web Search and Data Mining, Virtual Event, Israel, March 8--12, 2021, pages 355--363, 2021. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Sergey Volokhin, Joyce Ho, Oleg Rokhlenko, and Eugene Agichtein. You sound like someone who watches drama movies: Towards predicting movie preferences from conversational interactions. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 3091--3096, June 2021. URL https://aclanthology.org/2021.naacl-main.246. Google ScholarGoogle ScholarCross RefCross Ref
  29. Atsuki Yamaguchi, Kosui Iwasa, and Katsuhide Fujita. Dialogue act-based breakdown detection in negotiation dialogues. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 745--757, April 2021. URL https://aclanthology.org/2021.eacl-main.63. Google ScholarGoogle ScholarCross RefCross Ref
  30. Diyi Yang and Lucie Flek. Towards user-centric text-to-text generation: A survey. In Text, Speech, and Dialogue - 24th International Conference, TSD 2021, Olomouc, Czech Republic, September 6--9, 2021, Proceedings, volume 12848 of Lecture Notes in Computer Science, pages 3--22, 2021. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Report on the 6th workshop on search-oriented conversational AI (SCAI 2021)
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM SIGIR Forum
      ACM SIGIR Forum  Volume 55, Issue 2
      December 2021
      247 pages
      ISSN:0163-5840
      DOI:10.1145/3527546
      Issue’s Table of Contents

      Copyright © 2022 Copyright is held by the owner/author(s)

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 17 March 2022

      Check for updates

      Qualifiers

      • research-article
    • Article Metrics

      • Downloads (Last 12 months)25
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader