skip to main content
10.1145/1386352.1386410acmconferencesArticle/Chapter ViewAbstractPublication PagescivrConference Proceedingsconference-collections
research-article

Supporting video library exploratory search: when storyboards are not enough

Published:07 July 2008Publication History

ABSTRACT

Storyboards, a grid layout of thumbnail images as surrogates representing video, have received much attention in video retrieval interfaces and published studies through the years, and work quite well as navigation aids and as facilitators for shot-based information retrieval. When the information need is tied less to shots and requires inspection of stories and across stories, other interfaces into the video data have been demonstrated to be quite useful. These interfaces include scatterplots for timelines, choropleth maps, dynamic query preview histograms, and named entity relation diagrams representing sets of hundreds or thousands of video stories. One challenge for interactive video search is to move beyond support for fact-finding and also address broader, longer term search activities of learning, analysis, synthesis, and discovery. Examples are shown for broadcast news and life oral histories, drawing from empirically collected data showing how such interfaces can promote improved exploratory search. This paper surveys and reflects on a body of Informedia interface work dealing with news, folding in for the first time an examination of exploratory transactions with an oral history corpus.

References

  1. Proc. ACM Int'l Workshop on TRECVID Video Summarization (Augsburg, Germany, in conjunction with ACM Multimedia, Sept. 28, 2007), ISBN: 978-1-59593-780-3.Google ScholarGoogle Scholar
  2. Ahlberg, C. and Shneiderman, B. Visual Information Seeking: Tight Coupling of Dynamic Query Filters with Starfield Displays. In Proc. ACM CHI (Boston, MA, April 1994), 313--322. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Christel, M., Hauptmann, A.G., Wactlar, H.D., and Ng, T.D. Collages as Dynamic Summaries for News Video. In Proc. ACM Multimedia (Juan-les-Pins, France, Dec. 2002), 561--569. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Christel, M., and Moraveji, N. Finding the Right Shots: Assessing Usability and Performance of a Digital Video Library Interface. In Proc. ACM Multimedia (New York, NY, Oct. 2004), 732--739. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Christel, M. Windowing Time in Digital Libraries. In Proc. ACM/IEEE Joint Conf. Digital Libraries (Chapel Hill, NC, June 2006), 190--191. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Christel, M., and Conescu, R. Mining Novice User Activity with TRECVID Interactive Retrieval Tasks. In LNCS 4071: Proc. Image and Video Retrieval (CIVR) (Tempe, AZ, July 2006), Springer, Berlin, 2006, 21--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Christel, M., and Yan, R. Merging Storyboard Strategies and Automatic Retrieval for Improving Interactive Video Search. In Proc. CIVR (Amsterdam, July 2007), 486--493. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Christel, M. Establishing the Utility of Non-Text Search for News Video Retrieval with Real World Users. In Proc. ACM Multimedia (Augsburg, Germany, Sept. 2007), 706--717. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Frøkjær, E., et al. Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In Proc. ACM CHI (The Hague, The Netherlands, April 2000), 345--352. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Gersh, J., Lewis, B., et al. Supporting Insight-Based Information Exploration in Intelligence Analysis. Comm. ACM 49(4), 2006, 63--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hauptmann, A., and Christel, M. Successful Approaches in the TREC Video Retrieval Evaluations. In Proc. ACM Multimedia (New York, NY, October 2004), 668--675. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hearst M.A. 1999. User Interfaces and Visualization. In Baeza-Yates R, Ribeiro-Neto, B (eds.), Modern Information Retrieval, Addison Wesley/ACM Press, New York.Google ScholarGoogle Scholar
  13. Hearst, M.A., et al. Finding the flow in web site search. Comm. ACM 45(9), 2002, 42--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hearst, M.A. Clustering vs. Faceted Categories for Information Exploration. Comm. ACM 49(4), 2006, 59--61. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Helft, M. YouTube's Traffic Continues to Snowball. NY Times (Jan. 17, 2008), bits.blogs.nytimes.com/2008/01/17/.Google ScholarGoogle Scholar
  16. Hughes, A., et al. Text or pictures? An eyetracking study of how people view digital video surrogates. In Proc. Conf. Image and Video Retrieval (CIVR) (Urbana-Champaign, IL, 2003), 271--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Kobsa A. An Empirical Comparison of Three Commercial Information Visualization Systems. In Proc. IEEE InfoVis (San Diego, CA, Oct. 2001), 123--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Marchionini, G., and Geisler, G. The Open Video Digital Library. D-Lib Magazine 8(12), Dec. 2002, www.dlib.org.Google ScholarGoogle Scholar
  19. Marchionini, G. Exploratory Search: From Finding to Understanding. Comm. ACM 49(4), 2006, 41--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Mills, M., et al. A Magnifier Tool for Video Data. In Proc. ACM CHI (Monterey, CA, May 1992), 93--98. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Naphade, M., et al. Large-Scale Concept Ontology for Multimedia. IEEE MultiMedia 13(3), 2006, 86--91. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Olsen, K.A., et al. Visualization of a Document Collection: The VIBE System. Info. Processing & Mgt 29 (1993), 69--81. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Plaisant, C. The Challenge of Information Visualization Evaluation. In Proc. ACM Advanced Visual Interfaces (Gallipoli, Italy, May 2004), 109--116. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Shneiderman, B. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Proc. IEEE Symposium on Visual Languages (Boulder, CO, Sept. 1996), 336--343. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Shneiderman, B., and Plaisant, C. Strategies for Evaluating Information Visualization Tools: Multi-dimensional In-depth Long-term Case Studies. In Proc. BELIV'06 Workshop, Advanced Visual Interfaces Conf. (Venice, May 2006), 1--7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Snoek, C., Worring, M., Koelma, D., and Smeulders, A. A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval. IEEE Trans. Multimedia 9(2), Feb. 2007, 280--292. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. White, R.W., et al. Supporting Exploratory Search, Introduction. Comm. ACM 49(4), 2006, 36--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Worring, M., Snoek, C., et al. Mediamill: Advanced Browsing in News Video Archives. In LNCS 4071: Proc. Image and Video Retrieval (CIVR) (Tempe, AZ, July 2006), Springer, Berlin, 2006, 533--536. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Supporting video library exploratory search: when storyboards are not enough

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval
          July 2008
          674 pages
          ISBN:9781605580708
          DOI:10.1145/1386352

          Copyright © 2008 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 7 July 2008

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader