Joey Hagedorn
Joshua Hailpern
ABSTRACT
Digital tools for annotation of video have the promise to provide immense value to researchers in disciplines ranging from psychology to ethnography to computer science. With traditional methods for annotation being cumbersome, time-consuming, and frustrating, technological solutions are situated to aid in video annotation by increasing reliability, repeatability, and workflow optimizations. Three notable limitations of existing video annotation tools are lack of support for the annotation workflow, poor representation of data on a timeline, and poor interaction techniques with video, data, and annotations. This paper details a set of design requirements intended to enhance video annotation. Our framework is grounded in existing literature, interviews with experienced coders, and ongoing discussions with researchers in multiple disciplines. Our model is demonstrated in a new system called VCode and VData. The benefit of our system is that is directly addresses the workflow and needs of both researchers and video coders.
- Annotations as multiple perspectives of video content, Juan-les-Pins, France, 2002. ACM.Google Scholar
- The Family Video Archive: an annotation and browsing environment for home movies, Berkeley, CA, 2003. ACM.Google Scholar
- Fluid interaction techniques for the control and annotation of digital video, Vancouver, Canada, 2003. ACM.Google Scholar
- A Coding Tool for Multimodal Analysis of Meeting Video, Montreal, Quebec, Canada, 2004. IEEE.Google Scholar
- Creating Multi-Modal, User-Centric Records of Meetings with the Carnegie Mellon Meeting Recorder Architecture, Montreal, Quebec, Canada, 2004. IEEE.Google Scholar
- Work-in-progress: VACA: a tool for qualitative video analysis, Montreal, Quebec, Canada, 2006. ACM.Google Scholar
- K. J. Berry and P. W. Mielke. A generalization of cohen's kappa agreement measure to interval measurement and multiple raters, 1988.Google Scholar
- M. Bertini, A. Del Bimbo, R. Cucchiara, and A. Prati. Applications ii: Semantic video adaptation based on automatic annotation of sport videos. In Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval MIR, 2004. Google ScholarDigital Library
- S.-C. Chen, M.-L. Shyu, W. Liao, and C. Zhang. Scene change detection by audio and video clues. www.cs.fiu.edu/~chens/PDF/ICME02_Video.pdf.Google Scholar
- J. Clifford and G. Marcus, editors. Writing Culture. University of California Press, Berkeley, California, 1986.Google Scholar
- A. J. Conger. Kappa reliabilities for continuous behaviors and events, 1985.Google Scholar
- S. B. Group. Studiocode business group - supplier of studiocode and stream video analysis and distribution software. http://www.studiocodegroup.com, 2007.Google Scholar
- A. Johnson. About vprism video data analysis software. http://www.camse.org/andy/VP/vprism.htm, 2007.Google Scholar
- M. Kipp. Anvil - the video annotation research tool. http://www.anvil-software.de, 2007.Google Scholar
- B. J. Leadholm and J. F. Miller. Language Sample Analysis: The Wisconsin Guide. Wisconsin Department of Public Instruction, Madison, Wisconsin, 1995.Google Scholar
- L. Lee. Developmental Sentence Analysis. Northwestern University Press, Evanston, IL, 1974.Google Scholar
- S. S. LLC. Salt software. http://www.saltsoftware.com, 2007.Google Scholar
- Noldus. The observer. http://www.noldus.com/site/doc200401012, 2007.Google Scholar
- D. Ponceleon and S. Srinivasan. Automatic discovery of salient segments in imperfect speech transcripts. In CIKM '01: Proceedings of the tenth international conference on Information and knowledge management, pages 490--497, New York, NY, USA, 2001. ACM. Google ScholarDigital Library
- K. S. Retherford. Guide to Analysis of Language Transcripts. Thinking Publications, Eau Claire, Wisconsin, 1993.Google Scholar
- K. L. Rosenblum, C. Zeanah, S. McDonough, and M. Muzik. Video-taped coding of working model of the child interviews: a viable and useful alternative to verbatim transcripts?, 2004.Google Scholar
- S. Soft. Annotation. http://www.saysosoft.com/, 2006.Google Scholar
Index Terms
- VCode and VData: illustrating a new framework for supporting the video annotation workflow
Recommendations
Comparison of Methods to Annotate Named Entity Corpora
The authors compared two methods for annotating a corpus for the named entity (NE) recognition task using non-expert annotators: (i) revising the results of an existing NE recognizer and (ii) manually annotating the NEs completely. The annotation time, ...
Towards annotation of video as part of search
MMM'10: Proceedings of the 16th international conference on Advances in Multimedia ModelingSearch for multimedia is hampered by both the lack of quality annotations and a quantity of annotations. In recent years there has been a growth in multimedia search services that emphasis interactivity between the user and the interface. Some of these ...
CASAM: collaborative human-machine annotation of multimedia
The CASAM multimedia annotation system implements a model of cooperative annotation between a human annotator and automated components. The aim is that they work asynchronously but together. The system focuses upon the areas where automated recognition ...
Comments