Abstract

In this paper, we propose a novel system that is able to automatically detect and classify baseball highlights by seamlessly integrating image, audio, and speech clues using a unique framework based on maximum entropy model (MEM). What distinguishes our system is that we emphasize on the integration of multimedia features and the acquisition of domain knowledge through automatic machine learning processes. Our MEM-based framework provides a simple platform capable of integrating multimedia features as well as their contextual information in a uniform fashion. Unlike the Hidden Markov Model and the Bayes Network-based approaches, this framework does not need to explicitly segment and classify the input video into states during its data modeling process, and hence remarkably simplifies the training data creation and the highlight detection/classification tasks. Experimental evaluations demonstrate the superiority of our proposed baseball highlight detection system in its capability of detecting more major baseball highlights, and in its overall accuracy of detecting these major highlights.

Author Keywords: Baseball highlight detection; Event detection; Video content analysis; Machine learning; Maximum entropy method

Article Outline

1. Introduction

2. Related works

3. Characteristics of baseball videos

4. System overview

5. Highlight detection based on Maximum Entropy Model

6. Multimedia feature extraction

6.1. Image features

6.2. Special sound detection

6.3. Closed captions

6.4. Multimedia feature vector construction

7. Experiments

7.1. Performance evaluations

7.2. Performance comparisons

8. Summary

References