Shize Xu
ABSTRACT
Summarization methods such as timelines have greatly helped people to understand all kinds of news events within limited time. However, there are few studies probing into cross-media summarization, for example, generating timelines which contain both texts and images that can reinforce each other. In this paper, we tackle this important and challenging problem by proposing a novel solution. Specifically, we first reveal three requisite characteristics of an ideal image-text timeline. With the idea of recommendation, all these requisites will be modeled respectively, and fused compactly in a unified cross-media framework. Finally, we put all sentences and images into either the schema of referrer or the schema of recommended candidate, and the former recommends the latter. After changing their roles iteratively, we can achieve the optimal timelines which will significantly improve user experience and satisfaction. Experiments on real-world datasets show that the timelines generated by our framework outperform several competitive baselines.
- R. Agrawal, S. Gollapudi, A. Kannan, and K. Kenthapadi. Enriching textbooks with images. In Proceedings of the 20th ACM CIKM, pages 1847--1856, 2011. Google Scholar
Digital Library
- R. Aliguliyev. A new sentence similarity measure and sentence based extractive technique for automatic text summarization. Expert Systems with Applications, pages 7764--7772, 2009. Google ScholarDigital Library
- D. Cai, S. Yu, J. Wen, and W. Ma. Vips: a visionbased page segmentation algorithm. Technical report, Microsoft Technical Report, MSR-TR-2003--79, 2003.Google Scholar
- M. Chandra, V. Gupta, and S. Paul. A statistical approach for automatic text summarization by extraction. In Communication Systems and Network Technologies (CSNT), pages 268--271, 2011. Google ScholarDigital Library
- X. Chen, Y. Mu, S. Yan, and T. Chua. Efficient large-scale image annotation by probabilistic collaborative multi-label propagation. In Proceedings of the 18th ACM MM, pages 35--44, 2010. Google ScholarDigital Library
- Y. Chen, O. Jin, G.-R. Xue, J. Chen, and Q. Yang. Visual contextual advertising: Bringing textual advertisements to images. In Proceedings of the 24th AAAI Conference, AAAI, 2010.Google ScholarCross Ref
- K. R. M. R. B. David, E. V. Hatzivassiloglou, J. L. K. A. N. Carl, and S. B. S. S. Sigelman. Tracking and summarizing news on a daily basis with columbia's newsblaster. In Proceedings of HLT 2002, page 280, 2002. Google ScholarDigital Library
- M. Fattah and F. Ren. Ga, mr, ffnn, pnn and gmm based models for automatic text summarization. Computer Speech & Language, pages 126--144, 2009. Google ScholarDigital Library
- Y. Feng and M. Lapata. Topic models for image annotation and text illustration. In Human Language Technologies: The 2010 Annual Conference of the NAACL, pages 831--839, 2010. Google ScholarDigital Library
- T. Jiang and A. Tan. Discovering image-text associations for cross-media web information fusion. Knowledge Discovery in Databases: PKDD 2006, pages 561--568, 2006. Google ScholarDigital Library
- E. Kuiper, M. Volman, and J. Terwel. The web as an information resource in k--12 education: Strategies for supporting students in searching and processing information. Review of Educational Research, pages 285--328, 2005.Google Scholar
- X. Li, E. Gavves, C. Snoek, M. Worring, and A. Smeulders. Personalizing automated image annotation using cross-entropy. In Proceedings of the 19th ACM MM, pages 233--242, 2011. Google ScholarDigital Library
- C. Lin and E. Hovy. Automatic evaluation of summaries using n-gram co-occurrence statistics. In Proceedings of NAACL-HLT 2003, pages 71--78, 2003. Google ScholarDigital Library
- D. Lowe. Object recognition from local scale-invariant features. In Proceedings of the 7th IEEE ICCV, pages 1150--1157, 1999. Google ScholarDigital Library
- T. Mandl. Vague transformations in information retrieval. ISI, pages 312--325, 1998.Google Scholar
- R. Mihalcea and P. Tarau. A language independent algorithm for single and multiple document summarization. In Proceedings of IJCNLP, 2005.Google Scholar
- S. Panjwani, L. Micallef, K. Fenech, K. Toyama, et al. Effects of integrating digital visual materials with textbook scans in the classroom. International Journal of Education and Development using ICT, 2009.Google Scholar
- D. Radev, H. Jing, M. Stys, and D. Tam. Centroid-based summarization of multiple documents. Information Processing and Management, pages 919--938, 2004. Google ScholarDigital Library
- N. Rasiwasia, J. Costa Pereira, E. Coviello, G. Doyle, G. R. Lanckriet, R. Levy, and N. Vasconcelos. A new approach to cross-modal multimedia retrieval. In Proceedings of the 18th ACM MM, pages 251--260, 2010. Google ScholarDigital Library
- L. Tan, Y. Song, S. Liu, and L. Xie. Imagehive: Interactive content-aware image summarization. Computer Graphics and Applications, IEEE, pages 46--55, 2012. Google ScholarDigital Library
- X. Wan and J. Yang. Multi-document summarization using cluster-based link analysis. In Proceedings of the 31st international ACM SIGIR, pages 299--306, 2008. Google ScholarDigital Library
- J. Wang, L. Jia, and X. Hua. Interactive browsing via diversified visual summarization for image search results. Multimedia Systems, pages 379--391, 2011.Google Scholar
- Y. Wu, E. Y. Chang, K. C.-C. Chang, and J. R. Smith. Optimal multimodal fusion for multimedia data analysis. In Proceedings of the 12th ACM MM, pages 572--579, 2004. Google ScholarDigital Library
- R. Yan, L. Kong, C. Huang, X. Wan, X. Li, and Y. Zhang. Timeline generation through evolutionary trans-temporal summarization. In Proceedings of the Conference on EMNLP, pages 433--443, 2011. Google ScholarDigital Library
- R. Yan, X. Wan, M. Lapata, X. Zhao, P. Cheng, and X. Li. Visualizing timelines: Evolutionary summarization via iterative reinforcement between text and image streams. In Proceedings of the 21st ACM CIKM, pages 275--284, 2012. Google ScholarDigital Library
Index Terms
- A cross-media evolutionary timeline generation framework based on iterative recommendation
Recommendations
Timeline generation: tracking individuals on twitter
WWW '14: Proceedings of the 23rd international conference on World wide webIn this paper, we preliminarily learn the problem of reconstructing users' life history based on the their Twitter stream and proposed an unsupervised framework that create a chronological list for personal important events (PIE) of individuals. By ...
On Summarization and Timeline Generation for Evolutionary Tweet Streams
Short-text messages such as tweets are being created and shared at an unprecedented rate. Tweets, in their raw form, while being informative, can also be overwhelming. For both end-users and data analysts, it is a nightmare to plow through millions of ...
Topic category analysis on twitter via cross-media strategy
The growing popularity of social media provides a huge volume of social data including Tweets. These collections of social data can be potentially useful, but the extent of meaningful data in these collections has not been sufficiently researched, ...
Comments