Vivek K. Singh
ABSTRACT
With the growth in social media, internet of things, and planetary-scale sensing there is an unprecedented need to assimilate spatio-temporally distributed multimedia streams into actionable information. Consequently the concepts like objects, scenes, and events, need to be extended to recognize situations (e.g. epidemics, traffic jams, seasons, flash mobs). This paper motivates and computationally grounds the problem of situation recognition. It describes a systematic approach for combining multimodal real-time big data into actionable situations. Specifically it presents a generic approach for modeling and recognizing situations. A set of generic building blocks and guidelines help the domain experts model their situations of interest. The created models can be tested, refined, and deployed into practice using a developed system (EventShop). Results of applying this approach to create multiple situation-aware applications by combining heterogeneous streams (e.g. Twitter, Google Insights, Satellite imagery, Census) are presented.
- Peter Diamandis, Coming Age of Abundance, TED Talk 2012.Google Scholar
- V.K. Singh, M. Gao, and R. Jain, Social Pixels: Genesis and Evaluation. In Proc. ACM Multimedia Conference, 2010. Google ScholarDigital Library
- M. Gao, V.K. Singh, and R. Jain, EventShop: From Heterogeneous Web Streams to Personalized Situation Detection and Control. In Proc. ACM Web Science Conference, 2012. Google ScholarDigital Library
- Endsley, M.R. (1988). Situation awareness global assessment technique (SAGAT). Proceedings of the National Aerospace and Electronics Conference (NAECON), 789--795. New York: IEEE.Google ScholarCross Ref
- Moray, N. (2004). Ou sont les neiges d'antan? ("Where are the snows of yesteryear?"). In D.A. Vincenzi, M. Mouloua & P.A. Hancock (Eds), Human performance, situation awareness and automation: Current research and trends (pp. 1--31)Google Scholar
- Adam, E.C. (1993). Fighter cockpits of the future. Proceedings of 12th IEEE/AIAA Digital Avionics Systems Conference (DASC), 318--323.Google ScholarCross Ref
- Jeannot, E., Kelly, C. & Thompson, D. (2003). The development of situation awareness measures in ATM systems. Brussels: Eurocontrol.Google Scholar
- J. McCarthy and P. Hayes (1969). Some philosophical problems from the standpoint of artificial intelligence. In B. Meltzer and D. Michie, editors, Machine Intelligence, 4:463--502. Edinburgh University Press, 1969.Google Scholar
- Stephen S. Yau and Junwei Liu, Hierarchical situation modeling and reasoning for pervasive computing, Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, 2006. Google ScholarDigital Library
- The Situation Underground, Barwise and John Perry,Stanford Working Papers in Semantics, vol. 1, Stanford Cognitive Science Group 1980.Google Scholar
- Dietrich, D. Kastner, W. Maly, T. Roesener, C. Russ, G. Schweinzer, H., Situation modeling, IEEE Workshop on Factory Communication Systems, 2004.Google Scholar
- Sarter, N. B. and Woods, D. D. (1991). Situation Awareness: A critical but ill-defined phenomenon. International Journal of Aviation Psychology, 1, 45--57.Google ScholarCross Ref
- Dominguez, C. (1994). Can SA be defined? In Situation Awareness: Papers and Annotated Bibliography (U). Armstrong Laboratory, Wright-Patterson AFB: OH.Google Scholar
- Smith, K., and Hancock, P. A. (1995). The risk space representation of commercial airspace. In Proc. International Symposium on Aviation Psychology, 1995.Google Scholar
- Dostal, B.C. (2007). Enhancing situational understanding through the employment of unmanned aerial vehicles. Interim Brigade Combat Team Newsletter, No. 01--18.Google Scholar
- V. K. Singh and R. Jain, Situation-based Control for Cyber Physical Environments, IEEE workshop on situation management, MILCOM, (IEEE SIMA), 2009 Google ScholarDigital Library
- Kaufman, Y. J., Justice, C. O., Flynn, L. P., Kendall, J. D., Prins, E. M., Giglio, L., et al. (1998). Potential global fire monitoring from EOSMODIS. Journal of Geophysical Research, {Atmospheres}, 103, 32215--32238.Google ScholarCross Ref
- Jakobson, G. Buford, J. Lewis, L., A Framework of Cognitive Situation Modeling and Recognition, Military Communications Conference, 2006. MILCOM 2006 Google ScholarDigital Library
- Gísli R. Hjaltason and Hanan Samet. 1998. Incremental distance join algorithms for spatial databases. In Proc. ACM SIGMOD Int. Conf. Management of Data (SIGMOD '98). Google ScholarDigital Library
- A trillion points of data, Barett Sheridan, Newsweek 2012.Google Scholar
- Steinberg, A.N., Bowman, C.L., and White, F.E., "Revisions to the JDL Data Fusion Model", in Sensor Fusion: Architectures, Algorithms, and Applications, Proceedings of the SPIE, Vol. 3719, 1999Google Scholar
- Oliver Brdiczka, Pong C. Yuen, Sofia Zaidenberg, Patrick Reignier, James L. Crowley, Automatic Acquisition of Context Models and its Application to Video Surveillance, International Conference on Pattern Recognition, 2006. Google ScholarDigital Library
- R. Cucchiara, A.Pratti, and R.Vezani, "An Intelligent Surveillance System for Dangerous Situation Detection in home Environments", in Intelligenza artificable, vol.1, n.1, 2004.Google Scholar
- J.D. Ullman, Principles of Database and Knowledge-base Systems, vol. 1, Computer Science Press, 1988. Google ScholarDigital Library
- Montanari, M., Mehrotra, S., and Venkatasubramanian, N. 2007. Architecture for an automatic customized warning system. In IEEE Intelligence and Security Informatics, 2007Google Scholar
- Singh, K.D., 1993, The 1990 tropical forest resource assessment, Unasyva/FAO, 44, 10--19.Google Scholar
- A. K. Dey. Providing Architectural Support for Building Context-Aware Applications, PhD thesis, College of Computing, Georgia Institute of Technology, 2000. Google ScholarDigital Library
- http://auge.ics.uci.edu/eventshopGoogle Scholar
- http://auge.ics.uci.edu/eventshop/videosGoogle Scholar
- Asaf Adi, Opher Etzion, Amit -- the situation manager, The VLDB Journal --- The International Journal on Very Large Data Bases, v.13 n.2, p.177--203, May 2004 Google ScholarDigital Library
- P. D. Costa, J. Almeida, L. Pires, and M. Sinderen. Situation specification and realization in rule-based context-aware applications. International conference on Distributed applications and interoperable systems, 2007. Google ScholarDigital Library
Index Terms
- Situation recognition: an evolving problem for heterogeneous dynamic big multimedia data
Recommendations
Ontology-based situation awareness
The notions of ''situation'' and ''situation awareness'' have been formulated by many authors in various contexts. In this paper, we present a formalization of situations that is compatible with the interpretation of situation awareness in terms of ...
From Sensory Data to Situation Awareness: Enhanced Context Spaces Theory Approach
DASC '11: Proceedings of the 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure ComputingHigh-level context awareness can be significantly improved by the recognition of real-life situations. The theory of context spaces is a context awareness approach that uses spatial metaphors to provide integrated mechanisms for both low-level and high-...
Understanding situation awareness in SOCs, a systematic literature review
AbstractSituation awareness is shown through human factors research to be a valuable construct to understand and improve how humans perform while operating complex systems in critical environments. Within cyber security one such environment is ...
Comments