Hyoshin Park
ABSTRACT
We introduce temporal multimodal multivariate learning, a new family of decision making models that can indirectly learn and transfer online information from simultaneous observations of a probability distribution with more than one peak or more than one outcome variable from one time stage to another. We approximate the posterior by sequentially removing additional uncertainties across different variables and time, based on data-physics driven correlation, to address a broader class of challenging time-dependent decision-making problems under uncertainty. Extensive experiments on real-world datasets ( i.e., urban traffic data and hurricane ensemble forecasting data) demonstrate the superior performance of the proposed targeted decision-making over the state-of-the-art baseline prediction methods across various settings.
- Irwan Bello, Hieu Pham, Quoc V. Le, Mohammad Norouzi, and Samy Bengio. 2017. Neural Combinatorial Optimization with Reinforcement Learning. In 5th International Conference on Learning Representations (ICLR 2017).Google Scholar
- M. Ben-Akiva, D. McFadden, and T. et al. Gärling. 1999. Extended Framework for Modeling Choice Behavior. Marketing Letters 10 (1999), 187--203.Google ScholarCross Ref
- Yoshua Bengio, Andrea Lodi, and Antoine Prouvost. 2021. Machine learning for combinatorial optimization: A methodological tour d'horizon. European Journal of Operational Research 290, 2 (2021), 405--421.Google ScholarCross Ref
- Joseph J Cione, George H Bryan, Ronald Dobosy, Jun A Zhang, Gijs de Boer, Altug Aksoy, Joshua B Wadler, Evan A Kalina, Brittany A Dahl, Kelly Ryan, et al. 2020. Eye of the storm: observing hurricanes with a small unmanned aircraft system. Bulletin of the American Meteorological Society 101, 2 (2020).Google Scholar
- Joseph J Cione, EA Kalina, EW Uhlhorn, AM Farber, and B Damiano. 2016. Coyote unmanned aircraft system observations in Hurricane Edouard (2014). Earth and Space Science 3, 9 (2016), 370--380.Google ScholarCross Ref
- Rutger Claes, Tom Holvoet, and Danny Weyns. 2011. A Decentralized Approach for Anticipatory Vehicle Routing Using Delegate Multiagent Systems. IEEE Transactions on Intelligent Transportation Systems 12, 2 (2011), 364--373.Google ScholarDigital Library
- Hanjun Dai, Elias B. Khalil, Yuyu Zhang, Bistra Dilkina, and Le Song. 2017. Learning Combinatorial Optimization Algorithms over Graphs. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 6351--6361.Google ScholarDigital Library
- Justice Darko, Larkin Folsom, Niharika Deshpande, and Hyoshin Park. 2021. Distributed Constraint Optimization Problem for Coordinated Response of Unmanned Aerial Vehicles and Ground Vehicles. In 2021 55th Annual Conference on Information Sciences and Systems (CISS). IEEE, 1--6.Google Scholar
- Justice Darko, Larkin Folsom, Hyoshin Park, Masashi Minamide, Masahiro Ono, and Hui Su. 2022. A Sampling-Based Path Planning Algorithm for Improving Observations in Tropical Cyclones. Earth and Space Science 9, 1 (2022), e2020EA001498. https://doi.org/10.1029/2020EA001498Google Scholar
- Justice Darko, Larkin Folsom, Nigel Pugh, Hyoshin Park, Khadijeh Shirzad, Justin Owens, and Andrew Miller. 2022. Adaptive personalized routing for vulnerable road users. IET Intelligent Transport Systems (2022).Google Scholar
- Mithun Das Gupta, Srinidhi Srinivasa, J. Madhukara, and Meryl Antony. 2015. KL Divergence based Agglomerative Clustering for Automated Vitiligo Grading. In IEEE Computer Vision and Pattern Recognition.Google Scholar
- Xuan Di, Henry X. Liu, and Xuegang Jeff Ban. 2016. Second best toll pricing within the framework of bounded rationality. Transportation Research Part B: Methodological 83 (2016), 74--90. https://doi.org/10.1016/j.trb.2015.11.002Google ScholarCross Ref
- Larkin Folsom. 2021. Information-Theoretic Dynamic Decision Making of Multiple Agents Under Extreme Uncertain Conditions, Dissertation, Computational Data Science and Engineering, North Carolina A and T State University. https://www.proquest.com/openview/b141c77418b28498481750a282235211/1?pq-origsite=gscholar&cbl=18750&diss=yGoogle Scholar
- Larkin Folsom, Masahiro Ono, Kyohei Otsu, and Hyoshin Park. 2021. Scalable Information-Theoretic Path Planning for a Rover-Helicopter Team in Uncertain Environments, 18(2): 1--16. International Journal of Advanced Robotic Systems (2021).Google Scholar
- ]folsomdynamic Larkin Folsom, Hyoshin Park, and Venktesh Pandey. n. d. Dynamic Routing of Heterogeneous Users After Traffic Disruptions under a Mixed Information Framework. Frontiers in Future Transportation (n.d.), 11.Google Scholar
- Jason Gauci, Edoardo Conti, Yitao Liang, Kittipat Virochsiri, Yuchen He, Zachary Kaden, Vivek Narayanan, Xiaohui Ye, Zhengxing Chen, and Scott Fujimoto. 2019. Horizon: Facebook's Open Source Applied Reinforcement Learning Platform. In Workshop in the 36 th International Conference on Machine Learning (ICML), Long Beach, California, USA.Google Scholar
- Michel Gendreau, Gianpaolo Ghiani, and Emanuela Guerriero. 2015. Timedependent routing problems: A review. Computers & operations research 64 (2015), 189--197.Google Scholar
- Feng Guo, Hesham Rakha, and Sangjun Park. 2010. Multistate Model for Travel Time Reliability. Transportation Research Record 2188, 1 (2010), 46--54.Google ScholarCross Ref
- Xiaolei Guo. 2013. Toll sequence operation to realize target flow pattern under bounded rationality. Transportation Research Part B: Methodological 56 (2013), 203--216. http://www.sciencedirect.com/science/article/pii/S0191261513001422Google ScholarCross Ref
- Ke Han, Wai Yuen Szeto, and Terry L. Friesz. 2015. Formulation, existence, and computation of boundedly rational dynamic user equilibrium with fixed or endogenous user tolerance. Transportation Research Part B: Methodological 79 (2015), 16--49. https://doi.org/10.1016/j.trb.2015.05.002Google ScholarCross Ref
- Qi Han and Harry Timmermans. 2006. Interactive Learning in Transportation Networks with Uncertainty, Bounded Rationality, and Strategic Choice Behavior: Quantal Response Model. Transportation Research Record: Journal of the Transportation Research Board 1964 (2006), 27--34.Google ScholarCross Ref
- Solomon Kullback and Richard A. Leibler. 1951. On Information and Sufficiency. The Annals of Mathematical Statistics 22, 1 (1951), 79--86.Google ScholarCross Ref
- Jane Macfarlane. 2019. When Apps Rule the Road: Your Navigation App Is Making Traffic Unmanageable. IEEE Spectrum (2019).Google Scholar
- Niharika Mahajan, Andreas Hegyi, Serge P. Hoogendoorn, and Bart van Arem. 2019. Design analysis of a decentralized equilibrium-routing strategy for intelligent vehicles. Transportation Research Part C: Emerging Technologies 103 (2019), 308--327. https://doi.org/10.1016/j.trc.2019.03.028Google ScholarCross Ref
- Masashi Minamide, Fuqing Zhang, and Eugene E. Clothiaux. 2020. Nonlinear Forecast Error Growth of Rapidly Intensifying Hurricane Harvey (2017) Examined through Convection-Permitting Ensemble Assimilation of GOES-16 All-Sky Radiances. Journal of the Atmospheric Sciences 77, 12 (2020), 4277 -- 4296.Google ScholarCross Ref
- Masahiro Ono, Brandon Rothrock, Kyohei Otsu, Shoya Higa, Yumi Iwashita, Annie Didier, Tanvir Islam, Christopher Laporte, Vivian Sun, Kathryn Stack, Jacek Sawoniewicz, Shreyansh Daftry, Virisha Timmaraju, Sami Sahnoune, Chris A. Mattmann, Olivier Lamarre, Sourish Ghosh, Dicong Qiu, Shunichiro Nomura, Hemanth Sarabu, Gabrielle Hedrick, Larkin Folsom, Sean Suehr, and Hyoshin Park. 2020. MAARS: Machine learning-based Analytics for Rover Systems. In IEEE Aerospace Conference.Google ScholarCross Ref
- Byung-Jung Park, Yunlong Zhang, and Dominique Lord. 2010. Bayesian mixture modeling approach to account for heterogeneity in speed data. Transportation Research Part B: Methodological 44, 5 (2010), 662--673.Google ScholarCross Ref
- Hyoshin Park and Ali Haghani. 2015. Optimal Number and Location of Bluetooth Sensors Considering Stochastic Travel Time Prediction. Transportation Research Part C: Emerging Technologies 55 (2015), 203--216.Google ScholarCross Ref
- Hyoshin Park and Ali Haghani. 2016. Real-time prediction of secondary incident occurrences using vehicle probe data. Transportation Research Part C: Emerging Technologies 70 (2016), 69 -- 85.Google ScholarCross Ref
- H. Park and A. Haghani. 2016. Stochastic Capacity Adjustment Considering Secondary Incidents. IEEE Transactions on Intelligent Transportation Systems 17, 10 (2016), 2843--2853.Google ScholarDigital Library
- Hyoshin Park, Ali Haghani, Siby Samuel, and Michael A. Knodler. 2018. Realtime prediction and avoidance of secondary crashes under unexpected traffic congestion. Accident Analysis & Prevention 112 (2018), 39--49.Google ScholarCross Ref
- Hyoshin Park, Ali Haghani, and Xin Zhang. 2016. Interpretation of Bayesian neural networks for predicting the duration of detected incidents. Journal of Intelligent Transportation Systems 20, 4 (2016), 385--400.Google ScholarCross Ref
- Jonathan Poterjoy and Fuqing Zhang. 2011. Dynamics and structure of forecast error covariance in the core of a developing hurricane. Journal of the atmospheric sciences 68, 8 (2011), 1586--1606.Google ScholarCross Ref
- Claude Elwood Shannon and Warren Weaver. 1949. The Mathematical Theory of Communication. Urbana, The University of Illinois Press. 1--117 pages.Google Scholar
- M. Sutoh, M. Otsuki, S. Wakabayashi, T. Hoshino, and T. Hashimoto. 2015. The Right Path: Comprehensive Path Planning for Lunar Exploration Rovers. IEEE Robotics Automation Magazine 22, 1 (March 2015), 22--33.Google ScholarCross Ref
- Paul Tompkins, Anthony Stentz, and David Wettergreen. 2006. Mission-level path planning and re-planning for rover exploration. Robotics and Autonomous Systems 54 (2006), 174--183.Google ScholarCross Ref
- Chris S.Wallace and David L. Dowe. 1997. MML mixture modelling of multi-state, Poisson, von Mises circular and Gaussian distributions. (1997).Google Scholar
- DavidWettergreen, Paul Tompkins, Chris Urmson, MichaelWagner, and William Whittaker. 2005. Sun-Synchronous Robotic Exploration: Technical Description and Field Experimentation. The International Journal of Robotics Research 24, 1 (2005), 3--30.Google ScholarCross Ref
- Fangfang Zheng and Henk Van Zuylen. 2010. Uncertainty and Predictability of Urban Link Travel Time: Delay Distribution--Based Analysis. Transportation Research Record 2192, 1 (2010), 136--146.Google ScholarCross Ref
Index Terms
- Temporal Multimodal Multivariate Learning
Recommendations
Learning Multimodal Attention LSTM Networks for Video Captioning
MM '17: Proceedings of the 25th ACM international conference on MultimediaAutomatic generation of video caption is a challenging task as video is an information-intensive media with complex variations. Most existing methods, either based on language templates or sequence learning, have treated video as a flat data sequence ...
Learning Joint Multimodal Representation with Adversarial Attention Networks
MM '18: Proceedings of the 26th ACM international conference on MultimediaRecently, learning a joint representation for the multimodal data (e.g., containing both visual content and text description) has attracted extensive research interests. Usually, the features of different modalities are correlational and compositive, ...
Learning Joint Embedding with Multimodal Cues for Cross-Modal Video-Text Retrieval
ICMR '18: Proceedings of the 2018 ACM on International Conference on Multimedia RetrievalConstructing a joint representation invariant across different modalities (e.g., video, language) is of significant importance in many multimedia applications. While there are a number of recent successes in developing effective image-text retrieval ...
Comments