Kaikai Liu
Abstract
Augmented reality (AR) aims to render the world that users see and overlay information that reflects the real physical dynamics. The digital view could be potentially projected near the Point-of-Interest (POI) in a way that makes the virtual view attached to the POI even when the camera moves. Achieving smooth support for movements is a subject of extensive studies. One of the key problems is where the augmented information should be added to the field of vision in real time. Existing solutions either leverage GPS location for rendering outdoor AR views (hundreds of kilometers away) or rely on image markers for small-scale presentation (only for the marker region). To realize AR applications under various scales and dynamics, we propose a suite of algorithms for fine-grained AR view tracking to improve the accuracy of attitude and displacement estimation, reduce the drift, eliminate the marker, and lower the computation cost. Instead of requiring extremely high, accurate, absolute locations, we propose multimodal solutions according to mobility levels without additional hardware requirement. Experimental results demonstrate significantly less error in projecting and tracking the AR view. These results are expected to make users excited to explore their surroundings with enriched content.
- Apple. 2014. CMAttitude Class Reference. https://developer.apple.com/library/ios/documentation/CoreMotion/Reference/CMAttitude_Class/Reference/Reference.html.Google Scholar
- Ronald Azuma, Yohan Baillot, Reinhold Behringer, Steven Feiner, Simon Julier, and Blair MacIntyre. 2001. Recent advances in augmented reality. Comput. Graph. Appl. 21, 6, 34--47. Google ScholarDigital Library
- BSD license. 2014. OpenCV. (2014). http://opencv.org.Google Scholar
- Manmohan Krishna Chandraker, Christoph Stock, and Axel Pinz. 2003. Real-Time Camera Pose in a Room. Springer.Google Scholar
- Bas des Bouvrie. 2011. Improving RGBD indoor mapping with IMU data. Ph.D., Dissertation, Masters thesis, Delft University of Technology.Google Scholar
- Friedrich Fraundorfer and Davide Scaramuzza. 2012. Visual odometry: Part II: Matching, robustness, optimization, and applications. IEEE Robotics & Automation Mag. 19, 2, 78--90.Google ScholarCross Ref
- Blippar Group. 2014. Layar. https://www.layar.com.Google Scholar
- Richard Hartley and Andrew Zisserman. 2003. Multiple View Geometry in Computer Vision. Cambridge University Press. Google ScholarDigital Library
- J. D. Hol. 2011. Sensor fusion and calibration of inertial sensors, vision, Ultra-Wideband and GPS. Linköping Studies in Science and Technology. Dissertations 1368.Google Scholar
- Myung Hwangbo, Jun-Sik Kim, and Takeo Kanade. 2009. Inertial-aided KLT feature tracking for a moving camera. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2009). IEEE, 1909--1916. Google ScholarDigital Library
- Hirokazu Kato. 2002. ARToolKit: Library for vision-based augmented reality. Technical Report, IEICE PRMU, 101 (652), 79--86.Google Scholar
- Bernd Kitt, Andreas Geiger, and Henning Lategahn. 2010. Visual odometry based on stereo image sequences with ransac-based outlier rejection scheme. In Proceedings of the Intelligent Vehicles Symposium (IV). IEEE, 486--492.Google ScholarCross Ref
- Tobias Langlotz, Claus Degendorfer, Alessandro Mulloni, Gerhard Schall, Gerhard Reitmayr, and Dieter Schmalstieg. 2011. Robust detection and tracking of annotations for outdoor augmented reality browsing. Comput. Graph. 35, 4, 831--840. Google ScholarDigital Library
- Patrick Lazik and Anthony Rowe. 2012. Indoor pseudo-ranging of mobile devices using ultrasonic chirps. In Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems. ACM, 99--112. Google ScholarDigital Library
- Hongbo Liu, Yu Gan, Jie Yang, Simon Sidhom, Yan Wang, Yingying Chen, and Fan Ye. 2012. Push the limit of WiFi based localization for smartphones. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking. ACM, 305--316. Google ScholarDigital Library
- Kaikai Liu, Xinxin Liu, and Xiaolin Li. 2013. Guoguo: Enabling fine-grained indoor localization via smartphone. In Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 235--248. Google ScholarDigital Library
- Justin Gregory Manweiler, Puneet Jain, and Romit Roy Choudhury. 2012. Satellites in our pockets: An object positioning system using smartphones. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services. ACM, 211--224. Google ScholarDigital Library
- F. Landis Markley and John L. Crassidis. 2014. Fundamentals of Spacecraft Attitude Determination and Control. Springer.Google Scholar
- Lorenz Meier, Petri Tanskanen, Lionel Heng, Gim Hee Lee, Friedrich Fraundorfer, and Marc Pollefeys. 2012. PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision. Autonom. Robots 33, 1--2, 21--39. Google ScholarDigital Library
- Mixare. 2011. mix Augmented Reality Engine. http://www.mixare.org.Google Scholar
- Alessandro Mulloni, Daniel Wagner, Istvan Barakonyi, and Dieter Schmalstieg. 2009. Indoor positioning and navigation with camera phones. Pervas. Comput. 8, 2, 22--31. Google ScholarDigital Library
- R. Nandakumar, K. K. Chintalapudi, and V. N. Padmanabhan. 2012. Centaur: locating devices in an office environment. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking. ACM, 281--292. Google ScholarDigital Library
- Rob Napier and Mugunth Kumar. 2014. iOS 7 Programming Pushing the Limits. Wiley.Google Scholar
- Joseph Newman, David Ingram, and Andy Hopper. 2001. Augmented reality in a wide area sentient environment. In Proceedings. IEEE and ACM International Symposium on Augmented Reality, 2001. IEEE, 77--86. Google ScholarDigital Library
- William Russell Pensyl, Daniel Keith Jernigan, Tran Cong Thien Qui, Hsin Pei Fang, and Lee Shang Ping. 2008. Large area robust hybrid tracking with life-size avatar in mixed reality environment: For cultural and historical installation. In Proceedings of the 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry. ACM, 9. Google ScholarDigital Library
- Qualcomm. 2015. Vuforia. https://www.qualcomm.com/products/vuforia.Google Scholar
- Pavel Rajmic. 2005. Method for real-time signal processing via wavelet transform. Nonlin. Anal. Algor. Speech Process. 368--378. Google ScholarDigital Library
- Miguel Ribo, Markus Brandner, and Axel Pinz. 2004. A flexible software architecture for hybrid tracking. J. Robot. Syst. 21, 2, 53--62. Google ScholarDigital Library
- Ethan Rublee, Vincent Rabaud, Kurt Konolige, and Gary Bradski. 2011. ORB: An efficient alternative to SIFT or SURF. In Proceedings of the IEEE International Conference on Computer Vision (ICCV). IEEE, 2564--2571. Google ScholarDigital Library
- Guobin Shen, Zhuo Chen, Peichao Zhang, Thomas Moscibroda, and Yongguang Zhang. 2013. Walkie-markie: Indoor pathway mapping made easy. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation. USENIX Association, 85--98. Google ScholarDigital Library
- D. W. F. Van Krevelen and R. Poelman. 2010. A survey of augmented reality technologies, applications and limitations. Int. J. Virt. Real. 9, 2, 1.Google ScholarCross Ref
- Daniel Wagner, Gerhard Reitmayr, Alessandro Mulloni, Tom Drummond, and Dieter Schmalstieg. 2010. Real-time detection and tracking for augmented reality on mobile phones. IEEE Trans. Visual. Comput. Graph. 16, 3, 355--368. Google ScholarDigital Library
- He Wang, Souvik Sen, Ahmed Elgohary, Moustafa Farid, Moustafa Youssef, and Romit Roy Choudhury. 2012. No need to war-drive: Unsupervised indoor localization. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services. ACM, 197--210. Google ScholarDigital Library
- Zac White. 2012. iPhone-AR-Toolkit. https://github.com/nielswh/iPhone-AR-Toolkit.Google Scholar
- Roni Yadlin. 2009. Attitude determination and bias estimation using kalman filtering. US Air Force Academy Report.Google Scholar
- Zheng Yang, Chenshu Wu, and Yunhao Liu. 2012. Locating in fingerprint space: Wireless indoor localization with little human intervention. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking. ACM, 269--280. Google ScholarDigital Library
- Pengfei Zhou, Mo Li, and Guobin Shen. 2014. Use it free: Instantly knowing your phone attitude. In Proceedings of ACM MobiCom 2014. Google ScholarDigital Library
Index Terms
- Enabling Context-Aware Indoor Augmented Reality via Smartphone Sensing and Vision Tracking
Recommendations
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System
IWAR '99: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented RealityWe describe an augmented reality conferencing system which uses the overlay of virtual images on the real world. Remote collaborators are represented on Virtual Monitors which can be freely positioned about a user in space. Users can collaboratively ...
Calibration-Free Augmented Reality in Perspective
This paper deals with video-based augmented reality and proposes an algorithm for augmenting a real video sequence with views of graphics objects without metric calibration of the video camera by representing the motion of the video camera in projective ...
An Extended Marker-Based Tracking System for Augmented Reality
WMSVM '10: Proceedings of the 2010 Second International Conference on Modeling, Simulation and Visualization MethodsFiducial marker systems consist of unique patterns mounted in the environment and computer vision algorithms that help automatically find features in digital camera images. They are useful for Augmented Reality (AR), robot navigation, 3D modeling, and ...
Comments