Localization Service Using Sparse Visual Information Based on Recent Augmented Reality Platforms

The ability to localize precisely within a known space, would allow many use cases on the context of Location-based augmented reality. We propose a localization service based on sparse visual information using ARCore, a state-of-the-art augmented reality platform for mobile devices. Our service is constituted by two components: front-end and back-end. On the front-end, using the point cloud generated by ARCore as feature points, the corresponding binary keypoint descriptor algorithm like ORB or FREAK is computed to describe the place. On the back-end, this binary descriptor is searched in a map using the bags of binary words technique, responding with the position of the recognized place.

Online Demo Video: https://youtu.be/4gG3JjAgRFM