Be the first to like this
Here is an overview of how to use open-source libraries and existing Google codelabs to synthesize augmented reality and artificial intelligence into a single application. The app performs object detection to guess a 2D bounding box around a detected object. The center of the box is provided to a hit test that, if successful, will be used as the coordinate to place a 3D model in the AR environment at that location.
The technologies involved are native Android in Java, Tensorflow Lite, Sceneform AR library, Bazel build, Gradle build, and contains extra instructions for Windows users.
Besides just wiring up the libraries to work together, there are other pitfalls and gotchas that must be considered, and those are touched upon near the end of the deck.
YouTube video from 1 Feb. 2019: TBD
GitHub repo of final project: TBD