Anand Sukumaran Nair

Startup Founder, Software Engineer, Abstract thinker
Co-founder & CTO @ Engagespot (Techstars NYC '24)

Implementing Natural Feature Tracking (NFT) in JavaScript

As part of our research in building Augmented Reality for web, I was researching about implementing natural feature tracking in Javascript. All the existing libraries out there supports only markers based implementation. But that won’t work for a good AR experience.

What we needed is a way to train an uploaded image, and then use it to detect it from a live video stream from camera.

We used the SIFT feature descriptor to extract the feature points from the uploaded image.

Here is a video of what was built - https://www.youtube.com/shorts/ZeB48blAsZo