Marker-based Augmented Reality using OpenCV.

An easy to understand code to create ArUco Marker-based Augmented Reality using OpenCV

Prerequisite:

Know what is Augmented Reality(AR), Virtual Reality(VR), and Mixed Reality(MR), the difference between Marker-based AR and Marker-less AR

Marker-based Augmented Reality

Marker-based Augmented Reality, also known as Image Recognition AR, uses an object or a fiducial marker as a reference to determine the position or orientation of the camera.

Maker-based AR works by scanning a marker like an ArUco marker. The ArUco marker detection triggers an augmented experience to position an object, text, video, or animation to appear on the device.

In this example, we will write a simple code to augment an image on a video stream with the help of ArUco markers.

ArUco Marker

ArUco stands for the Augmented Reality University of Cordoba, developed in 2014 by S.Garrido-Jurado et al., in their work “Automatic generation and detection of highly reliable fiducial markers under occlusion“.

The ArUco marker is a fiducial square marker used for camera pose estimation. When an ArUco marker is detected in the video, you can augment the digital content like an image on top of the detected markers.