#MixedRealities：Experience with Spark AR

Augmented Reality (AR) has developed rapidly in recent years, bringing revolutionary changes in many fields such as artificial intelligence, CAD, graphics simulation, virtual communication, remote sensing, simulation training, etc. In addition to AR games, the most widely used and mature AR technology is video AR filter.

After downloading Spark AR Studio, we are ready to start a new project into its main interface. Like most design software interface structure, the top menu bar is the entry point for some insert class operations and global operations. The left is the layer list, the middle is the main editing stage, and the right is the layer's various property Settings. One of the most significant differences between the right of the editing stage can have a real-time preview window. The preview window will be looping like take real-time video convenient for you to check the filter effect. Of course, you can also switch to a computer front-facing camera or download a Spark in the mobile phone Player in equipment real-time preview real filter effects.

The imported eyewear model will appear in Assets. Next, we can drag and drop it to add the layer list, and the eyewear model will also appear on the stage.

But here we have a problem. The glasses are disconnected from the person's face in the video, and they don't move with the person's head. To solve this problem, we essentially need to identify the character's face through video or shot picture information, then track the face's movements in real-time, and convert these movements information into the displacement and rotation of the 3D model on the XYZ axis. The biggest advantage of Spark AR Studio is that it encapsulates these complex graphics recognition and tracking computations into a very simple way for designers to call, allowing us to focus more on the creative production of filters.