Serenity Parlour
Beauty Industry
Industry
AR/VR
Client
Serenity Parlour
Tools used
Unity, AR Foundation, Face Mesh, Blendshapes, C#
Services
AR Development
Serenity Parlor, an innovative beauty and wellness brand, approached us to solve a unique challenge: they wanted to deliver a captivating AR/VR experience that enabled users to virtually try on face paintings with highly accurate face tracking and natural alignment, but their existing solutions lacked seamless facial integration and intuitive user experience. This outlines a technical project utilizing Unity (a popular game engine) to create an advanced face-tracking augmented reality application—leveraging AR Foundation to ensure streamlined development and reliable performance across multiple platforms.
The system uses the device’s front camera to continuously detect and track the user’s face as they move. This is powered by AR Foundation, which provides a unified interface for ARKit/ARCore, enabling robust facial tracking across both major mobile platforms.
As the user’s face is tracked, the system creates a 3D face mesh that accurately matches the user’s facial geometry. This mesh is a digital representation of the face, including contours and features, updated in real time.
As the user’s face is tracked, the system creates a 3D face mesh that accurately matches the user’s facial geometry. This mesh is a digital representation of the face, including contours and features, updated in real time.
The face mesh is animated using blendshapes (also called morph targets or shape keys). Blendshapes define how the mesh deforms to represent different facial expressions, such as smiles, frowns, or eyebrow raises. The system detects subtle facial movements and applies the corresponding blendshapes to the face mesh, enabling simulated expressions that mirror the user’s real face.
The project was specifically optimized for smooth performance on mobile devices, ensuring that the facial tracking, mesh generation, and animation updates happen quickly and reliably without draining battery life or causing lag.
The stack includes Unity (for building the app and rendering), AR Foundation (for cross-platform AR support), ARKit/ARCore (for device-specific facial tracking), Face Mesh (for 3D modeling of the face), Blendshapes (for expression animation), and C# (for scripting logic).
