Abstract
In this paper, we extend well-designed 3D face masks into AR face masks and demonstrate the possibility of transforming this into an NFT-copyrighted AR face mask that helps authenticate the ownership of the AR mask user so as to improve creative control, brand identification, and ID protection. The output of this project will not only potentially validate the value of the NFT technology but also explore how to combine the NFT technology with AR technology so as to be applied to e-commerce and e-business aspects of the multimedia industry.
Introduction
As digital transformation sweeps through the e-commerce sector, "self-media" hosts and influencers increasingly rely on unique digital avatars and Augmented Reality (AR) face masks to establish brand identity and protect their privacy. However, two major hurdles remain: the technical complexity of integrating sophisticated AR interfaces with robust authentication systems, and the rampant issue of copyright infringement. Digital assets like AR masks are trivial to copy and reuse without permission, creating a pressing need for a systematic way to authenticate ownership and provide creative control to original designers.
This research presents a practical workflow for developing AR face masks in Unity3D and securing their intellectual property through NFT-based copyrighting on the Ethereum blockchain. By bridging the gap between real-time facial tracking and decentralized ownership, we provide a blueprint for content creators to protect their digital identities in the burgeoning e-commerce landscape.
Methodology and Technical Pipeline
The project utilizes a multi-stage development pipeline designed to move from 3D mask design to a functional mobile application, finally "locking" the asset's value via the blockchain.
AR Development Environment
The system was developed using Unity3D (version 2022.x) paired with AR Foundation. This framework allows for a unified API that wraps around platform-specific SDKs like ARCore (Android) and ARKit (iOS), ensuring broader compatibility. The core logic relies on three steps: recognition, tracking, and mixing. Specifically, the AR Face Manager component in Unity handles the detection of the user’s face mesh in real-time.
Logic and UI Implementation
A custom C# script (swap.cs) was developed to manage a "Switchface" function. This allows users to toggle through different mask textures stored in an array within the application's APK. This modular approach ensures that multiple NFT-backed designs can be hosted within a single interface.
NFT Integration and Copyright Protection
To handle copyright and ownership verification, the research utilizes the Ethereum blockchain via the OpenSea platform. Rather than relying on traditional, slow copyright registration, we propose the blockchain’s "Proof of Work" and unique token IDs as a tamper-proof, real-time method for artists to prove authorship.
Mask textures are minted as NFTs, providing a unique token ID and a decentralized ledger entry that serves as a "serial number." This process involves defining properties, levels, and stats for the digital asset before finalizing the metadata on the blockchain. This creates a verified ownership pipeline that allows for the licensing and protection of AR assets.
Key Results and Insights
The research successfully produced a functional prototype deployed as an Android APK (tested on a Google Pixel 7). Key findings include:
- Performance: The AR Foundation integration proved capable of tracking eye and mouth movements smoothly, even during rapid head movement.
- Seamless Interaction: The C# implementation allowed for smooth transitions between different NFT-backed textures via a simple UI button.
- Democratization of Tools: By using ARCore and Windows-based Unity development, the study demonstrates that high-quality AR tools are accessible without needing specialized, high-cost hardware.
In the modern "Self-Media" economy, reputation and digital identity are primary commodities. AR masks are becoming essential "uniforms" for creators, and the integration of NFT technology validates the value of these digital assets by providing a clear framework for e-commerce applications.
Limitations and Future Work
A significant technical limitation identified was the "Hollow Socket" problem—the inability to create transparent eye and mouth sockets in the masks using the current version of Google’s ARCore. This results in masks that cover the user's actual features entirely. Future work will explore moving to an iOS/ARKit environment to resolve this and provide more granular tracking.
Additionally, future iterations aim to automate the integration between the AR application and the blockchain. This would allow the app to automatically verify a user's digital wallet for the required NFT before granting access to specific premium mask textures, further tightening the link between ownership and utility.
Summary updated