IB3's Augmented Reality and Desktop application, created by Unity's GovTech team, focuses on creating a digital twin of the IB3 campus and providing training on glovebox operations for making a casting from a crucible. The innovative use of AR technology, specifically the Magic Leap headset, and the integration of LED walls were key considerations in enhancing the training and daily operations at IB3.
Objectives
The primary objectives of this project were to:
Create an immersive digital twin of the IB3 campus to facilitate tours and orientation for new employees that could be done through AR and desktop applications.
Develop an AR training module for glovebox operations, focusing on making a casting from a crucible.
Evaluate the effectiveness of the Magic Leap headset for hands-free, gesture-based interaction in training scenarios.
Assess the impact of LED wall integration on the AR environment and user experience.
Methodologies
Technology Selection:
Magic Leap Headset - Chosen for its advanced AR capabilities and hand gesture recognition, allowing users to interact with virtual objects in a natural and intuitive manner.
LED Wall Integration: Investigated how the presence of LED walls in the environment would affect the AR experience, ensuring seamless blending of physical and virtual elements.
Development Process:
Digital Twin Creation - Leveraged Unity's powerful 3D rendering capabilities to create a highly detailed digital replica of the IB3 campus. This virtual environment was used for both orientation tours and training simulations.
Glovebox Training Module - Designed an interactive AR training module that guides users through the process of making a casting from a crucible. The module included step-by-step instructions, visual aids, and real-time feedback.
User Testing and Feedback:
Conducted user testing sessions with new employees and existing staff to gather feedback on the usability and effectiveness of the digital twin and AR training module.
Iterative design improvements based on user feedback, focusing on enhancing the user interface, gesture recognition accuracy, and overall training experience.
Key Findings
Digital Twin of IB3 Campus:
Enhanced Orientation - The digital twin proved to be an effective tool for orienting new employees, helping them navigate the campus and locate key facilities with ease.
Educational Value - Provided a comprehensive overview of the campus layout, which was beneficial for daily tours and educating employees about the various departments and their functions.
AR Training on Glovebox Operations:
Intuitive Interaction - Users found the Magic Leap headset's hand gesture recognition to be intuitive, making the training process more engaging and easier to follow.
Effective Training - The AR training module successfully simulated the glovebox operations, providing users with hands-on experience without the need for physical materials. This approach reduced training costs and minimized the risk of errors in real-world operations.
LED Wall Integration:
Seamless Experience: The integration of LED walls in the training environment enhanced the realism of the AR experience. Users reported that the virtual elements blended well with the physical surroundings, creating a cohesive training atmosphere.
Conclusion
The development of the Augmented Reality and Desktop application for IB3 by Unity's GovTech team resulted in a highly effective and innovative solution for campus orientation and glovebox training. The digital twin of the IB3 campus facilitated seamless tours and employee education, while the AR training module on the Magic Leap headset provided an engaging and intuitive learning experience. The successful integration of LED walls further enriched the AR environment, demonstrating the potential of combining physical and virtual elements in training applications.By addressing key objectives and leveraging advanced technologies, the project significantly enhanced the efficiency and effectiveness of training and daily operations at IB3.
