Skip to content

Vision Pro - Virtual Chopper

Elevating AR Experiences with a Virtual Helicopter Controlled by Hand Gestures

Problem

Creating interactive AR experiences presents unique challenges, particularly when it comes to intuitive control mechanisms.

For this project, we aimed to build a virtual helicopter that users could fly around their real-world environment. However, existing technologies often struggle with accurately recognizing complex hand gestures and positions, which are critical for providing a seamless and intuitive user experience. These limitations make it difficult to develop natural and responsive controls that feel engaging and enjoyable to the user.

Chopper1
Chopper2
Chopper3

Solution

We explored the capabilities of the Apple Vision Pro to push the boundaries of augmented reality. We developed a virtual helicopter that users can control with their hands, flying it freely around their environment. Leveraging the advanced spatial computing and hand-tracking capabilities of the Apple Vision Pro, we created an experience that feels both intuitive and responsive.

Our team tackled challenges related to hand gesture and position recognition, implementing sophisticated algorithms to ensure the helicopter responds smoothly to user movements. This required a deep understanding of the Apple Vision Pro’s limitations and possibilities, particularly in recognizing and interpreting complex hand gestures in real time.
The result was a playful yet highly technical AR experience that not only demonstrates the potential of the Apple Vision Pro but also highlights our expertise in utilizing its unique features. The Virtual Chopper project showcases our ability to creatively solve complex challenges and create engaging, immersive experiences using the latest in spatial computing technology.

“It’s amazing the results you get when you mix Occipital’s 3D scanner with an iPad mobile app. The two combined make cutting-edge technology simple and accessible.”

Sarah Troshian
Project Manager
Sidekick Interactive

Let's 
co-create 
build 
define 
your mobile app.
Get in touch