Bridging the Gap Between Virtual and Real-World Drone Flight

Overview

Flying drones with first-person view (FPV) goggles is illegal in Australia, but CASA saying no hasn’t stopped me from exploring immersive drone piloting in virtual environments. By combining my passion for drones with immersive technology, I have developed a custom virtual drone controller that connects seamlessly to an FrSky Taranis X9D, allowing for true-to-life drone control in digital spaces.

Key Features

  • Virtual Drone Control: Developed a system that links the FrSky Taranis X9D to virtual environments.
  • Realistic Training & Exploration: Enables drone training, digital world exploration, and simulated flight experiences.
  • Cinematography Previsualisation: Captures flight paths for digital drone cinematography, processed in real time or as a spline for pre-rendered footage.
  • LiDAR Simulation: I built a Unity tool that draws a live point cloud onto the environment, so people can practise scanning technique and learn what “good coverage” actually looks like.

Project Purpose

This project serves as another tool engaging with digital environments, allowing for a risk-free, immersive flight experience while capturing drone data. This allows me to pilot the pilot, using immersive technologies to engauge with community and stakeholders with rendered drone footage. I am able to collaborate with professional drone pilots to generate accurate 3D assets for various applications.

This project represents my understanding of drone technology and immersive environments, showcasing how virtual simulations can bridge the gap between digital and real-world applications. In the future, I aim to further develop my skills, work with drone pilots, and contribute to the evolving landscape of drone-based immersive technology.

My Role & Demonstrated Skills

Applied drone LiDAR, photogrammetry, and aerial cinematography across multiple visualisation projects spanning engineering to education.

    • Drone LiDAR & Photogrammetry
      Used drone-captured LiDAR and photogrammetry data to generate accurate 3D environments and point clouds for analysis, visualisation, and immersive applications.

    • Visualisation & Immersive Media
      Integrated spatial datasets and drone outputs into Unity-based real-time environments to support project visualisation, simulation, and communication of complex sites.

    • Aerial Cinematography & Data Capture
      Utilised drone footage as a core project input for visual storytelling and immersive media deliverables.

    • Collaboration with Drone Operators
      Worked closely with licensed drone operators to plan capture, define coverage requirements, and acquire site data and footage aligned with project outcomes.

Goal & Outcomes

  • Future Professional Aspirations: Obtaining a Remote Pilot Licence (RePL) to fly drones professionally.
  • Enhanced Training & Simulation: Created a realistic and accessible way to practice drone piloting.
  • 3D Asset Creation & Digital Mapping: Utilised drone controller for immersive technologies, with potential applications in real-time geospatial mapping.

Leave a Reply