Active Environment-aware Optimal Scanning Control for UAV LiDAR-Inertial Odometry in Complex Scenes

Jianping Li1 Xinhang Xu1 Zhongyuan Liu1 Shenghai Yuan1 Muqing Cao2 Lihua Xie1 1 Nanyang Technological University 2 Carnegie Mellon University

What can AEOS do?

Active Environment-aware Optimal Scanning Control for UAV LiDAR-Inertial Odometry in Complex Scenes. (a) We proposed a bio-inspired active panoramic sensing UAV system for complex scenes. (b) The active sensing agent practices and learns knowledge in a point cloud-based simulation environment via reinforcement learning. (c) The proposed agent is a differentiable hybrid Model Predictive Control (MPC) considering implicit information from scene context and explicit information from uncertainty analysis.

Abstract

LiDAR-based UAV perception is limited by narrow field of view and payload constraints. Traditional fixed-speed scanning lacks scene awareness, degrading performance in complex environments.

AEOS combines model predictive control (MPC) and reinforcement learning in a hybrid architecture inspired by owl sensing behavior. An analytical uncertainty model predicts pose observability while a neural network learns implicit cost maps for optimal scanning control.

Extensive experiments demonstrate significant odometry improvements compared to baseline methods while maintaining real-time performance for onboard deployment.

Key Features & Contributions

🦉 Bio-inspired Design

Inspired by the active sensing behavior of owls, AEOS adapts LiDAR scanning patterns based on environmental context and task requirements.

🤖 Hybrid MPC + RL

Combines analytical uncertainty models for exploitation with neural networks for exploration, achieving optimal scanning control.

🌍 Real-world Transfer

Point cloud-based simulation environment enables effective sim-to-real transfer across diverse real-world scenarios.

⚡ Real-time Performance

Maintains computational efficiency for onboard deployment while significantly improving odometry accuracy.

Bio-inspired Active Sensing System

Owl-inspired Adaptive Scanning: Traditional UAV LiDAR systems use fixed-speed rotations that ignore environmental complexity. AEOS mimics the selective attention mechanism of owls, dynamically adjusting scanning patterns based on scene structure and uncertainty, leading to more efficient data collection and improved localization performance in challenging environments.

Active Sensing Mechanical Design

Mechanical Design

AEOS-DRONE

Mechanical Design

Real-world Experiments

Challenging Environments: AEOS has been extensively tested in complex real-world scenarios including industrial facilities and underground environments. Our experiments demonstrate significant improvements in odometry accuracy compared to fixed-rate scanning, while maintaining real-time performance constraints essential for autonomous UAV operations.

Field Testing Results

Industrial Equipment

Basement

Rescue Operation



Learning & Practice in Simulation Environments

Scalable Training Framework: Our point cloud-based simulation environment incorporates real-world LiDAR maps from diverse global locations, enabling robust policy learning and effective sim-to-real transfer. The lightweight neural network learns implicit cost maps from panoramic depth representations, balancing exploration and exploitation for optimal scanning strategies across varied environmental conditions.

World-wide Evaluation in Complex Environments

Dataset Overview

Seq1: Lava Tube

Seq2: Cave

Seq3: Eurasia Tunnel

Seq4: Subway in Wuhan

Seq5: Tunnel in Wuhan

Seq6: Building in Singapore

Seq7: Building in Singapore

Seq8: Forest