AirDOS: Dynamic SLAM benefits from Articulated Objects

Published: by

Dynamic Object-aware SLAM (DOS) exploits object-level information to enable robust motion estimation in dynamic environments. It has attracted increasing attention with the recent success of learning-based models. Existing methods mainly focus on identifying and excluding dynamic objects from the optimization. In this work, we show that feature-based visual SLAM systems can also benefit from the presence of dynamic articulated objects by taking advantage of two observations:

  • The 3D structure of an articulated object remains consistent over time;
  • The points on the same object follow the same motion.
AirDOS demo in TartanAir Shibuya dataset

In particular, we present AirDOS, a dynamic object-aware system that introduces rigidity and motion constraints to model articulated objects. By jointly optimizing the camera pose, object motion, and the object 3D structure, we can rectify the camera pose estimation, preventing tracking lost, and generate 4D spatio-temporal maps for both dynamic objects and static scenes.

Articulated Objects

We extend the simple rigid objects to general articulated objects, which are defined as objects composed of one or more rigid parts connected by joints allowing rotational or translational motion, e.g., vehicles and humans, and utilize the properties of articulated objects to improve the camera pose estimation.

An example of the articulated dynamic objects’ point-segment model. Vehicles and semi-rigid objects like pedestrian are modeled as articulated objects.

We jointly optimize the 3D structural information and the motion of articulated objects. To this end, we introduce

(1) a rigidity constraint, which assumes that the distance between any two points located on the same rigid part remains constant over time, and

(2) a motion constraint, which assumes that feature points on the same rigid parts follow the same 3D motion. This allows us to build a 4D spatio-temporal map including both dynamic and static structures.


Publication

Qiu, Yuheng, Chen Wang, Wenshan Wang, Mina Henein, and Sebastian Scherer. “AirDOS: Dynamic SLAM benefits from Articulated Objects.” International Conference on Robotics and Automation (ICRA), 2022.

Source Code

https://github.com/haleqiu/AirDOS

Citation

@inproceedings{qiu2022airdos,
 title={AirDOS: Dynamic SLAM benefits from Articulated Objects},
 author={Qiu, Yuheng and Wang, Chen and Wang, Wenshan and Henein, Mina and Scherer, Sebastian},
 booktitle={International Conference on Robotics and Automation (ICRA)},
 year={2022}
}

Contact