VINS-Mask: A ROI-mask Feature Tracker for Monocular Visual-inertial System

Jiayuan Sun1, Fangwei Song1, Luping Ji*;1
1 University of Electronic Science and Technology of China
 

2022 International Conference on Automation, Robotics and Computer Engineering (ICARCE 2022)

 
[Summary video]     [Abstract]     [Paper/Supp]     [Code]     [Citation]    

Summary video

Abstract

Feature tracker is usually believed to be one of the most important components to the performance influence on a Visual-inertial System (VINS). This paper proposes the VINS-Mask scheme, a more robust feature tracker for monocular VINS through Region of Interest (ROI) masks. It could achieve real-time feature tracking with high accuracy and robustness. Firstly, we propose an edge mask to generate the edge-sensitive feature candidate regions from the incoming image frame. Next, we design an interest point sensitive SuperPoint mask with deep learning framework to obtain repeatable and reliable feature candidate regions. We also dynamically adjust the inflation radius by monitoring the initial status from VINS Initialization module to obtain more accurate ROI masks. Notably, compared with the best baseline approach (i.e., VINS-Mono), our VINS-Mask scheme achieves an average improvement accuracy of 0.068m on the dataset of EuRoc drone. After paper publication, our source codes will be available at https://github.com/sunjiayuanro/VINS-Mask.git.

Paper

Code

Please refer to our  github repo for code.

Citation

    @INPROCEEDINGS{10046501,
        author={Sun, Jiayuan and Song, Fangwei and Ji, Luping},
        booktitle={2022 International Conference on Automation, Robotics and Computer Engineering (ICARCE)}, 
        title={VINS-Mask: A ROI-mask Feature Tracker for Monocular Visual-inertial System}, 
        year={2022},
        volume={},
        number={},
        pages={1-5},
        doi={10.1109/ICARCE55724.2022.10046501}}