基于描述符辅助光流跟踪匹配的数据关联方法

夏华佳; 章红平; 陈德忠; 李团

基于描述符辅助光流跟踪匹配的数据关联方法

武汉大学卫星导航定位技术研究中心武汉 430079

基金项目:

国家重点研发计划项目（SQ2018YFE020091）、长江勘测规划设计研究院开放创新基金项目（CX2020K04）资助

详细信息

作者简介:
夏华佳(1996-),硕士研究生.研究方向:视觉/INS组合导航.E-mail:67010973@qq.com

通讯作者:
章红平(1977-),博士,教授.研究方向:GNSS/INS组合导航.E-mail:hpzhang@whu.edu.cn

中图分类号: V249.32+8
计量
- 文章访问数: 4253
- HTML全文浏览量: 335
- PDF下载量: 1182
- 被引次数: 0
出版历程
- 收稿日期: 2021-11-06
- 网络出版日期: 2021-12-14

Data Association Method Based on Descriptor Assisted Optical flow Tracking Matching

GNSS Research Center, Wuhan University, Wuhan Hubei 430079, China

摘要

摘要: 针对采用多状态约束卡尔曼滤波（MSCKF）的视觉惯性里程计定位精度易受特征点匹配异常值影响问题，提出了一种基于描述符辅助光流跟踪匹配的数据关联方法。该方法采用金字塔LK光流对序列图像中特征点进行跟踪匹配，计算每一对匹配点的rBRIEF描述符，根据Hamming距离对描述符的相似度进行判断消除异常匹配点。在实验中从特征点匹配主观效果以及定位精度两个方面评估本文方法的有效性。结果表明：所提出方法能够有效滤除动态场景下图像特征匹配的异常值，使用该方法处理后的图像进行MSCKF运动解算，位置结果漂移率小于0.38%，相较于未剔除异常匹配值的MSCKF算法结果，改善了54.7%，单帧图像处理时间约为39 ms。
- 视觉惯性 /
- 数据关联方法 /
- 特征点匹配 /
- rBRIEF描述符 /
- 光流跟踪 /
- MSCKF
Abstract: in the view of the problem that the positioning accuracy of visual inertial odometer using multi-state constrained Kalman filter(MSCKF) is easily affected by the abnormal value of feature point matching, a data association method based on descriptor assisted optical flow tracking matching is proposed. This method uses pyramid LK optical flow to track and match the feature points in the sequence image, then calculates the rbrief descriptor of each pair of matching points, judges the similarity of the descriptor according to the Hamming distance,and eliminates the abnormal matching points. In the experiment, the effectiveness of the proposed method is evaluated from two aspects:the subjective effect of feature point matching and positioning accuracy. The results show that the proposed method can effectively filter the abnormal values of image feature matching in dynamic scene. The image processed by this method is used for msckf motion solution,and the drift rate of position result is less than 0.38%, compared with the result of msckf algorithm without eliminating abnormal matching values,The improvement is 54.7%, and the single frame image processing time is about 39 ms.
- visual inertial /
- data association method /
- feature matching /
- rbrief descriptor /
- optical flow tracking /
- MSCKF

HTML全文

参考文献(17)

[1]	姚卓, 章红平.里程计辅助车载GNSS/INS组合导航性能分析[J].大地测量与地球动力学, 2018, 38(2):206-210. YAO Zhuo,ZHANG Hongping.Performance analysis of odometer assisted vehicle GNSS/INS Integrated Navigation[J]. Journal of Geodesy and Geodynamics, 2018, 38(2):206-210. (in Chinese)
[2]	QIU Xiaochen, ZHANG Hai, FU Wenxing,et al.Monocular visual-inertial odometry with an unbiased linear system model and robust feature tracking front-end[J]. Sensors,2019,19(8):1941.
[3]	DELMERICO J, SCARAMUZZA D.A benchmark comparison of monocular visual-inertial odometry algorithms for flying robots[C].2018 Internatio nal IEEE Conference on Robotics and Automation, Queensland,Australia:IEEE, 2018.
[4]	FAESSLER M, FONTANA F, FORSTER C, et al.Autonomous, vision-based flight and live dense 3D mapping with a quadrotor micro aerial vehicle[J]. Journal of Field Robotics, 2016, 33(4):431-450.
[5]	BLOESCH M, BURRI M, OMARI S, et al.Iterated extended Kalman filter based visual-inertial odometry using direct photometric feedback[J]. The International Journal of Robotics Research, 2017, 36(10):1053-1072.
[6]	MOURIKIS A I, ROUMELIOTIS S I.A multi-state constraint Kalman filter for vision-aided inertial navigation[C]. 2007 International IEEE Conference on Robotics and Automation,Roma, Italy:IEEE, 2007.
[7]	齐乃新, 杨小冈, 李小峰, 等.基于ORB特征和LK光流的视觉里程计算法[J]. 仪器仪表学报, 2018, 39(12):216-227. QI Naixin, YANG Xiaogang, LI Xiaofeng, et al.Visual odometry algorithm based on ORB features and LK optical flow[J]. Chinese Journal of Scientific Instrument,2018,39(12):216-227. (in Chinese)
[8]	LIU Jingneng,ZENG Guihua.Improved global context descriptor for describing interest regions[J]. Journal of Shanghai Jiaotong University (Science), 2012, 17(2):147-152.
[9]	成怡, 朱伟康, 徐国伟.基于余弦相似度的改进ORB匹配算法[J].天津工业大学学报, 2021, 40(1):60-66. CHENG Yi, ZHU Weikang, XU Guowei. An improved ORB matching algorithm based on cosine similarity[J]. Journal of Tianjin Polytechnic University,2021, 40(1):60-66. (in Chinese)
[10]	邹斌, 赵小虎, 尹智帅.基于改进ORB的图像特征匹配算法研究[J].激光与光电子学进展, 2021, 58(2):96-103. ZOU Bin,ZHAO Xiaohu,YIN Zhishuai.image feature matching algorithm based on improved ORB[J]. Laser & Optoelectronics Progress, 2021, 58(2):96-103. (in Chinese)
[11]	王亭亭, 蔡志浩, 王英勋.无人机室内视觉/惯导组合导航方法[J].北京航空航天大学学报, 2018, 44(1):176-186. WANG Tingting, CAI Zhihao, WANG Yingxun.UAV indoor vision/inertial navigation integrated navigation method[J]. Journal of Beijing University of Aeronautics and Astronautics, 2018, 44(1):176-186. (in Chinese)
[12]	刘奕杉.一种基于改进光流法的视觉惯性状态估计器[J].科学技术创新, 2021(10):17-18. LIU Yishan. A visual inertial state estimator based on improved optical flow method[J]. Scientific and Technological Innovation, 2021(10):17-18. (in Chinese)
[13]	BOUGUET J Y.Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm[J].Intel corporation, 2001, 4(5):1-10.
[14]	RUBLEE E, RABAUD V, KONOLIGE K, et al.ORB:An efficient alternative to SIFT or SURF[C]. 2011 International conference on computer vision,Barcelona,Spain:IEEE, 2011.
[15]	CHUM O, MATAS J, KITTLER J.Locally optimized RANSAC[C].Joint Pattern Recognition Symposium,Magdeburg, Germany:DAGM, 2003.
[16]	李团.单频多模GNSS/INS/视觉紧组合高精度位姿估计方法研究[D].武汉:武汉大学, 2019. LI Tuan.Research on the Tightly Coupled Single-frequency multi-GNSS/INS/Vision Integration for Precise Position and Orientation Estimation[D]. Wuhan:Wuhan University,2019. (in Chinese)
[17]	MUR-ARTAL R, TARDÓS J D.Orb-slam2:An open-source slam system for monocular,stereo,andrgb-d cameras[J]. IEEE Transactions on Robotics, 2017, 33(5):1255-1262.