一种基于Star算法的多路视频稳像方法研究
作者:
作者单位:

1.中国兵器工业试验测试研究院 华阴 714200;2.南京理工大学能源与动力工程学院 南京 210094

作者简介:

王栋梁 1989年生,学士,工程师,主要研究方向为试验技术和图像处理。
徐啸康 1996年生,硕士,主要研究方向为嵌入式软件开发和图像处理。
白宏阳 1985年生,教授,博士生导师,主要研究方向为目标检测和导航与制导技术。
郭宏伟 1994年生,在读博士研究生,主要研究方向为深度学习和目标检测与识别技术。

通讯作者:

白宏阳(hongyang@njust.edu.cn)

中图分类号:

TP391.41;TJ765.3

基金项目:


Research on multi-channel video image stabilization method
Author:
Affiliation:

1.Norinco Group Test and Measuring Academy, Huayin 714200, China;2.Nanjing University of Science and Technology, Nanjing 210094, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    目前,基于特征点匹配的稳像算法中存在特征点提取速度慢、误匹配率高,以及多目相机的多路视频稳像太过耗时、实时性不好的问题,提出了一种基于Star特征点提取算法的多路视频快速稳像方法。首先采用Star算法提取视频当前帧特征点,然后采用光流法结合当前帧特征点信息跟踪预测下一帧对应的特征点,以加快特征点提取速度,同时减少所提取的特征点错误匹配率。通过对匹配的特征点求取相应的仿射变换矩阵获取帧间运动矢量,进而采用卡尔曼滤波器对帧间运动矢量进行滤波处理,以滤除其中的相机随机抖动矢量并保留相机的主观运动矢量。最后依据滤波后的运动矢量进行图像补偿得到稳定的图像序列。针对复眼导引头存在的多路视频抖动情况,基于OpenMP并行开发库,利用多核处理器的优势,实现了多路抖动视频的并行实时稳像。所设计的数字稳像算法在PC平台下对4路抖动视频(OTB100的BlurCar系列视频,分辨率为640×480,帧率为30 FPS)并行稳像的结果参数为:峰值信噪比 (Peak Signal-to-Noise Ratio,PPSNR)平均提升了4.62 dB,单帧耗时平均为14.51 ms。经仿真实验证实,算法的计算效率和特征点匹配正确率高,可实现多路输入视频的实时稳像。

    Abstract:

    Aiming at the problems of slow feature point extraction, high mismatch rate, and multi-channel video image stabilization of multi-camera cameras that are too time-consuming and poor real-time performance in current image stabilization algorithms based on feature point matching, this paper proposes an improved Star feature point fast extraction algorithm. First, the Star algorithm is used to extract the feature points of the current frame of the video, and then the optical flow method is combined with the feature point information of the current frame to track and predict the feature points corresponding to the next frame, which speeds up the extraction of feature points and reduces the number of invalid feature points extracted. The inter-frame motion vector is obtained by obtaining the corresponding affine transformation matrix for the matched feature points, and then the Kalman filter is used to filter the inter-frame motion vector to filter out the random camera shake vector and retain the subjective motion of the camera vector. Finally, perform image compensation according to the filtered motion vector to obtain a stable image sequence. In view of the multi-channel video jitter situation in the seeker, this article is based on the OpenMP parallel development library and uses the advantages of multi-core processors to achieve parallel real-time image stabilization of multi-channel jitter videos. The results of parallel image stabilization of 4 dithered videos (BlurCar series videos of OTB100, resolution 640×480, frame rate 30 FPS) under the PC platform of this algorithm are: PSNR increased by 4.62 dB on average, and single frame time consumption average is 14.51 ms. Experiments have confirmed that the algorithm in this paper has high computational efficiency and accuracy, and can realize real-time image stabilization of multiple input videos. Compared with other image stabilization algorithms, it has better practical value.

    相似文献
    引证文献
引用本文

王栋梁,徐啸康,白宏阳,郭宏伟.一种基于Star算法的多路视频稳像方法研究[J].遥测遥控,2023,44(1):79-87.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
    参考文献
历史
  • 收稿日期:2022-04-25
  • 最后修改日期:2022-06-26
  • 录用日期:
  • 在线发布日期: 2023-01-14
  • 出版日期:
  • 优先出版日期: 2023-01-14