欢迎访问《空军工程大学学报》官方网站!

咨询热线:029-84786242 RSS EMAIL-ALERT
融合多尺度注意力和双向LSTM的行人重识别
DOI:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391

基金项目:

陕西省重点发展计划(2021ZDLSF06 09)


A Pedestrian Re ID with Multi Scale Attention and Bidirectional LSTM
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    将深度学习应用于行人重识别领域,嵌入多尺度注意力融合模块至神经网络中进行多尺度特征提取和表示,可有效提升注意力机制对深度学习网络的识别性能。提出了一种基于SE block的多尺度通道注意力融合模块,并结合ResNet50卷积神经网络提取特征;然后通过双向LSTM网络进一步提取特征序列上下文信息,在提高模型对图像重要特征的提取能力的同时,降低对图像冗余特征的关注度;最后使用级联难采样三元组损失函数和交叉熵损失函数共同训练网络模型,使样本能够在高维特征空间中实现聚类,进一步提升模型识别准确性。所提出算法在Market1501数据集和CUHK03数据集分别进行实验,并在同等条件下和其他注意力模块算法进行比较。为进一步验证各模块作用,对算法进行消融实验,以验证各模块的有效性,实验结果表明,所提出方法可有效应用于行人重识别

    Abstract:

    With the rapid development of the information society, taking video sensors as the front end for acquiring information is of great significance in effectively finding specific objects through pedestrian re identification algorithms to protect people’s lives and property. This paper applies deep learning to the field of person re identification, and embeds the multi scale attention fusion module into the neural network for multi scale feature extraction and representation, effectively improving the recognition performance of the attention mechanism for deep learning networks. The paper proposes a multi scale channel attention fusion module based on SE block in combination with the ResNet50 convolutional neural network to extract features, further extract the feature sequence context information through the bidirectional LSTM network, and improve the model’s ability to extract important image features. At the same time, the attention to redundant features of images is reduced. Finally, the network model is jointly trained by the cascaded hard sampling triplet loss function and the cross entropy loss function, clustering the samples in the high dimensional feature space, and further improving the model recognition accuracy. Market1501 dataset and CUHK03 dataset are tested by the proposed algorithm respectively, and compared with other attention module algorithms under the same conditions. In order to further verify the function of each module, an ablation experiment is performed by the algorithm to verify the effectiveness of each module. The experimental results show that the proposed method can be effectively applied to person re identification

    参考文献
    相似文献
    引证文献
引用本文

闫昊雷,李小春,张仁飞,张磊,邱浪波,王哲.融合多尺度注意力和双向LSTM的行人重识别[J].空军工程大学学报,2022,23(5):71-76

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2022-11-04
  • 出版日期: