智能科学与技术学报 ›› 2021, Vol. 3 ›› Issue (3): 268-279.doi: 10.11959/j.issn.2096-6652.202128

• 专刊:目标智能检测与识别 • 上一篇    下一篇

基于3D卷积的图像序列特征提取与自注意力的车牌识别方法

曾淦雄1,2, 柯逍1,2   

  1. 1 福州大学数学与计算机科学学院,福建 福州 350116
    2 福建省网络计算与智能信息处理重点实验室,福建 福州 350116
  • 修回日期:2021-07-05 出版日期:2021-09-15 发布日期:2021-09-01
  • 作者简介:曾淦雄(1996− ),男,福州大学数学与计算机科学学院硕士生,主要研究方向为计算机视觉、模式识别等
    柯逍(1983− ),男,博士,福州大学数学与计算机科学学院副教授,主要研究方向为计算机视觉、机器学习与模式识别等
  • 基金资助:
    国家自然科学基金资助项目(61972097);福建省科技引导性项目(2017H0015);福建省自然科学基金资助项目(2018J01798)

3D convolution-based image sequence feature extraction and self-attention for license plate recognition method

Ganxiong ZENG1,2, Xiao KE1,2   

  1. 1 College of Mathematics and Computer Science, Fuzhou University, Fuzhou 350116, China
    2 Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, Fuzhou 350116, China
  • Revised:2021-07-05 Online:2021-09-15 Published:2021-09-01
  • Supported by:
    The National Natural Science Foundation of China(61972097);The Technology Guidance Project of Fujian Province(2017H0015);The Natural Science Foundation of Fujian Province(2018J01798)

摘要:

近年来,基于自注意力机制的神经网络在计算机视觉任务中得到广泛的应用。随着智能交通系统的广泛应用,面对复杂多变的交通场景,车牌识别任务的难度不断提高,准确识别的需求更加迫切。因此提出一个基于自注意力的免矫正的车牌识别方法T-LPR。首先对图像进行切片和序列化,并使用3D卷积对切片序列进行特征提取,从而得到图像的嵌入向量序列。然后将嵌入向量序列输入基于Transformer Encoder的编码器中,学习各个嵌入向量之间的关系并输出最终的编码结果。最后使用分类器进行分类。在多个公共数据集上的实验结果表明,所提方法对各类困难场景下的车牌识别都非常有效。

关键词: 车牌识别, 图像嵌入向量, 自注意力, 免矫正

Abstract:

In recent years, neural networks based on self-attentive mechanism have been widely used in computer vision tasks.As the intelligent transportation system is widely used, the task difficulty of license plate recognition is increasing and the need for correct recognition is getting more pressing in the face of complex and changing traffic scenes.Therefore, a rectification-free license plate recognition method T-LPR based on self-attention was proposed.Firstly, the images were sliced and sequenced, and 3D convolution was used for feature extraction of the sliced sequences to obtain a sequence of image embedding vectors.Secondly, the sequence of embedding vectors was fed into an encoder based on Transformer Encoder, which learned the relationship between the individual embedding vectors and outputs the final encoding result.Finally, the final encoding result was classified by a classifier.Experimental results on several public datasets show that T-LPR proposed is very effective for recognizing license plates in all kinds of difficult scenarios.

Key words: license plate recognition, image embedding vector, self-attention, rectification-free

中图分类号: 

No Suggested Reading articles found!