Chinese Journal of Intelligent Science and Technology ›› 2019, Vol. 1 ›› Issue (1): 88-95.doi: 10.11959/j.issn.2096-6652.201906

• Papers • Previous Articles     Next Articles

Algorithm design for food-picking combining deep learning and biometrics recognition

Niya CHEN1(),Jiayang RUAN1,Jinmiao HUANG1,Wei YANG2   

  1. 1 ABB Corporate Research Center,Beijing 100015,China
    2 ABB Robotics Application Center,Shanghai 201319,China
  • Revised:2019-02-21 Online:2019-03-20 Published:2019-05-28


Irregular-shape food picking and processing is a common problem in industrial automation,which can be difficult for classical image processing techniques,because of the big variations in food shape and characteristics,also the high-performance requirements in both algorithm accuracy and speed.In this paper,a hybrid method based on deep learning and feature recognition was proposed,which first roughly localized the target point based on deep learning model,and then created a search range accordingly.After that,based on biological feature analysis,target point could be accurately localized in the search range.Based on the data of shrimps,a kind of common food,the performance of the proposed method was tested.The shrimp images were pre-processed and used to train the deep learning model for rough localization.Then the shrimp body pose was normalized for edge extraction after proper rotation and projection.The extracted edge curve in search range was analyzed to accurately localize the target joint point.The validation results based on a test set including 1000 samples prove the feasibility of the method – the final detection rate of the proposed hybrid method is 97%.The performance meets industrial requirements on this case.

Key words: computer vision, food picking, deep learning, feature recognition

CLC Number: 

No Suggested Reading articles found!