Telecommunications Science ›› 2020, Vol. 36 ›› Issue (11): 121-126.doi: 10.11959/j.issn.1000-0801.2020303

• Topic:Information Security • Previous Articles     Next Articles

Internet bad information detection based on Bert model

Xin CAI   

  1. Research Institute of China Telecom Co.,Ltd.,Shanghai 200122,China
  • Revised:2020-11-01 Online:2020-11-20 Published:2020-12-09

Abstract:

In view of the business scenario of bad information detection on the internet,the method of detection based on the text content of the website was discussed .Classical text analysis techniques were reviewed.The key technical features and two different usages of Bert model were introduced.The specific implementation scheme of using the feature extraction method to detect website bad information was described in detail,and was compared with the traditional TF-IDF model and word2vec+LSTM model.The validity of this method is verified.

Key words: bad information, Bert model, text analysis, feature extraction

CLC Number: 

No Suggested Reading articles found!