通信学报 ›› 2013, Vol. 34 ›› Issue (Z2): 5-8.doi: 10.3969/j.issn.1000-436x.2013.Z2.002

• 网络工程 • 上一篇    下一篇

基于IPFIX的网络流量日志系统

马云龙,张千里,王继龙   

  1. 清华大学 信息化技术中心,北京 100084
  • 出版日期:2013-12-25 发布日期:2017-06-16
  • 基金资助:
    国家重点基础研究发展计划(“973”计划)基金资助项目

Network traffic analysis system based on IPFIX

Yun-long MA,Qian-li ZHANG,Ji-long WANG   

  1. Information Technology Center,Tsinghua University,Beijing 100084,China
  • Online:2013-12-25 Published:2017-06-16
  • Supported by:
    The National Basic Research Program of China(973 Program)

摘要:

针对高速网络海量数据采集、存储和管理问题,分析了传统IPFIX流量日志系统在高速网络中的性能问题,提出了基于IPFIX协议的用户网络流量日志系统体系结构的优化设计,改进了数据聚类和存储算法,包括二元归井方式采集数据以及多层结构的散列算法存储数据。经校园网部署应用证明,可提供万兆链路下用户网络日志详单及准确上网流量计量值。

关键词: IPFIX, 散列, 流量日志, 海量数据处理

Abstract:

To deal with the large-scale traffic capture and management in high speed network,the performance of IPFIX system was studied.An optimized architecture was proposed and implemented based on improved binary information integration to collect data and improved multi-layer hash algorithm to storage data.This system was deployed in Tsinghua university campus network and can scale to the 10 GB network traffic collection and accurate pricing.

Key words: IPFIX, hash, traffic log, large-scale data processing