Abstract:

With the rapid development of network scale and the stricter requirement for operation efficiency, network traffic analysis system is facing big challenges in terms of the scale and analyzing depth. Traditional technologies cannot meet the current requirement for the scalability, cost and analyzing depth of the system. A MapReduce based traffic analysis system was presented, which could eliminate the performance bottleneck by parallelizing the storage and computation.

Key words: MapReduce, traffic analysis, large scale