如何分析服务器日志哪些元素占用流量过大？

标签：服务器   日志分析   流量   awk应用   

测试数据如下：

59.33.26.105 - - [08/Dec/2010:15:43:56 +0800] "GET /static/images/photos/2.jpg HTTP/1.1" 200 11299 "http://oldboy.blog.51cto.com/static/web/column/17/index.shtml?courseId=43" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)" 

59.33.26.105 - - [08/Dec/2010:15:43:56 +0800] "GET /static/images/photos/2.jpg HTTP/1.1" 200 11299 "http://oldboy.blog.51cto.com/static/web/column/17/index.shtml?courseId=43" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)" 

59.33.26.105 - - [08/Dec/2010:15:44:02 +0800] "GET /static/flex/vedioLoading.swf HTTP/1.1" 200 3583 "http://oldboy.blog.51cto.com/static/flex/AdobeVideoPlayer.swf?width=590&height=328&url=/[[DYNAMIC]]/2" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729)" 

124.115.4.18 - - [08/Dec/2010:15:44:15 +0800] "GET /?= HTTP/1.1" 200 46232 "-" "-" 

124.115.4.18 - - [08/Dec/2010:15:44:25 +0800] "GET /static/js/web_js.js HTTP/1.1" 200 4460 "-" "-" 

124.115.4.18 - - [08/Dec/2010:15:44:25 +0800] "GET /static/js/jquery.lazyload.js HTTP/1.1" 200 1627 "-" "-"

需要输出三个指标：【访问次数】【访问次数*单个文件大小】 【文件名（可以带URL）】。

解决方案，通过awk取出文件名，文件大小；用数组进行 访问次数，及访问量的统计，最后排序输出结果。

代码如下： 

[root@oldboy32 data]# awk ‘{a[$7] += $10; ++b[$7];
total += $10}END {for( i in a) print b[i],a[i],i}‘ images.log |sort -rnk2
1 46232 /?=
2 22598 /static/images/photos/2.jpg
1 4460 /static/js/web_js.js
1 3583 /static/flex/vedioLoading.swf
1 1627 /static/js/jquery.lazyload.js

如何分析服务器日志哪些元素占用流量过大？

标签：服务器   日志分析   流量   awk应用   

原文地址：http://iersa.blog.51cto.com/9257603/1871499