Word Frequency

标签：

Write a bash script to calculate the frequency of each word in a text file words.txt.

For simplicity sake, you may assume:

• words.txt contains only lowercase characters and space ‘ ‘ characters.
• Each word must consist of lowercase characters only.
• Words are separated by one or more whitespace characters.

For example, assume that words.txt has the following content:

the day is sunny the the
the sunny is is

Your script should output the following, sorted by descending frequency:

the 4
is 3
sunny 2
day 1

Note:
Don‘t worry about handling ties, it is guaranteed that each word‘s frequency count is unique.

cat words.txt | tr -s ‘ ‘ ‘\n‘ | sort | uniq -c | sort -r | awk ‘{print $2" "$1}‘
tr -s: 使用指定字符串替换出现一次或者连续出现的目标字符串（把一个或多个连续空格用换行符代替）

sort: 将单词从小到大排序

uniq -c: uniq用来对连续出现的行去重，-c参数为计数

sort -r: -r 倒序排列

awk ‘{ print $2, $1 }‘: 格式化输出，将每一行的内容用空格分隔成若干部分，$i为第i个部分。

Word Frequency

标签：

原文地址：http://www.cnblogs.com/fightformylife/p/4389492.html