综合练习：词频统计

news=‘‘‘At the same time, the market of TV dramas has also maintained rapid development. In 2017, the production volume of TV dramas in China reaches 310 and 13,000 sets, and continues to be the no.1 in the world. The "national treasure", "national treasure", "if the national treasure can talk" and other TV variety shows, documentaries, vividly spread the excellent Chinese traditional culture.
With modern technology, traditional culture is rejuvenated. Hangzhou songcheng group with new technology to interpret ancient Chinese traditional story, the Qingdao publishing group is using virtual reality, 3 d printing technology, the audience can feel the charm of traditional culture anytime and anywhere.
In recent years, China‘s cultural industry has been growing rapidly, and the pace of "going out" has been accelerating. As of last year, China‘s publishing enterprises set up more than 400 branches overseas and established cooperative partnership with over 500 publishing institutions in over 70 countries. People‘s day boat publishing co., LTD. Was set up in less than two years, has published "Chinese traditional festival" (in Arabic), "in a pocket of father" (French version) and so on more than 40 foreign language books.
 ‘‘‘
sep = ‘‘‘,.;:‘‘""‘‘‘
for c in sep:
    news = news.replace(c, ‘ ‘)

wordlist = news.lower().split()

wordDict = {}
for w in wordlist:
    wordDict[w] = wordDict.get(w, 0) + 1
‘‘‘
wordSet=set(wordlist)
for w in wordSet:
    wordDict[w]=wordlist.count(w)
‘‘‘
for w in wordDict:
    print(w, wordDict[w])

wordSet=set(wordlist)
for w in wordSet:
    wordDict[w]=wordlist.count(w)
dictList=list(wordDict.items())
dictList.sort(key=lambda x:x[1],reverse=True)
 
print(dictList)

exclude={‘the‘,‘a‘,‘an‘,‘and‘,‘of‘,‘with‘,‘to‘,‘by‘,‘am‘,‘are‘,‘is‘,‘which‘,‘on‘}
wordSet=set(wordlist)-exclude
for w in wordSet:
    wordDict[w]=wordlist.count(w)
dictList=list(wordDict.items())
dictList.sort(key=lambda x:x[1],reverse=True)
 
print(dictList)

for i in range(20):
    print(dictList[i])


print(‘author:xujinpei‘)
f=open(‘news.txt‘,‘r‘)
news=f.read()
f.close()
print(news)