码迷,mamicode.com
首页 > 编程语言 > 详细

文本统计器(Java)

时间:2018-08-25 11:41:29      阅读:199      评论:0      收藏:0      [点我收藏+]

标签:util   syn   substr   关键字   inter   color   short   程序   turn   

1. 创建一个类,实现统计文本文件中各类字符和字符串的个数的功能,要求实现:

a) 按字符统计,输出各个字符的数量

b) 按单词统计,输出各个单词的数量

2. 在b)的基础上实现一个类keywordIdentifier,读入一个Java程序源文件,输出各个关键字的个数(注释中出现的关键字不计入关键字个数)

 

思考:统计1:如果文本文件只包含26个英文字母并且用空格分离,那么只需要使用数组就可以对字符计数,用空格分离得到字符串可以对字符串计数(是否区分大小写问题)。如果文本文件是英文,但是包含各种标点及其他符号,则使用集合key-value的形式来对字符计数,按字符依次读取,然后将26个字母以外的所有字符作为空格处理,再使用空格将其分离,最后对字符串统计计数。

关键字统计:需要所有关键字集合,对每行判断是否为注释,再对非注释进行空格分离,对关键字计数(采用key-value形式)

 

1.统计字符和单词 StringCounter.java

import java.util.Map;
import java.util.TreeMap;

public class StringCounter {
    
    private Map<String, Integer> charCount = new TreeMap<String, Integer>();
    
    private Map<String, Integer> wordCount = new TreeMap<String, Integer>();
    
    public void charCounter(String s) {
        Integer freq;
        for(int i = 0; i < s.length(); i++) {
            freq = charCount.get(s.substring(i, i+1));
            if(freq == null) {
                freq = new Integer(1);
            }
            else {
                freq = new Integer(freq.intValue() + 1);
            }
            charCount.put(s.substring(i, i+1), freq);
        }
    }
    
    public void wordCounter(String s) {
        //将除过a-zA-Z0-9的其他符号转为空格,再将多个空格转为一个空格
        String s1 = s.replaceAll("\\W", " ");
        String s2 = s1.replaceAll(" +", " ");
        String[] s3 = s2.split(" ");
        Integer freq;
        for(String str : s3) {
            freq = wordCount.get(str);
            if(freq == null) {
                freq = new Integer(1);
            }
            else {
                freq = new Integer(freq.intValue() + 1);
            }
            wordCount.put(str, freq);
        }
    }
    
    public void output() {
        System.out.println(charCount);
        System.out.println(wordCount);
    }
}

2.测试 使用的文本文件为随意的英文文本

import java.io.IOException;
import java.io.RandomAccessFile;

public class CountTest {

    public static void main(String[] args) throws IOException {
        StringCounter sc = new StringCounter();
        
        long filePoint = 0;
        String s;
        RandomAccessFile file = new RandomAccessFile("string.txt", "r");
        long fileLength = file.length();
        while(filePoint < fileLength) {
            s = file.readLine();
            //处理及计数
            sc.charCounter(s);
            sc.wordCounter(s);
            filePoint = file.getFilePointer();
        }
        file.close();
        
        sc.output();
    }

}

3.关键词统计

  先将所有关键字放入map中,以关键字为键,次数0为值,再读文本统计个数

import java.io.IOException;
import java.io.RandomAccessFile;
import java.util.Map;
import java.util.TreeMap;

public class keywordIdentifier {

    private Map<String, Integer> keyWordCount = new TreeMap<String, Integer>();
    
    public void keyWord() throws IOException {
        long filePoint = 0;
        String s;
        RandomAccessFile file = new RandomAccessFile("keyword.txt", "r");
        long fileLength = file.length();
        while(filePoint < fileLength) {
            s = file.readLine();
            
            String[] s1 = s.split(" ");
            Integer freq = new Integer(0);
            for(String word : s1) {
                keyWordCount.put(word, freq);
            }
            
            filePoint = file.getFilePointer();
        }
        file.close();
    }
    
    public void keyWordCounter(String s){
        int pos = s.indexOf("//");
        if(pos == -1) {
            pos = s.length();
        }
        String sub = s.substring(0, pos);
     String sub1 = sub.replaceAll("\\W", " "); String str
= sub1.replaceAll(" +", " "); String[] s1 = str.split(" "); Integer freq; for(String word : s1) { freq = keyWordCount.get(word); if(freq != null) { freq = new Integer(freq.intValue() + 1); keyWordCount.put(word, freq); } } } public void output() { System.out.println(keyWordCount); } }

4.测试关键词统计

import java.io.*;

public class CountTest {

    public static void main(String[] args) throws IOException {
        keywordIdentifier sc = new keywordIdentifier();
        sc.keyWord();
        long filePoint = 0;
        String s;
        RandomAccessFile file = new RandomAccessFile("CountTest.java", "r");
        long fileLength = file.length();
        while(filePoint < fileLength) {
            s = file.readLine();
            sc.keyWordCounter(s);
            filePoint = file.getFilePointer();
        }
        file.close();
        
        sc.output();
    }

}

输出:

{abstract=0, assert=0, boolean=0, break=0, byte=0, case=0, catch=0, char=0, class="1", const=0, continue=0, default=0, do=0, double=0, else=0, enum=0, extends=0, final=0, finally=0, float=0, for=0, goto=0, if=0, implements=0, import=1, instanceof=0, int=0, interface=0, long=2, native=0, new=2, package=1, private=0, protected=0, public=2, return=0, short=0, static=1, strictfp=0, super=0, switch=0, synchronized=0, this=0, throw=0, throws=1, transient=0, try=0, void=1, volatile=0, while=1}

 

文本统计器(Java)

标签:util   syn   substr   关键字   inter   color   short   程序   turn   

原文地址:https://www.cnblogs.com/datamining-bio/p/9532925.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!