码迷,mamicode.com
首页 > 其他好文 > 详细

hadoop第一个例子

时间:2018-06-30 22:22:03      阅读:165      评论:0      收藏:0      [点我收藏+]

标签:input   test   code   config   pat   on()   utils   void   第一个   

Java.io.URL

1、编写java程序

package com.company;
import java.io.IOException;
import java.io.InputStream;
import java.net.MalformedURLException;
import java.net.URL;
import org.apache.hadoop.fs.FsUrlStreamHandlerFactory;
import org.apache.hadoop.io.IOUtils;

public class Main {
    static {
        URL.setURLStreamHandlerFactory(new FsUrlStreamHandlerFactory());
    }

    public static void main(String[] args) throws MalformedURLException,IOException {
        InputStream in=null;
        try{
            in = new URL(args[0]).openStream();
            IOUtils.copyBytes(in,System.out,4096,false);
        }finally {
            IOUtils.closeStream(in);
        }
    }
}

2、打包为javaWrkspace.jar

3、simon@simon-Lenovo-G400:~/software/hadoop$

bin/hadoop jar /home/simon/javaWrkspace/out/artifacts/javaWrkspace_jar/javaWrkspace.jar  hdfs://localhost:9000/test/hello

 

org.apache.hadoop.fs.FileSystem

1、

import java.io.IOException;
import java.io.InputStream;
import java.net.URI;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IOUtils;
public class hdfsclient {
    public static void main(String[] args) throws IOException{
        String uri="hdfs://localhost:9000/test/hello";
        Configuration conf=new Configuration();
        FileSystem fs = FileSystem.get(URI.create(uri),conf);
        InputStream in=null;
        try{
            in = fs.open(new Path(uri));
            IOUtils.copyBytes(in,System.out,4096,false);
        }finally {
            IOUtils.closeStream(in);
        }
    }
}

2、打包为javaWrkspace.jar

3、simon@simon-Lenovo-G400:~/software/hadoop$

bin/hadoop jar /home/simon/javaWrkspace/out/artifacts/javaWrkspace_jar2/javaWrkspace.jar  hdfsclient

hadoop第一个例子

标签:input   test   code   config   pat   on()   utils   void   第一个   

原文地址:https://www.cnblogs.com/ggzhangxiaochao/p/9248796.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!