码迷,mamicode.com
首页 > Web开发 > 详细

大数据新手之路二:安装Flume

时间:2018-03-05 20:46:23      阅读:237      评论:0      收藏:0      [点我收藏+]

标签:col   localhost   name   一个   console   oca   buffers   sink   esc   

WIN7+Ubuntu16.04+Flume1.8.0

 

1.下载apache-flume-1.8.0-bin.tar.gz

http://flume.apache.org/download.html

 

2.解压到/usr/local/flume中

 

3.设置配置文件/etc/profile文件,增加flume的路径

①vi /etc/profile

export FLUME_HOME=/usr/local/flume
export PATH=$PATH:$FLUME_HOME/bin

②让配置文件立即生效

source /etc/profile

 

4.检查flume环境是否生效

flume-ng version

 

5.在/etc/local/flume/conf中增加一个example.conf文件

# example.conf: A single-node Flume configuration

# Name the components on this agent
a1.sources = r1
a1.sinks = k1
a1.channels = c1

# Describe/configure the source
a1.sources.r1.type = netcat
a1.sources.r1.bind = localhost
a1.sources.r1.port = 44444

# Describe the sink
a1.sinks.k1.type = logger

# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

 

6.启动flume

flume-ng agent --conf /usr/local/flume/conf --conf-file /usr/local/flume/conf/example.conf --name a1 -Dflume.root.logger=INFO,console

 

7.使用telnet连接到flume并发送数据

$ telnet localhost 44444
Trying 127.0.0.1...
Connected to localhost.localdomain (127.0.0.1).
Escape character is ^].
Hello world! <ENTER>
OK

 

8.在flume的进程中可以看到如下信息

[INFO - org.apache.flume.sink.LoggerSink.process(LoggerSink.java:95)] Event: { headers:{} body: 48 65 6C 6C 6F 20 57 6F 72 6C 64 21 0D          Hello World!. }

 

以上。

 

大数据新手之路二:安装Flume

标签:col   localhost   name   一个   console   oca   buffers   sink   esc   

原文地址:https://www.cnblogs.com/chevin/p/8510735.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!