varnish4杂记（1）

标签：varnish4 基础 杂记

varnish4使用

1、安装varnish4

[root@master1 ~]# yum install -y varnish

1.1 内存回收模块

Name        : jemalloc
Arch        : x86_64
Version     : 3.6.0
Release     : 1.el7
Size        : 317 k
Repo        : installed
From repo   : ali-epel
Summary     : General-purpose scalable concurrent malloc implementation
URL         : http://www.canonware.com/jemalloc/
License     : BSD
Description : General-purpose scalable concurrent malloc(3) implementation.
            : This distribution is the stand-alone "portable" implementation of
            : jemalloc.

[root@master1 ~]# 

1.2 查看服务启动文件

[root@master1 ~]# cat /usr/lib/systemd/system/varnish.service

2、修改服务器启动配置选项

[root@master1 ~]# vim /etc/varnish/varnish.params 

#VARNISH_STORAGE="malloc,256M"
VARNISH_STORAGE="malloc,256M"       #修改缓存方式

3、配置另一台web服务器（节点2）

[root@master2 ~]# yum -y install httpd

配置测试页：
[root@master2 ~]# for i in {1..10}; do echo "Page $i on Web1" > /var/www/html/test$i.html;done
[root@master2 ~]# ls /var/www/html/
test10.html  test2.html  test4.html  test6.html  test8.html
test1.html   test3.html  test5.html  test7.html  test9.html
[root@master2 ~]# 

启动服务：
[root@master2 ~]# systemctl start httpd

设置开机启动：
[root@master2 ~]# systemctl enable httpd
Created symlink from /etc/systemd/system/multi-user.target.wants/httpd.service to /usr/lib/systemd/system/httpd.service.
[root@master2 ~]# 
[root@master2 ~]# systemctl is-enabled httpd
enabled
[root@master2 ~]# 

4、配置varnish的acl后端主机文件

# Default backend definition. Set this to point to your content server.
backend default {
    .host = "10.201.106.132";       跳转到web2
    .port = "80";
}

开启varnish服务：
[root@master1 ~]# systemctl start varnish.service

varnish：6081,6082
[root@master1 ~]# ss -tnl
State       Recv-Q Send-Q                                      Local Address:Port                                                     Peer Address:Port              
LISTEN      0      50                                                      *:3306                                                                *:*                  
LISTEN      0      128                                                     *:22                                                                  *:*                  
LISTEN      0      100                                             127.0.0.1:25                                                                  *:*                  
LISTEN      0      128                                                     *:6081                                                                *:*                  
LISTEN      0      10                                              127.0.0.1:6082                                                                *:*                  
LISTEN      0      128                                                    :::22                                                                 :::*                  
LISTEN      0      100                                                   ::1:25                                                                 :::*                  
LISTEN      0      128                                                    :::6081                                                               :::*                  
[root@master1 ~]# 

访问测试：
http://10.201.106.131:6081/test9.html
正常

5、varnishadm

5.1 查看缓存命中结果

连进去：
[root@master1 ~]# varnishadm -S /etc/varnish/secret -T 127.0.0.1:6082 
200        
-----------------------------
Varnish Cache CLI 1.0
-----------------------------
Linux,3.10.0-327.el7.x86_64,x86_64,-smalloc,-smalloc,-hcritbit
varnish-4.0.4 revision 386f712

Type ‘help‘ for command list.
Type ‘quit‘ to close CLI session.

ping
200        
PONG 1484619827 1.0
status
200        
Child in state running
vcl.list
200        
active          0 boot

vcl.load test default.vcl
200        
VCL compiled.
vcl.list
200        
active          0 boot
available       0 test

vcl.use test
200        
VCL ‘test‘ now active
vcl.use t
varnish> vcl .list
101        
Unknown request.
Type ‘help‘ for more info.

vcl.list
200        
active          0 boot
available       0 test

vcl.discard test
200        

vcl.list
200        
active          0 boot

5.2 查看当前参数值

Type ‘help‘ for more info.

param.show

设置参数值：
param.set thread_pools 4

显示单个参数：
param.show thread_pools
200        
thread_pools
        Value is: 4 [pools]
        Default is: 2
        Minimum is: 1

查看进程上次挂掉原因
panic.show
300        
Child has not panicked or panic has been cleared

显示正在使用的存储：
varnish> storage.list
200        
Storage devices:
    storage.Transient = malloc
    storage.s0 = malloc

显示配置文件编译前的样子：
vcl.show boot

查看后端服务器列表：
varnish> backend.list
200        
Backend name                   Refs   Admin      Probe
default(10.201.106.132,,80)    1      probe      Healthy (no probe)

列出定义的ban规则，（缓存对象清除规则）
varnish> ban.list
200        
Present bans:
1484618521.742461     0 C  

6、显示varnish日志

[root@master1 ~]# varnishlog 

7、另一种日志格式

[root@master1 ~]# varnishncsa 
10.201.106.1 - - [17/Jan/2017:21:19:42 +0800] "GET http://10.201.106.131:6081/test1.html HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.106 Safari/537.36"

8、查看状态和排序

[root@master1 ~]# varnishstat 

[root@master1 ~]# varnishtop

配置vcl

1、备份vcl，配置备份的vcl

[root@master1 ~]# cd /etc/varnish/
[root@master1 varnish]# cp default.vcl test.vcl
[root@master1 varnish]# vim test.vcl 

2、编辑配置文件

[root@master1 varnish]# vim test.vcl 

sub vcl_recv {
    # Happens before we check if we have this in cache already.
    #
    # Typically you clean up the request here, removing cookies you don‘t need,
    # rewriting the request, etc.
    if (req.method == "PRI") {
        /* We do not support SPDY or HTTP/2.0 */
        return (synth(405));
    }
    if (req.method != "GET" &&
        req.method != "HEAD" &&
        req.method != "PUT" &&
        req.method != "POST" &&
        req.method != "TRACE" &&
        req.method != "OPTIONS" &&
        req.method != "DELETE") {
            /* Non-RFC2616 or CONNECT which is weird. */
            return (pipe);
    }

    if (req.method != "GET" && req.method != "HEAD") {
        /* We only deal with GET and HEAD by default */
        return (pass);
    }
    if (req.http.Authorization || req.http.Cookie) {
        /* Not cacheable by default */
        return (pass);
    }
    return (hash);
}

3、vcl装载新配置文件

连入vcl：
[root@master1 varnish]# varnishadm -S /etc/varnish/secret -T 127.0.0.1:6082

装载配置文件：
vcl.load test1 test.vcl
200        
VCL compiled.

查看：
vcl.list
200        
active          0 boot
available       0 test1

使用test1，使其生效：
vcl.use test1
200        
VCL ‘test1‘ now active

查看test1配置：
vcl.show test1
200        
#
# This is an example VCL file for Varnish.
#
# It does not do anything by default, delegating control to the
# builtin VCL. The builtin VCL is called when there is no explicit
# return statement.
#
# See the VCL chapters in the Users Guide at https://www.varnish-cache.org/docs/
# and http://varnish-cache.org/trac/wiki/VCLExamples for more examples.

# Marker to tell the VCL compiler that this VCL has been adapted to the
# new 4.0 format.
vcl 4.0;

# Default backend definition. Set this to point to your content server.
backend default {
    .host = "10.201.106.132";
    .port = "80";
}

sub vcl_recv {
    # Happens before we check if we have this in cache already.
    #
    # Typically you clean up the request here, removing cookies you don‘t need,
    # rewriting the request, etc.
    if (req.method == "PRI") {
    /* We do not support SPDY or HTTP/2.0 */
    return (synth(405));
    }
    if (req.method != "GET" &&
    req.method != "HEAD" &&
    req.method != "PUT" &&
    req.method != "POST" &&
    req.method != "TRACE" &&
    req.method != "OPTIONS" &&
    req.method != "DELETE") {
        /* Non-RFC2616 or CONNECT which is weird. */
        return (pipe);
    }

    if (req.method != "GET" && req.method != "HEAD") {
    /* We only deal with GET and HEAD by default */
    return (pass);
    }
    if (req.http.Authorization || req.http.Cookie) {
    /* Not cacheable by default */
    return (pass);
    }
    return (hash);
}

sub vcl_backend_response {
    # Happens after we have read the response headers from the backend.
    #
    # Here you clean the response headers, removing silly Set-Cookie headers
    # and other mistakes your backend does.
}

sub vcl_deliver {
    # Happens when we have all the pieces we need, and are about to send the
    # response to the client.
    #
    # You can do accounting or modifying the final object here.
}

4、deliver测试

4.1 自定义命中响应内容

sub vcl_deliver {
    # Happens when we have all the pieces we need, and are about to send the
    # response to the client.
    #
    # You can do accounting or modifying the final object here.
    if (obj.hits>0) {
        set resp.http.X-Cache = "HIT";
    } else {
        set resp.http.X-Cache = "MISS";
    }
}

4.2 重新载入激活配置文件

载入文件
vcl.load test2 test.vcl
200        
VCL compiled.

查看配置文件列表
vcl.list
200        
available       0 boot
active          0 test1
available       0 test2

激活使用配置文件
vcl.use test2
200        
VCL ‘test2‘ now active

4.3 测试

curl测试：
[root@node1 ~]# curl http://10.201.106.131:6081/test3.html
Page 3 on Web1

curl只响应首部：
[root@node1 ~]# curl -I http://10.201.106.131:6081/test3.html
HTTP/1.1 200 OK
Date: Tue, 17 Jan 2017 20:05:02 GMT
Server: Apache/2.4.6 (CentOS)
Last-Modified: Mon, 16 Jan 2017 21:28:25 GMT
ETag: "f-5463cdd1ee54f"
Content-Length: 15
Content-Type: text/html; charset=UTF-8
X-Varnish: 131079 131075
Age: 38
Via: 1.1 varnish-v4
X-Cache: HIT                            #已命中
Connection: keep-alive

[root@node1 ~]# 

4.4 第一次请求网页MISS，第二次就HIT了

[root@node1 ~]# curl -I http://10.201.106.131:6081/test4.html
HTTP/1.1 200 OK
Date: Tue, 17 Jan 2017 20:06:33 GMT
Server: Apache/2.4.6 (CentOS)
Last-Modified: Mon, 16 Jan 2017 21:28:25 GMT
ETag: "f-5463cdd1ee54f"
Content-Length: 15
Content-Type: text/html; charset=UTF-8
X-Varnish: 23
Age: 0
Via: 1.1 varnish-v4
X-Cache: MISS               ###
Connection: keep-alive

[root@node1 ~]# curl -I http://10.201.106.131:6081/test4.html
HTTP/1.1 200 OK
Date: Tue, 17 Jan 2017 20:06:33 GMT
Server: Apache/2.4.6 (CentOS)
Last-Modified: Mon, 16 Jan 2017 21:28:25 GMT
ETag: "f-5463cdd1ee54f"
Content-Length: 15
Content-Type: text/html; charset=UTF-8
X-Varnish: 131081 24
Age: 6
Via: 1.1 varnish-v4
X-Cache: HIT                    ###
Connection: keep-alive

[root@node1 ~]# 

5、添加server.ip

5.1 修改配置

sub vcl_deliver {
    # Happens when we have all the pieces we need, and are about to send the
    # response to the client.
    #
    # You can do accounting or modifying the final object here.
    if (obj.hits>0) {
        set resp.http.X-Cache = "HIT from " + server.ip;
    } else {
        set resp.http.X-Cache = "MISS " + server.ip;
    }
}

5.2 装载激活配置文件

vcl.load test3 test.vcl
200        
VCL compiled.
vcl.use test3
200        
VCL ‘test3‘ now active

5.3 测试

root@node1 ~]# curl -I http://10.201.106.131:6081/test1.html
HTTP/1.1 200 OK
Date: Tue, 17 Jan 2017 20:41:33 GMT
Server: Apache/2.4.6 (CentOS)
Last-Modified: Mon, 16 Jan 2017 21:28:25 GMT
ETag: "f-5463cdd1ee54f"
Content-Length: 15
Content-Type: text/html; charset=UTF-8
X-Varnish: 26
Age: 0
Via: 1.1 varnish-v4
X-Cache: MISS 10.201.106.131            ###
Connection: keep-alive

[root@node1 ~]# curl -I http://10.201.106.131:6081/test1.html
HTTP/1.1 200 OK
Date: Tue, 17 Jan 2017 20:41:33 GMT
Server: Apache/2.4.6 (CentOS)
Last-Modified: Mon, 16 Jan 2017 21:28:25 GMT
ETag: "f-5463cdd1ee54f"
Content-Length: 15
Content-Type: text/html; charset=UTF-8
X-Varnish: 163844 27
Age: 24
Via: 1.1 varnish-v4
X-Cache: HIT from 10.201.106.131            ###
Connection: keep-alive

[root@node1 ~]# 

varnish4杂记（1）

标签：varnish4 基础 杂记

原文地址：http://blog.51cto.com/zhongle21/2087361