码迷,mamicode.com
首页 > 数据库 > 详细

[原创]MongoDB综合实例二

时间:2015-04-30 17:46:25      阅读:327      评论:0      收藏:0      [点我收藏+]

标签:

MongoDB-Sharding部署方案

一、    部署环境

  1. 五台主机:
    1. Amongoshard01:  10.212.74.43
    2. Amongoshard02:  10.212.84.4
    3. Amongoshard03:  10.212.98.23
    4. Amongoshard04:  10.212.46.5
    5. Amongoshard05:  10.212.70.21
  2. 安装;
    1. CentOS 6.5系统
    2. mongodb-linux-x86_64-rhel62-3.0.2.tgz

二、    部署方案

方案目标是搭建两个shard(shard1和shard2)实现数据分片,每个shard分别由一个副本集(一主两从一仲裁)组成。Amongoshard01主机开启27017和30000端口作为shard11和mongos实例端口;Amongoshard02开启27017、27018、27019和30000端口作为shard12、shard13、config和mongos实例端口;Amongoshard03主机开启27017和30000端口作为shard21和mongos实例端口;Amongoshard04开启27017、27018、27019和30000端口作为shard22、shard23、config和mongos实例端口;Amongoshard05开启端口27017、27018、27019作为shard14、shard24和config实例端口。

         Shard11(主写操作:priority为2)、shard12(从读操作:priority为1)、shard13(仲裁)和shard14(从备份:priority为0)组成一个副本集shard1作为一个分片shard1;shard21(主写操作:priority为2)、shard22(从读操作:priority为1)、shard23(仲裁)和shard24(从备份:priority为0)组成另一个副本集shard2作为另一个分片shard2。实例部署如下:

           1)Amongoshard01上:

      Shard11:10.212.74.43:27017

        Mongos :10.212.74.43:30000

              2)Amongoshard02上:

                 Shard12: 10.212.84.4:27017

                 Shard13: 10.212.84.4:27018

                 Config: 10.212.84.4:27019

                 Mongos: 10.212.84.4:30000

           3)Amongoshard03上:

      Shard21:10.212.98.23:27017

      Mongos :10.212.98.23:30000

              4)Amongoshard04上:

                 Shard22:10.212.46.5:27017

                 Shard23: 10.212.46.5:27018

                 Config: 10.212.46.5:27019

                 Mongos: 10.212.46.5:30000

     5)Amongoshard05上:

          Shard14:10.212.70.21:27017

            Shard24:10.212.70.21:27018

            Config:10.212.70.21:27019

总概况如下图所示:

 技术分享

该部署方案可实现数据的读写分离和备份容灾。Config放在不同主机上或者独立,仲裁机和从机放在一起或独立,无论哪台主机当机均能提供服务。

三、    部署实现

  1. mongodb的安装:

 Amongoshard01(10.212.74.43 )

--#cd /opt/software

--#tar -zxvf mongodb-linux-x86_64-rhel62-3.0.2.tgz

--#mv mongodb-linux-x86_64-rhel62-3.0.2 /opt/mongodb3.2

--#useradd mongodb

--#chmod -R mongodb.mongodb /data/mongodb

--#su - mongodb

--$mkdir -p /data/mongodb/data/shard11

Amongoshard02(10.212.84.4 )

--#cd /opt/software

--#tar -zxvf mongodb-linux-x86_64-rhel62-3.0.2.tgz

--#mv mongodb-linux-x86_64-rhel62-3.0.2 /opt/mongodb3.2

--#useradd mongodb

--#chmod -R mongodb.mongodb /data/mongodb

--#su - mongodb

--$mkdir -p /data/mongodb/data/shard12

--$mkdir -p /data/mongodb/data/shard13

--$mkdir -p /data/mongodb/data/config

Amongoshard03(10.212.98.23 )

--#cd /opt/software

--#tar -zxvf mongodb-linux-x86_64-rhel62-3.0.2.tgz

--#mv mongodb-linux-x86_64-rhel62-3.0.2 /opt/mongodb3.2

--#useradd mongodb

--#chmod -R mongodb.mongodb /data/mongodb

--#su - mongodb

--$mkdir -p /data/mongodb/data/shard21

Amongoshard04(10.212.46.5 )

--#cd /opt/software

--#tar -zxvf mongodb-linux-x86_64-rhel62-3.0.2.tgz

--#mv mongodb-linux-x86_64-rhel62-3.0.2 /opt/mongodb3.2

--#useradd mongodb

--#chmod -R mongodb.mongodb /data/mongodb

--#su - mongodb

--$mkdir -p /data/mongodb/data/shard22

--$mkdir -p /data/mongodb/data/shard23

--$mkdir -p /data/mongodb/data/config

Amongoshard05(10.212.70.21 )

--#cd /opt/software

--#tar -zxvf mongodb-linux-x86_64-rhel62-3.0.2.tgz

--#mv mongodb-linux-x86_64-rhel62-3.0.2 /opt/mongodb3.2

--#useradd mongodb

--#chmod -R mongodb.mongodb /data/mongodb

--#su - mongodb

--$mkdir -p /data/mongodb/data/shard14

--$mkdir -p /data/mongodb/data/shard24

--$mkdir -p /data/mongodb/data/config

2.mongodb的配置:

Amongoshard01(10.212.74.43 )

--$vi shard11.conf

shardsvr = true

replSet = shard1

port = 27017

dbpath = /data/mongodb/data/shard11

oplogSize = 100

logpath = /data/mongodb/data/shard11.log

logappend = true

maxConns = 10000

pidfilepath = /data/mongodb/data/shard11.pid

bind_ip = 10.212.74.43

rest = true

fork = true

noprealloc = true

directoryperdb = true

Amongoshard02(10.212.84.4 )

--$vi shard12.conf

shardsvr = true

replSet = shard1

port = 27017

dbpath = /data/mongodb/data/shard12

oplogSize = 100

logpath = /data/mongodb/data/shard12.log

logappend = true

maxConns = 10000

pidfilepath = /data/mongodb/data/shard12.pid

bind_ip = 10.212.84.4

rest = true

fork = true

noprealloc = true

directoryperdb = true

--$vi shard13.conf

shardsvr = true

replSet = shard1

port = 27018

dbpath = /data/mongodb/data/shard13

oplogSize = 100

logpath = /data/mongodb/data/shard13.log

logappend = true

maxConns = 10000

pidfilepath = /data/mongodb/data/shard13.pid

bind_ip = 10.212.84.4

rest = true

fork = true

noprealloc = true

directoryperdb = true

--$vi configsvr.conf

dbpath = /data/mongodb/data/config

logpath = /data/mongodb/data/config.log

logappend = true

bind_ip = 10.212.84.4

port = 27019

fork = true

Amongoshard03(10.212.98.23 )

--$vi shard21.conf

shardsvr = true

replSet = shard2

port = 27017

dbpath = /data/mongodb/data/shard21

oplogSize = 100

logpath = /data/mongodb/data/shard21.log

logappend = true

maxConns = 10000

pidfilepath = /data/mongodb/data/shard21.pid

bind_ip = 10.212.98.23

rest = true

fork = true

noprealloc = true

directoryperdb = true

Amongoshard04(10.212.46.5 )

--$vi shard22.conf

shardsvr = true

replSet = shard2

port = 27017

dbpath = /data/mongodb/data/shard22

oplogSize = 100

logpath = /data/mongodb/data/shard22.log

logappend = true

maxConns = 10000

pidfilepath = /data/mongodb/data/shard22.pid

bind_ip = 10.212.46.5

rest = true

fork = true

noprealloc = true

directoryperdb = true

--$vi shard23.conf

shardsvr = true

replSet = shard2

port = 27018

dbpath = /data/mongodb/data/shard23

oplogSize = 100

logpath = /data/mongodb/data/shard23.log

logappend = true

maxConns = 10000

pidfilepath = /data/mongodb/data/shard23.pid

bind_ip = 10.212.46.5

rest = true

fork = true

noprealloc = true

directoryperdb = true

--$vi configsvr.conf

dbpath = /data/mongodb/data/config

logpath = /data/mongodb/data/config.log

logappend = true

bind_ip = 10.212.46.5

port = 27019

fork = true

Amongoshard05(10.212.70.21 )

--$vi shard14.conf

shardsvr = true

replSet = shard1

port = 27017

dbpath = /data/mongodb/data/shard14

oplogSize = 100

logpath = /data/mongodb/data/shard14.log

logappend = true

maxConns = 10000

pidfilepath = /data/mongodb/data/shard14.pid

bind_ip = 10.212.70.21

rest = true

fork = true

noprealloc = true

directoryperdb = true

--$vi shard24.conf

shardsvr = true

replSet = shard2

port = 27018

dbpath = /data/mongodb/data/shard24

oplogSize = 100

logpath = /data/mongodb/data/shard24.log

logappend = true

maxConns = 10000

pidfilepath = /data/mongodb/data/shard24.pid

bind_ip = 10.212.70.21

rest = true

fork = true

noprealloc = true

directoryperdb = true

--$vi configsvr.conf

dbpath = /data/mongodb/data/config

logpath = /data/mongodb/data/config.log

logappend = true

bind_ip = 10.212.70.21

port = 27019

fork = true

3.mongodb的启动:

Amongoshard01(10.212.74.43 )

--$cd /data/mongodb/bin

--./mongod -shardsvr -f /data/mongodb/data/shard11.conf

--./mongos -configdb 10.212.84.4:27019,10.212.46.5:27019,10.212.70.21:27019 -port 30000 -chunkSize 5 -logpath /data/mongodb/data/mongos.log -logappend -fork

Amongoshard02(10.212.84.4 )

--$cd /data/mongodb/bin

--./mongod -shardsvr -f /data/mongodb/data/shard12.conf

--./mongod -shardsvr -f /data/mongodb/data/shard13.conf

--./mongod -configsvr -f /data/mongodb/data/config.conf

--./mongos -configdb 10.212.84.4:27019,10.212.46.5:27019,10.212.70.21:27019 -port 30000 -chunkSize 5 -logpath /data/mongodb/data/mongos.log -logappend -fork

Amongoshard03(10.212.98.23 )

--$cd /data/mongodb/bin

--./mongod -shardsvr -f /data/mongodb/data/shard21.conf

--./mongos -configdb 10.212.84.4:27019,10.212.46.5:27019,10.212.70.21:27019 -port 30000 -chunkSize 5 -logpath /data/mongodb/data/mongos.log -logappend -fork

Amongoshard04(10.212.46.5 )

--$cd /data/mongodb/bin

--./mongod -shardsvr -f /data/mongodb/data/shard22.conf

--./mongod -shardsvr -f /data/mongodb/data/shard23.conf

--./mongod -configsvr -f /data/mongodb/data/config.conf

--./mongos -configdb 10.212.84.4:27019,10.212.46.5:27019,10.212.70.21:27019 -port 30000 -chunkSize 5 -logpath /data/mongodb/data/mongos.log -logappend -fork

Amongoshard05(10.212.70.21 )

--$cd /data/mongodb/bin

--./mongod -shardsvr -f /data/mongodb/data/shard14.conf

--./mongod -shardsvr -f /data/mongodb/data/shard24.conf

--./mongod -configsvr -f /data/mongodb/data/config.conf

4.初始化副本集:

第一个副本集:

--#su - monogdb

--$cd /data/mongodb/bin

--$./mongo 10.212.74.43:27017

>use admin

>config={_id:‘shard1‘,members:[{_id:0,host:‘10.212.74.43:27017‘,priority:2},{_id:1,host:‘10.212.84.4:27017‘,priority:1},{_id:2,host:‘10.212.84.4:27018‘,arbiterOnly:true},{_id:3,host:‘10.212.70.21:27017‘,priority:0}]};

>rs.initiate(config)

Shard1:PRIMARY>rs.status()

第二个副本集:

--#su - monogdb

--$cd /data/mongodb/bin

--$./mongo 10.212.74.43:27017

>use admin

>config={_id:‘shard2‘,members:[{_id:0,host:‘10.212.98.23:27017‘,priority:2},{_id:1,host:‘10.212.46.5:27017‘,priority:1},{_id:2,host:‘10.212.46.5:27018‘,arbiterOnly:true},{_id:3,host:‘10.212.70.21:27018‘,priority:0}]};

>rs.initiate(config)

Shard2:PRIMARY>rs.status()

5.配置sharding:

Login到任意一台mongos机器上:

--#su - monogdb

--$cd /data/mongodb/bin

--$./mongo 10.212.74.43:30000/admin

mongos>db.runCommand( { addshard : "shard1/10.212.74.43:27017,10.212.84.4:27017,10.212.84.4:27018,10.212.70.21:27017",name:"shard1",maxsize:2048000});

mongos>db.runCommand( { addshard : "shard2/10.212.98.23:27017,10.212.46.5:27017,10.212.46.5:27018,10.212.70.21:27018",name:"shard2",maxsize:2048000});

mongos>db.runCommand({listshards:1})

6.数据库分片以及Collection分片:

--#su - monogdb

--$cd /data/mongodb/bin

--$./mongo 10.212.74.43:30000/admin

mongos>db.runCommand( { enablesharding : “<dbname>” } );

mongos> db.runCommand( { shardcollection : “<namespace>”,key : <shardkeypatternobject> });

注意:

--数据库中不同的collection将被存放在不同的shard上;

--一个collection仍旧存放在同一个shard上,要使单个collection也分片,还需单独对collection作些操作;

--分片的collection系统会自动创建一个索引(也可用户提前创建好);

--分片的collection只能有一个在分片key上的唯一索引,其它唯一索引不被允许

四、    测试与总结

使用for(i=1;i<=100000;i++){db.test.insert({_id:i})}语句对环境进行测试并查看分片情况。

部署时遇到的问题及解决方法:

问题1:如果在从机上查看数据时出现不能查看错误时,则在从机上执行命令:db.getMongo().setSlave0k()。再查询就可以了。Mongodb3.0以上版本的使用db.getMongo().setSlave0k()或rs.slaveOk()之后退出再次登录时还是会出现此错误,需要编辑文件:#vi ~/.mongorc.js添加rs.slaveOk();即可。

问题2:配置sharding后需注意maxSize值得指定,若发现数据开始可以分片后来不行则可能是数据储存超出maxSize的大小,调整之后即可。maxSize值(单位是M)表示一个shard可使用的磁盘大小,超出的数据不会分片但会存储在primary sharding上。使用一下语句指定或更改其大小:

第一种:

>db.runCommand({addshard:”shardIP:port”,maxSize:20480})

第二种:

>use config

>db.shards.update({_id:”[shardname]”},{$set:{maxSize:20480}})

 

[原创]MongoDB综合实例二

标签:

原文地址:http://www.cnblogs.com/wsjhk/p/4469317.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!