MooseFS 2.x 在线扩容

---

2015-05-15 by dongnan

环境

操作系统: CentOS 6.6 amd64

配置

ChunkServer: 物理机 4Core CPU/16GB Mem/单磁盘 1TB/1GB NIC
Master: VM 4Core CPU/4GB Mem/100GB Disk/1GB NIC
Client: VM 4Core CPU/4GB Mem/50GB Disk/1GB NIC

IP

master: 172.27.244.69
client: 172.27.244.99
chunk1: 172.27.244.31
chunk2: 172.27.244.32
chunk3: 172.27.244.33
# newK: 172.27.244.28

目标

为 Ｍoosefs 集群添加新的 ChunkServer 扩展集群存储容量。

步骤

安装请参考 moosefs 2.x chunk server

验证

ChunkServer日志

Apr 30 11:59:35 localhost mfschunkserver[1760]: open files limit has been set to: 16384
Apr 30 11:59:35 localhost mfschunkserver[1760]: set gid to 498
Apr 30 11:59:35 localhost mfschunkserver[1760]: set uid to 498
Apr 30 11:59:35 localhost mfschunkserver[1760]: setting glibc malloc arena max to 8
Apr 30 11:59:35 localhost mfschunkserver[1760]: setting glibc malloc arena test to 1
Apr 30 11:59:35 localhost mfschunkserver[1760]: monotonic clock function: clock_gettime
Apr 30 11:59:35 localhost mfschunkserver[1760]: monotonic clock speed: 243425 ops / 10 mili seconds
Apr 30 11:59:35 localhost mfschunkserver[1760]: hdd space manager: folder /mfs/chunk1/ will be scanned
Apr 30 11:59:35 localhost mfschunkserver[1760]: hdd space manager: setting open chunks limit to: 10922
Apr 30 11:59:35 localhost mfschunkserver[1760]: main server module: listen on *:9422
Apr 30 11:59:35 localhost mfschunkserver[1760]: connecting ...
Apr 30 11:59:35 localhost mfschunkserver[1760]: no charts data file - initializing empty charts
Apr 30 11:59:35 localhost mfschunkserver[1760]: connected to Master
Apr 30 11:59:35 localhost mfschunkserver[1760]: scanning folder /mfs/chunk1/: complete (1s)

Master日志

Apr 30 11:59:39 test6 mfsmaster[21404]: csdb: server not found (172.27.244.28:9422,0), add it to database
Apr 30 11:59:39 test6 mfsmaster[21404]: chunkserver register begin (packet version: 6) - ip: 172.27.244.28 / port: 9422, usedspace: 0 (0.00 GiB), totalspace: 0 (0.00 GiB)
Apr 30 11:59:39 test6 mfsmaster[21404]: csdb: generate new server id for (172.27.244.28:9422): 4
Apr 30 11:59:39 test6 mfsmaster[21404]: chunkserver register end (packet version: 6) - ip: 172.27.244.28 / port: 9422

控制面板

Server 项目

Disk 项目

小结

对于应用来说 MooseFS扩容是透明的不需要停止服务，添加 chunkserver 也非常简单，mfs master 将在后台操作一切。