Zookeeper的单机部署安装以及常用命令使用

简介

Zookeeper是一个开源的分布式应用程序协调服务，作为 Google Chubby 的一个开源实现，是Hadoop和Hbase的重要组件，Zookeeper的目标是封装好复杂易出错的关键服务，暴漏简单易用、高效、稳定的接口给用户，提供java和C接口。

设计目标

简单

ZooKeeper 允许分布式的进程之间通过一个共享的层级命名空间(hierarchinal namespace, 和文件系统类似)进行协调。 ZK 实现了高性能、高可用和严格顺序访问, 是的它可以用于大规模分布式系统, 无单点故障问题, 和复杂的同步原语。

复制的（replicated）

Zookeeper ZooKeeper 和其它的分布式进程一样, 也是一个集群的主机作为一个整体。组成 ZooKeeper 服务的所有服务器必须指向相互之间的存在, 并在内存中维护一张状态图和事务日志, 以及永久储存的快照。只要服务器中的一个多数(majority)保持可用, ZooKeeper 就可以继续提供服务。客户端连接到一个单一的(single) ZooKeeper 服务器, 通过 TCP 连接来发送请求、获取响应、观察的事件和发送心跳。如果 TCP 连接断开了, 客户端则连接到其它服务器。

有序（ordered）

Zookeeper用一个数字表示每一次的更新，以反应所有Zookeeper事务的顺序。后续可以利用这个顺序来实现诸如同步原语之类的高级抽象。

快速（fast）

Zookeeper在读多写少的负载中性能尤其高，读写比例大概处于 10:1 时表现最好。

安装

下载资源包

进入官网下载对应版本的资源包。

1

wget https://www.apache.org/dyn/closer.lua/zookeeper/zookeeper-3.9.3/apache-zookeeper-3.9.3-bin.tar.gz

安装

下载完成后解压文件

1

tar -zxvf apache-zookeeper-3.9.3-bin.tar.gz -C /var/local/

解压完成后会生成一个目录，目录名称为apache-zookeeper-3.9.3，进入conf目录，将zoo_sample.cfg文件复制一份命名为zoo.cfg

1
2


cd conf
cp zoo_sample.cfg zoo.cfg

编辑zoo.cfg文件，修改如下配置

1
2
3
4
5
6
7
8


# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
# 数据存储目录，可以修改为当前 zookeeper 的安装目录下新建 `data`目录。
dataDir=/var/local/zookeeper/data 
# the port at which the clients will connect
# 客户端连接端口，启动客户端时需要用到。
clientPort=2181 

启动 server，在根目录下执行启动命令

1

./bin/zkServer.sh start

输出日志：

1
2
3
4


/usr/bin/java
ZooKeeper JMX enabled by default
Using config: /var/local/zookeeper/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED

启动成功

1

 ./bin/zkCli.sh -server 127.0.0.1:2181

输出日志：

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36


/usr/bin/java
Connecting to 127.0.0.1:2181
2024-12-04 13:34:36,405 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:zookeeper.version=3.9.3-c26634f34490bb0ea7a09cc51e05ede3b4e320ee, built on 2024-10-17 23:21 UTC
2024-12-04 13:34:36,408 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:host.name=982-dev.
2024-12-04 13:34:36,409 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:java.version=11.0.25
2024-12-04 13:34:36,409 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:java.vendor=Ubuntu
2024-12-04 13:34:36,409 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:java.home=/usr/lib/jvm/java-11-openjdk-amd64
2024-12-04 13:34:36,409 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:java.class.path=/var/local/zookeeper/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/classes:/var/local/zookeeper/bin/../zookeeper-server/target/classes:/var/local/zookeeper/bin/../build/classes:/var/local/zookeeper/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/lib/*.jar:/var/local/zookeeper/bin/../zookeeper-server/target/lib/*.jar:/var/local/zookeeper/bin/../build/lib/*.jar:/var/local/zookeeper/bin/../lib/zookeeper-prometheus-metrics-3.9.3.jar:/var/local/zookeeper/bin/../lib/zookeeper-jute-3.9.3.jar:/var/local/zookeeper/bin/../lib/zookeeper-3.9.3.jar:/var/local/zookeeper/bin/../lib/snappy-java-1.1.10.5.jar:/var/local/zookeeper/bin/../lib/slf4j-api-1.7.30.jar:/var/local/zookeeper/bin/../lib/simpleclient_servlet-0.9.0.jar:/var/local/zookeeper/bin/../lib/simpleclient_hotspot-0.9.0.jar:/var/local/zookeeper/bin/../lib/simpleclient_common-0.9.0.jar:/var/local/zookeeper/bin/../lib/simpleclient-0.9.0.jar:/var/local/zookeeper/bin/../lib/netty-transport-native-unix-common-4.1.113.Final.jar:/var/local/zookeeper/bin/../lib/netty-transport-native-epoll-4.1.113.Final-linux-x86_64.jar:/var/local/zookeeper/bin/../lib/netty-transport-classes-epoll-4.1.113.Final.jar:/var/local/zookeeper/bin/../lib/netty-transport-4.1.113.Final.jar:/var/local/zookeeper/bin/../lib/netty-tcnative-classes-2.0.66.Final.jar:/var/local/zookeeper/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final.jar:/var/local/zookeeper/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-windows-x86_64.jar:/var/local/zookeeper/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-osx-x86_64.jar:/var/local/zookeeper/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-osx-aarch_64.jar:/var/local/zookeeper/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-linux-x86_64.jar:/var/local/zookeeper/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-linux-aarch_64.jar:/var/local/zookeeper/bin/../lib/netty-resolver-4.1.113.Final.jar:/var/local/zookeeper/bin/../lib/netty-handler-4.1.113.Final.jar:/var/local/zookeeper/bin/../lib/netty-common-4.1.113.Final.jar:/var/local/zookeeper/bin/../lib/netty-codec-4.1.113.Final.jar:/var/local/zookeeper/bin/../lib/netty-buffer-4.1.113.Final.jar:/var/local/zookeeper/bin/../lib/metrics-core-4.1.12.1.jar:/var/local/zookeeper/bin/../lib/logback-core-1.2.13.jar:/var/local/zookeeper/bin/../lib/logback-classic-1.2.13.jar:/var/local/zookeeper/bin/../lib/jline-2.14.6.jar:/var/local/zookeeper/bin/../lib/jetty-util-ajax-9.4.56.v20240826.jar:/var/local/zookeeper/bin/../lib/jetty-util-9.4.56.v20240826.jar:/var/local/zookeeper/bin/../lib/jetty-servlet-9.4.56.v20240826.jar:/var/local/zookeeper/bin/../lib/jetty-server-9.4.56.v20240826.jar:/var/local/zookeeper/bin/../lib/jetty-security-9.4.56.v20240826.jar:/var/local/zookeeper/bin/../lib/jetty-io-9.4.56.v20240826.jar:/var/local/zookeeper/bin/../lib/jetty-http-9.4.56.v20240826.jar:/var/local/zookeeper/bin/../lib/javax.servlet-api-3.1.0.jar:/var/local/zookeeper/bin/../lib/jackson-databind-2.15.2.jar:/var/local/zookeeper/bin/../lib/jackson-core-2.15.2.jar:/var/local/zookeeper/bin/../lib/jackson-annotations-2.15.2.jar:/var/local/zookeeper/bin/../lib/commons-io-2.17.0.jar:/var/local/zookeeper/bin/../lib/commons-cli-1.5.0.jar:/var/local/zookeeper/bin/../lib/audience-annotations-0.12.0.jar:/var/local/zookeeper/bin/../zookeeper-*.jar:/var/local/zookeeper/bin/../zookeeper-server/src/main/resources/lib/*.jar:/var/local/zookeeper/bin/../conf:
2024-12-04 13:34:36,409 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:java.library.path=/usr/java/packages/lib:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2024-12-04 13:34:36,410 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:java.io.tmpdir=/tmp
2024-12-04 13:34:36,410 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:java.compiler=<NA>
2024-12-04 13:34:36,410 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:os.name=Linux
2024-12-04 13:34:36,410 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:os.arch=amd64
2024-12-04 13:34:36,410 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:os.version=5.15.167.4-microsoft-standard-WSL2
2024-12-04 13:34:36,410 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:user.name=root
2024-12-04 13:34:36,411 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:user.home=/root
2024-12-04 13:34:36,411 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:user.dir=/var/local/zookeeper
2024-12-04 13:34:36,411 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:os.memory.free=235MB
2024-12-04 13:34:36,411 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:os.memory.max=256MB
2024-12-04 13:34:36,411 [myid:] - INFO  [main:o.a.z.Environment@98] - Client environment:os.memory.total=250MB
2024-12-04 13:34:36,413 [myid:] - INFO  [main:o.a.z.ZooKeeper@637] - Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@2fd66ad3
2024-12-04 13:34:36,421 [myid:] - INFO  [main:o.a.z.c.X509Util@88] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2024-12-04 13:34:36,535 [myid:] - INFO  [main:o.a.z.c.X509Util@110] - Default TLS protocol is TLSv1.3, supported TLS protocols are [TLSv1.3, TLSv1.2, TLSv1.1, TLSv1, SSLv3, SSLv2Hello]
2024-12-04 13:34:36,540 [myid:] - INFO  [main:o.a.z.ClientCnxnSocket@235] - jute.maxbuffer value is 1048575 Bytes
2024-12-04 13:34:36,546 [myid:] - INFO  [main:o.a.z.ClientCnxn@1748] - zookeeper.request.timeout value is 0. feature enabled=false
Welcome to ZooKeeper!
2024-12-04 13:34:36,579 [myid:127.0.0.1:2181] - INFO  [main-SendThread(127.0.0.1:2181):o.a.z.ClientCnxn$SendThread@1171] - Opening socket connection to server localhost/127.0.0.1:2181.
2024-12-04 13:34:36,580 [myid:127.0.0.1:2181] - INFO  [main-SendThread(127.0.0.1:2181):o.a.z.ClientCnxn$SendThread@1173] - SASL config status: Will not attempt to authenticate using SASL (unknown error)
2024-12-04 13:34:36,590 [myid:127.0.0.1:2181] - INFO  [main-SendThread(127.0.0.1:2181):o.a.z.ClientCnxn$SendThread@1007] - Socket connection established, initiating session, client: /127.0.0.1:55586, server: localhost/127.0.0.1:2181
JLine support is enabled
2024-12-04 13:34:36,637 [myid:127.0.0.1:2181] - INFO  [main-SendThread(127.0.0.1:2181):o.a.z.ClientCnxn$SendThread@1454] - Session establishment complete on server localhost/127.0.0.1:2181, session id = 0x10000fd3d890000, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null zxid: -1
[zk: 127.0.0.1:2181(CONNECTED) 0]

客户端启动成功，进入命令行模式，可以执行各种命令，例如创建节点、列出节点、删除节点等。

客户端常用命令

查看某个路径下目录列表：ls /{path}

1
2


[zk: 127.0.0.1:2181(CONNECTED) 8] ls /
[zookeeper]

创建节点：create /{path} {data}

1
2


[zk: 127.0.0.1:2181(CONNECTED) 9] create /test "hello"
Created /test

查看节点数据：get /{path}

1
2


[zk: 127.0.0.1:2181(CONNECTED) 10] get /test
hello

删除节点：delete /{path}

1
2
3


[zk: 127.0.0.1:2181(CONNECTED) 11] delete /test
[zk: 127.0.0.1:2181(CONNECTED) 12] ls /
[zookeeper]