Keepalived+Nginx+Tomcat+Redis搭建高可用服务SERE0211的博客-

Keepalived+Nginx+Tomcat+Redis搭建高可用服务

Keepalived作用是检测服务器的状态，Nginx的作用是负载均衡，Tomcat提供web应用，redis提供session共享。

一、环境条件

服务器ssh免密码登录配置

ssh-keygen ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.176 ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.177 ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.178 ssh-copy-id -i ~root/.ssh/id_rsa.pub 192.168.10.179 

二、Tomcat服务器配置

1.JDK安装

安装jdk、查看jdk版本

[root@server1 ~]# yum -y install java-1.7.0-openjdk [root@server1 ~]# java -version 

2.SERVER1服务器配置

Tomcat部署比较简单，修改端口启动可以正常访问，开放WEB端口，修改server.xml如下

vim conf/server.xml # 多个Tomcat在同台服务器上需要修改 <Server port="8005" shutdown="SHUTDOWN"> # 修改访问端口 <Connector port="8086" protocol="HTTP/1.1"            connectionTimeout="20000"            redirectPort="8443" /> # 多个Tomcat在同台服务器上需要修改 <Connector port="8009" protocol="AJP/1.3" redirectPort="8443" /> # 配置Engine节点的路由信息，session复制和负载均衡需要用 # 添加jvmRoute="Tomcat01"、每个tomcat都需要修改 <Engine name="Catalina" defaultHost="localhost" jvmRoute="Tomcat01"> # 去掉Cluster注释 <Cluster className="org.apache.catalina.ha.tcp.SimpleTcpCluster"/> 

在访问的项目index.jsp页面加上以下代码

<% HttpSession session = request.getSession(); %> <%= session.getId() %> 

3.SERVER2服务器配置

将配置好的tomcat发送到server2，修改jvmRoute=“Tomcat02”

[root@server1 home]# scp -r apache-tomcat-7.0.53 192.168.3.179:/home/ 

Tomcat没有重启命令，每次修改后还需要关闭再启动，太麻烦，我将关闭和启动整合一下，变成重启，下面是重启脚本，将脚本保存到tomcat/bin/目录，重启直接执行./restart.sh

#!/bin/bash # -*- coding: UTF-8 -*- # Filename: restart.sh # Description: 用于Tomcat重新启动 # Author: SERE  LOGSDIR=../logs ./shutdown.sh &> /dev/null echo -e "33[32mINFO: Tomcat close to finish33[0m" echo -e "33[32mINFO: Now restart tomcat33[0m" nohup ./startup.sh &> /dev/null sleep 1 tail -f $LOGSDIR/catalina.out 

4.测试web应用

分别启动tomcat进行访问

三、Nginx服务器配置

1.Nginx安装

Nginx yum 源地址：
https://nginx.org/packages/centos/

[root@master ~]# yum -y install nginx # nginx -t ：测试配置文件是否有语法错误 [root@master ~]# nginx -v 

2.Master服务器配置

Nginx转发配置

[root@master ~]# vim /etc/nginx/conf.d/cluster.conf  upstream application {     server 192.168.10.178:8086 weight=1;     server 192.168.10.179:8086 weight=1; } server {     listen      8080; # BACKUP改为：192.168.10.177     server_name  192.168.10.176;     location / {         root  /var/www/html;         index  index.php index.html index.htm;         proxy_pass https://application; } } 

测试配置文件是否有语法错误

[root@master ~]# nginx -t [root@master ~]# service nginx restart 

测试负载nginx转发web应用
https://192.168.3.176:8080/application/

3.Backup服务器配置

将nginx转发配置文件发送到backup服务器

[root@master ~]# scp -r /etc/yum.repos.d/nginx.repo 192.168.10.177:/etc/yum.repos.d/ [root@master ~]# scp -r /etc/nginx/conf.d/cluster.conf 192.168.10.177:/etc/nginx/conf.d/ [root@backup ~]# nginx -t [root@backup ~]# service nginx restart 

4.测试负载nginx转发web应用

https://192.168.10.177:8080/application/

四、Redis服务器配置

1.Redis安装

上传jar包到tomcat/lib/目录

[root@server1 ~]# yum -y install redis 

下载地址：
https://github.com/jcoleman/tomcat-redis-session-manager
https://download.csdn.net/download/SERE0211/12527300
找不到私信我

commons-pool2-2.2 jedis-2.5.2 tomcat-redis-session-manager-2.0.0 

2.SERVER1服务器配置

将jar发送server2服务器

[root@server1 lib]# scp -r commons-pool2-2.2.jar jedis-2.5.2.jar tomcat-redis-session-manager-2.0.0.jar 192.168.10.179:/home/tomcat/lib/ 

修改conf/context.xml

[root@server1 lib]# vim ../conf/context.xml # 添加以下内容 <WatchedResource>WEB-INF/web.xml</WatchedResource> <WatchedResource>${catalina.base}/conf/web.xml</WatchedResource> <Valve className="com.orangefunction.tomcat.redissessions.RedisSessionHandlerValve" /> <Manager className="com.orangefunction.tomcat.redissessions.RedisSessionManager"      host="localhost"      port="6379"      database="0"      maxInactiveInterval="60"/> # 一般是从23行开始添加 

修改完成重启

[root@server1 ~]# service redis restart 

3.SERVER2服务器配置

将context.xml发送server2服务器

[root@server1 bin]# scp ../conf/context.xml 192.168.10.179:/home/apache-tomcat-7.0.53/conf/ # 重启tomcat，redis也需要启动，否则访问报错 [root@server2 ~]# service redis restart 

五、Keepalived服务器配置

1.Keepalived安装

[root@master ~]# yum -y install  keepalived 

2.Master服务器配置

[root@master ~]# vim /etc/keepalived/keepalived.conf ! Configuration File for keepalived global_defs {      router_id hostname #机器标识 }  vrrp_instance VI_1 {     state MASTER  #主备状态     interface eth0  #监听网卡     virtual_router_id 51  #虚拟路由id     mcast_src_ip 192.168.10.176  #本机IP地址     priority 100  #权重     nopreempt  #设置不抢占     advert_int 1  #同步检查时间设置     authentication { #认证配置         auth_type PASS  #认证方式         auth_pass 1111  #认证密码 }     track_script {         chk_nginx  #执行Nginx监控的服务# }     virtual_ipaddress { #虚拟IP         192.168.10.110  #虚拟IP池MASTER&&BACKUP, 两个设置必须一样，虚拟ip，可以定义多个 } } 

将master配置好的keepalived.conf发送到backup服务器

[root@master ~] service keepalived restart [root@master ~] scp /etc/keepalived/keepalived.conf 192.168.10.177:/etc/keepalived/keepalived.conf 

3.Backup服务器配置

[root@master ~]# vim /etc/keepalived/keepalived.conf ! Configuration File for keepalived global_defs {      router_id backup #机器标识 }  vrrp_instance VI_1 {     state MASTER  #主备状态     interface eth0  #监听网卡     virtual_router_id 51  #虚拟路由id     mcast_src_ip 192.168.10.177  #本机IP地址     priority 100  #权重     nopreempt  #设置不抢占     advert_int 1  #同步检查时间设置     authentication { #认证配置         auth_type PASS  #认证方式         auth_pass 1111  #认证密码 }     track_script {         chk_nginx  #执行Nginx监控的服务# }     virtual_ipaddress { #虚拟IP         192.168.10.110  #虚拟IP池MASTER&&BACKUP, 两个设置必须一样，虚拟ip，可以定义多个 } } # 我将（# priority 100）master和backup设置的是一样的，当一个节点故障，另个节点自动变成主节点 

4.测试高可用服务

https://192.168.10.110:8080/application

常用命令：
查看本地IP地址：ip addr

五.参考文档

nginx官网：
https://nginx.org/
redis官网：
https://redis.io/
keepalived官网：
https://www.keepalived.org/