首页 > 代码库 > Rhel6-tomcat+nginx+memcached配置文档

Rhel6-tomcat+nginx+memcached配置文档

理论基础:

User - > web ->nginx  ->tomcat1 ->*.jsp

                          80          8080

                           ↓      -> tomcat2

                        html    -> tomcat3

用户通过web访问网页,默认访问的是80端口,即访问nginx。由于nginx只支持静态网页,如果用户访问的是类似*.jsp的动态网页,需要通过应用服务器tomcat先进行处理。tomcat相当与一个媒介,将动态网页经过处理之后交给nginx,最终返回给用户。

nginx后端的tomcat可以实现负载均衡,但是为了防止用户在访问过程出现类似下列情况:

访问登录页面时,帐号密码输入完成后,按下一步后马上又弹出一个登录界面

需要给nginx添加sticky模块,使得对于来自同一个用户的请求始终交给同一个tomcat处理

192.168.0.1 -> tomcat1

192.168.0.2 ->tomcat2 根据IP进行负载均衡

 

为了防止当用户在访问注册页面时,当用户填写注册信息到一半时,服务器宕机,当用户按“下一步”之后,用户之前提交的资料全部消失了,需要结合memcached来解决此问题。

 

         nginx

             |

       T1      T2

         | \     / |

         |    \/   |

         |    /\   |

         |  /    \ |

      M1       M2

交叉式存储,完美解决单点故障的问题

1号机子上有两个服务 T1和 M1

2号机子上有两个服务 T2 和 M2

 

默认的T1的数据往M2中存,T2的数据往M1中存,防止单点故障。

当T1服务挂掉之后,由T2接管,T2从M2中取得之前T1存在M2上的数据,之后提交的数据继续往M2上存(注:如果此时开启了另一个请求由T2接管,数据默认的往M1上存,而不是M2)

接着如果连M2也挂掉了,但是由于T2是正常工作的,T2会将M2上所有的数据取出,并存到M1中,使得用户提交的数据仍然存在,不会丢失。

 

当1号机子挂掉后,T2存在M1上的数据将丢失

 

配置:

系统环境: rhel6 x86_64 iptables and selinux disabled

主机: n1:192.168.122.185:nginx tomcat memcached server85.example.com

n2:192.168.122.117:tomcat memcached server17.example.com

相关网址: rpm.pbone.net tomcat.apache.org

 

所需的包:memcache-2.2.5.tgz memcached-1.4.15.tar.gz libevent-devel-1.4.13-4.el6.x86_64.rpm libevent-doc-1.4.13-4.el6.noarch.rpm libevent-headers-1.4.13-4.el6.noarch.rpm webbench-1.5.tar.gz jdk-6u32-linux-x64.bin apache-tomcat-7.0.37.tar.gznginx-sticky-module-1.0.tar.gz asm-3.2.jar kryo-1.04.jar kryo-serializers-0.10.jar memcached-session-manager-1.6.3.jar memcached-session-manager-tc7-1.6.3.jar minlog-1.2.jar msm-kryo-serializer-1.6.3.jar reflectasm-1.01.jar spymemcached-2.7.3.jar

 

1.安装memcached

[root@server85 kernel]# tar zxf memcache-2.2.5.tgz

[root@server85 kernel]# cd memcache-2.2.5

[root@server85 memcache-2.2.5]# phpize

[root@server85 memcache-2.2.5]# ./configure

[root@server85 memcache-2.2.5]# make && make install

[root@server85 memcache-2.2.5]# vim /usr/local/lnmp/php/etc/php.ini

extension=memcache.so

[root@server85 memcache-2.2.5]# /etc/init.d/php-fpm reload

 

[root@server85 kernel]# tar zxf memcached-1.4.15.tar.gz

[root@server85 kernel]# cd memcached-1.4.15

[root@server85 memcached-1.4.15]# ./configure

此时会出现以下错误:

checking for libevent directory... configure: error: libevent is required. You can get it fromhttp://www.monkey.org/~provos/libevent/

 

解决方法如下:

[root@server85 memcached-1.4.15]# yum install libevent

[root@server85 kernel]# rpm -ivh libevent-*

注:libevent-*包含:libevent-devel-1.4.13-4.el6.x86_64.rpm libevent-doc-1.4.13-4.el6.noarch.rpm libevent-headers-1.4.13-4.el6.noarch.rpm

 

[root@server85 memcached-1.4.15]# make && make install

 

[root@server85 ~]# memcached -m 50M -d -u root (若不制定大小默认64M,每次最大不超过2G)

[root@server85 ~]# ps ax

6106 ? Ssl 0:00 memcached -m 50M -d -u root

[root@server85 ~]# netstat -antple

tcp 0 0 0.0.0.0:11211 0.0.0.0:* LISTEN 0 12791 6106/memcached

出现类似上方的内容表示安装成功.

[root@server85 kernel]# cd memcache-2.2.5/

[root@server85 memcache-2.2.5]# cp memcache.php /usr/local/lnmp/nginx/html/

[root@server85 memcache-2.2.5]# vim /usr/local/lnmp/nginx/html/memcache.php

define(‘ADMIN_PASSWORD‘,‘westos‘); // Admin Password

#$MEMCACHE_SERVERS[] = ‘mymemcache-server1:11211‘;

$MEMCACHE_SERVERS[] = ‘192.168.122.185:11211‘;

[root@server85 memcache-2.2.5]# nginx -s reload

访问server85.example.com/memcache.php:

 

 

 

进行压力测试:

[root@server85 kernel]# tar zxf webbench-1.5.tar.gz

[root@server85 kernel]# cd webbench-1.5

[root@server85 webbench-1.5]# make

此时会出现以下错误:

/bin/sh: ctags: command not found

 

解决方法如下:

[root@server85 webbench-1.5]# yum install ctags -y

[root@server85 webbench-1.5]# make clean

 

[root@server85 webbench-1.5]# make install

[root@server85 ~]# webbench -c 500 -t 10 http://192.168.122.185/memcache.php

Webbench - Simple Web Benchmark 1.5

Copyright (c) Radim Kolar 1997-2004, GPL Open Source Software.

 

Benchmarking: GET http://server85.example.com/memcache.php

500 clients, running 10 sec.

 

Speed=20442 pages/min, 102477 bytes/sec.

Requests: 3407 susceed, 0 failed.

或者访问server85.example.com/status:

 

 

2.安装tomcat

[root@server85 kernel]# chmod +x jdk-6u32-linux-x64.bin

[root@server85 kernel]# ./jdk-6u32-linux-x64.bin

[root@server85 kernel]# mv jdk1.6.0_32/ /usr/local/jdk

[root@server85 kernel]# vim /etc/profile

export JAVA_HOME=/usr/local/jdk

export CLASSPATH=:$JAVA_HOME/lib

export PATH=$PATH:$JAVA_HOME/bin

[root@server85 kernel]# source /etc/profile

执行echo $PATH能看到/usr/local/jdk/bin说明已生效.

 

[root@server85 ~]# vim test.java

public class test{

public static void main(String[] agre) {

System.out.println("Hello World!");

}

}

[root@server85 ~]# javac test.java

[root@server85 ~]# java test

打印出Hello World!说明安装成功!

 

[root@server85 kernel]# tar zxf apache-tomcat-7.0.37.tar.gz -C /usr/local/

[root@server85 kernel]# cd /usr/local/

[root@server85 local]# mv apache-tomcat-7.0.37/ tomcat

[root@server85 local]# cd tomcat/bin/

[root@server85 bin]# ./startup.sh

[root@server85 bin]# netstat -antple

tcp 0 0 :::8080 :::* LISTEN 0 57982 7465/java

查看到8080端口说明启动成功.

访问server85.example.com:8080出现如下页面说明tomcat正常.

[root@server85 bin]# cd /usr/local/tomcat/webapps/ROOT/

[root@server85 ROOT]# vim test.jsp

the time is: <%=new java.util.Date() %>

访问server85.example.com:8080/test.jsp出现如下页面为正常.

[root@server85 ROOT]# vim /usr/local/lnmp/nginx/conf/nginx.conf

location ~ \.jsp$ {

proxy_pass http://127.0.0.1:8080;

} (访问*.jsp时候交给8080端口处理)

[root@server85 ROOT]# nginx -s reload

 

 

以下步骤在server85上实施:

[root@server85 kernel]# tar zxf nginx-sticky-module-1.0.tar.gz

[root@server85 kernel]# tar zxf nginx-1.2.7.tar.gz

[root@server85 kernel]# cd nginx-1.2.7

[root@server85 nginx-1.2.7]# vim src/core/nginx.h

#define NGINX_VER "nginx"

[root@server85 nginx-1.2.7]# vim auto/cc/gcc

# debug

#CFLAGS="$CFLAGS -g"

[root@server85 nginx-1.2.7]# ./configure --prefix=/usr/local/lnmp/nginx/ --with-http_ssl_module --with-http_stub_status_module –add-module=/root/kernel/nginx-sticky-module-1.0

[root@server85 nginx-1.2.7]# make && make install

[root@server85 nginx-1.2.7]# vim /usr/local/lnmp/nginx/conf/nginx.conf

http {

upstream koen{

sticky;

server 192.168.122.185:8080;

server 192.168.122.117:8080;

}

server {

listen 80;

server_name server85.example.com;

location ~ \.jsp$ {

proxy_pass http://koen;

}

}

}

[root@server85 nginx-1.2.7]# nginx -s stop

[root@server85 nginx-1.2.7]# nginx

[root@server85 nginx-1.2.7]# memcached -d -u root

[root@server85 nginx-1.2.7]# cd /usr/local/tomcat/webapps/ROOT/

[root@server85 ROOT]# vim test.jsp

<%@ page contentType="text/html; charset=GBK" %>

<%@ page import="java.util.*" %>

<html><head><title>Cluster App Test</title></head>

<body>

Server Info:

<%

out.println(request.getLocalAddr() + " : " + request.getLocalPort()+"<br>");%>

<%

out.println("<br> ID " + session.getId()+"<br>");

String dataName = request.getParameter("dataName");

if (dataName != null && dataName.length() > 0) {

String dataValue = http://www.mamicode.com/request.getParameter("dataValue");

session.setAttribute(dataName, dataValue);

}

out.print("<b>Session list</b>");

Enumeration e = session.getAttributeNames();

while (e.hasMoreElements()) {

String name = (String)e.nextElement();

String value = http://www.mamicode.com/session.getAttribute(name).toString();

out.println( name + " = " + value+"<br>");

System.out.println( name + " = " + value);

}

%>

<form action="test.jsp" method="POST">

name:<input type=text size=20 name="dataName">

<br>

key:<input type=text size=20 name="dataValue">

<br>

<input type=submit>

</form>

</body>

</html>

[root@server85 ROOT]# cd /usr/local/tomcat/lib/

把如下软件包放置在该目录下:

asm-3.2.jar

kryo-1.04.jar

kryo-serializers-0.10.jar

memcached-session-manager-1.6.3.jar

memcached-session-manager-tc7-1.6.3.jar

minlog-1.2.jar

msm-kryo-serializer-1.6.3.jar

reflectasm-1.01.jar

spymemcached-2.7.3.jar

[root@server85 lib]# vim /usr/local/tomcat/conf/context.xml

<Context>

<Manager className="de.javakaffee.web.msm.MemcachedBackupSessionManager"

memcachedNodes="n1:192.168.122.185:11211,n2:192.168.122.117:11211"

failoverNodes="n1"

requestUriIgnorePattern=".*\.(ico|png|gif|jpg|css|js)$" transcoderFactoryClass="de.javakaffee.web.msm.serializer.kryo.KryoTranscoderFactory"

/>

</Context>

[root@server85 lib]# /usr/local/tomcat/bin/shutdown.sh

[root@server85 lib]# /usr/local/tomcat/bin/startup.sh

 

 

以下步骤在server17上实施:

[root@server17 ~]# memcached -d -u root

[root@server17 ~]# cd /usr/local/tomcat/webapps/ROOT/

[root@server17 ROOT]# vim test.jsp

<%@ page contentType="text/html; charset=GBK" %>

<%@ page import="java.util.*" %>

<html><head><title>Cluster App Test</title></head>

<body>

Server Info:

<%

out.println(request.getLocalAddr() + " : " + request.getLocalPort()+"<br>");%>

<%

out.println("<br> ID " + session.getId()+"<br>");

String dataName = request.getParameter("dataName");

if (dataName != null && dataName.length() > 0) {

String dataValue = http://www.mamicode.com/request.getParameter("dataValue");

session.setAttribute(dataName, dataValue);

}

out.print("<b>Session list</b>");

Enumeration e = session.getAttributeNames();

while (e.hasMoreElements()) {

String name = (String)e.nextElement();

String value = http://www.mamicode.com/session.getAttribute(name).toString();

out.println( name + " = " + value+"<br>");

System.out.println( name + " = " + value);

}

%>

<form action="test.jsp" method="POST">

name:<input type=text size=20 name="dataName">

<br>

key:<input type=text size=20 name="dataValue">

<br>

<input type=submit>

</form>

</body>

</html>

[root@server17 ROOT]# cd /usr/local/tomcat/lib/

把如下软件包放置在该目录下:

asm-3.2.jar

kryo-1.04.jar

kryo-serializers-0.10.jar

memcached-session-manager-1.6.3.jar

memcached-session-manager-tc7-1.6.3.jar

minlog-1.2.jar

msm-kryo-serializer-1.6.3.jar

reflectasm-1.01.jar

spymemcached-2.7.3.jar

[root@server17 lib]# vim /usr/local/tomcat/conf/context.xml

<Context>

<Manager className="de.javakaffee.web.msm.MemcachedBackupSessionManager"

memcachedNodes="n1:192.168.122.185:11211,n2:192.168.122.117:11211"

failoverNodes="n2"

requestUriIgnorePattern=".*\.(ico|png|gif|jpg|css|js)$" transcoderFactoryClass="de.javakaffee.web.msm.serializer.kryo.KryoTranscoderFactory"

/>

</Context>

[root@server17 bin]# /usr/local/tomcat/bin/shutdown.sh

[root@server17 bin]# /usr/local/tomcat/bin/startup.sh

 

测试:

1.存储数据:

2.server85上的m1宕掉然后存入user3

3.重置server85上的m1,存user4

4.server17上的m2宕掉,存user5

5.重置server17上的m2,user6

6.server17上的tomcat关闭,存user7

测试完毕!!!

Rhel6-tomcat+nginx+memcached配置文档