首页 > 代码库 > Cloudera 5.8.2 Installation guide

Cloudera 5.8.2 Installation guide

2024-08-17 20:42:12   219人阅读

Envireronment:

VMware® Workstation 12 Pro 12.0.1 build-3160714(Host: Windows 7 Ultimate)

Centos 6.5 x64

Cloudera 5.8.2

Resource:

  1. Cloudera Manager 5 Requirements and Supported Versions
  2. Installation Path B - Manual Installation Using Cloudera Manager Packages
  3. http://dev.mysql.com/get/Downloads/MySQL-5.7/mysql-5.7.16-linux-glibc2.5-x86_64.tar
  4. http://archive.cloudera.com/cdh5/
  5. CHD5 5.8.2 EL6
    1. CDH-5.8.2-1.cdh5.8.2.p0.3-el6.parcel
    2. CDH-5.8.2-1.cdh5.8.2.p0.3-el6.parcel.sha1
    3. manifest.json
  6. CM RPMS
    1. cloudera-manager-agent-5.8.2-1.cm582.p0.17.el6.x86_64.rpm
    2. cloudera-manager-daemons-5.8.2-1.cm582.p0.17.el6.x86_64.rpm
    3. cloudera-manager-server-5.8.2-1.cm582.p0.17.el6.x86_64.rpm
    4. cloudera-manager-server-db-2-5.8.2-1.cm582.p0.17.el6.x86_64.rpm
    5. enterprise-debuginfo-5.8.2-1.cm582.p0.17.el6.x86_64.rpm
    6. jdk-6u31-linux-amd64.rpm
    7. oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
  7. Repro
    1. cm5.8.2-centos6.tar.gz
    2. cm5.8.2-centos6.tar.gz.md5
    3. cm5.8.2-centos6.tar.gz.sha1

规划

 角色数量内存CPU
namenode120GB1*1 core
datanode32GB1*1 core

 

Envireronment setup：

  • 在VMware中安装4台虚拟机，操作系统为Centos 6.5。
    • nn
    • n1
    • n2
    • n3
  •  网络设置（每台）
    • vi /etc/sysconfig/network
      vi /etc/sysconfig/network-scripts/ifcfg-eth0

      IPADDR=192.168.254.151~154GATEWAY=192.168.254.2DNS1=192.168.254.2
      service iptables stopchkconfig iptables off
      vi /etc/selinux/config

      shutdown -r now
  • 检查
    • hostname
      ifconfig
      getenforce
      service iptables status
      ping cn.pool.ntp.org
      vi /etc/hosts
      192.168.254.151 nn192.168.254.152 n1192.168.254.153 n2192.168.254.154 n3
    • ping n1
      ping n2
      ping n3
  •  系统配置（每台）
    • 配置NTP
    • ntpstatservice ntpd startchkconfig ntpd onwatch ntpq -p
    • SSH免密码
    • ssh-keygen -t rsacat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keyschmod 600 ~/.ssh/authorized_keysscp ~/.ssh/authorized_keys root@n1:~/.ssh/scp ~/.ssh/authorized_keys root@n2:~/.ssh/scp ~/.ssh/authorized_keys root@n3:~/.ssh/

Install CM：

  • NameNode
  • cloudera-manager-agent-5.8.2-1.cm582.p0.17.el6.x86_64.rpmcloudera-manager-daemons-5.8.2-1.cm582.p0.17.el6.x86_64.rpmcloudera-manager-server-5.8.2-1.cm582.p0.17.el6.x86_64.rpmcloudera-manager-server-db-2-5.8.2-1.cm582.p0.17.el6.x86_64.rpmenterprise-debuginfo-5.8.2-1.cm582.p0.17.el6.x86_64.rpmjdk-6u31-linux-amd64.rpmoracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpmcloudera-manager-installer.bin
    yum localinstall --nogpgcheck *.rpm
  • DataNode
  • cloudera-manager-agent-5.8.2-1.cm582.p0.17.el6.x86_64.rpmcloudera-manager-daemons-5.8.2-1.cm582.p0.17.el6.x86_64.rpm
    jdk-6u31-linux-amd64.rpmoracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
    yum localinstall --nogpgcheck *.rpm
    vi /etc/cloudera-scm-agent/config.ini
    server_host=nn
  • Download CDH parcels and manifest.json from https://archive.cloudera.com/cdh5/parcels/
  • mkdir /tmp/parcelcp /home/admin/Downloads/CDH-5.5.2-1.cdh5.5.2.p0.4-el7.parcel /tmp/parcel/cp /home/admin/Downloads/ manifest.json /tmp/parcel/
  • python -m SimpleHTTPServer 8900
  • http://n1:7180/
  • 设置Parcels远程目录为http://192.168.254.151:8900
  • 检查（所有主机）
  • echo never > /sys/kernel/mm/transparent_hugepage/defragecho 0 > /proc/sys/vm/swappiness
  • 安装结束

Cloudera 5.8.2 Installation guide


联系
我们