gitlab 的安装使用以及数据结构

安装

环境：

• CentOS6.5
• 基于 nignx + unicorn 搭建的应用环境， 如果想要换成passenger，可以参考网上的文档
• ruby环境是基于rbenv搭建的

1: install vim

yum install -y vim

2: install git > 1.7.10

• install git

$ rpm -i ‘http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.3-1.el6.rf.x86_64.rpm‘$ rpm --import http://apt.sw.be/RPM-GPG-KEY.dag.txt$ vim /etc/yum.repos.d/rpmforge.repo  # 将[rpmforge-extras] 下的enabled = 0 => enabled = 1$ yum install -y git$ git --versiongit version 1.7.12.4$ yum clean all

reference: http://tecadmin.net/how-to-upgrade-git-version-1-7-10-on-centos-6/#

• git config

git config --global user.name ‘jerry‘git config --global user.email ‘jerrery520@gmail.com‘git config --global color.branch ‘auto‘git config --global color.diff ‘auto‘git config --global color.interactive ‘auto‘git config --global color.interactive ‘auto‘git config --global core.editor ‘/usr/bin/vim‘

3: install dependent rpm

• first: replace yum repo

rpm -Uvh http://mirrors.sohu.com/fedora-epel/6/i386/epel-release-6-8.noarch.rpm

• second: install

yum install -y gcc-c++ patch readline readline-devel zlib zlib-devel libyaml libyaml-devel libffi libffi-devel openssl-devel make bzip2 autoconf automake libtool bison iconv-devel git-core libxml libxml-devel libxslt libxslt-devel wget pcre-devel openssl openssl-devel tcl tcl-devel libaio-devel ntpdate libicu-devel

4: install rbenv && Ruby

• add users: git

adduser --comment ‘GitLab‘ --create-home --home-dir /home/git git

• use rbenv-installer install rbenv

cd /home/git/sudo -u git sh -c "curl https://raw.github.com/fesplugas/rbenv-installer/master/bin/rbenv-installer > rbenv-installer"su - git -c ‘/bin/bash rbenv-installer‘sudo -u git -H echo ‘export RBENV_ROOT="${HOME}/.rbenv"if [ -d "${RBENV_ROOT}" ]; then  export PATH="${RBENV_ROOT}/bin:${PATH}"  eval "$(rbenv init -)"fi‘ >> /home/git/.bashrc

• install Ruby

su - git -c ‘rbenv install 2.0.0-p353‘su - git -c ‘rbenv global 2.0.0-p353‘

• install bundler

su - git -c ‘gem install bundler --no-ri --no-rdoc‘

5: install gitlab

• install gitlab shell

sudo -u git -H git clone https://gitlab.com/gitlab-org/gitlab-shell.gitcd gitlab-shellsudo -u git -H cp config.yml.example config.yml# 注：将下面的 your_git_domain替换成你的域名sudo -u git -H sed -i ‘s/localhost/your_git_domain/g‘ config.ymlsu - git -c ‘/home/git/gitlab-shell/bin/install‘

• install mysql, redis, nginx

refer: http://blog.58share.com/?p=291

• install gitlab

cd /home/gitsudo -u git -H git clone https://gitlab.com/gitlab-org/gitlab-ce.git -b 6-6-stable gitlabcd /home/git/gitlabsudo -u git -H cp config/gitlab.yml.example config/gitlab.yml# Make sure to change "localhost" to the fully-qualified domain name of your# If you installed Git from source, change the git bin_path to /usr/local/bin/git# 这里修改host(域名), email_from: (邮件)， support_email（邮件）sudo -u git -H vim config/gitlab.ymlchown -R git log/chown -R git tmp/chmod -R u+rwX  log/chmod -R u+rwX  tmp/sudo -u git -H mkdir /home/git/gitlab-satellitessudo -u git -H mkdir tmp/pids/sudo -u git -H mkdir tmp/sockets/chmod -R u+rwX  tmp/pids/chmod -R u+rwX  tmp/sockets/sudo -u git -H mkdir public/uploadschmod -R u+rwX  public/uploadssudo -u git -H cp config/unicorn.rb.example config/unicorn.rb# Ex. change amount of workers to 3 for 2GB RAM serversudo -u git -H vim config/unicorn.rbsudo -u git -H cp config/initializers/rack_attack.rb.example config/initializers/rack_attack.rbsudo -u git -H git config --global user.name "GitLab"sudo -u git -H git config --global user.email "jerrery520@gmail.com"sudo -u git -H git config --global core.autocrlf input# mysqlsudo -u git cp config/database.yml.mysql config/database.yml# 修改配置文件 config/database.yml

• install gem

su - gitcd /home/git/gitlab# NOTES: RAM must be > 512M if your mysql onbundle install --deployment --without development test postgres aws# 确认数据库配置正确# 创建数据库bundle exec rake db:create RAILS_ENV=production# 初始化gitlab数据 NOTES: need redisbundle exec rake gitlab:setup RAILS_ENV=production# 这里会执行清空数据库的操作，第一次请输入 yes# install scriptcp lib/support/init.d/gitlab /etc/init.d/gitlab

• start server

/etc/init.d/gitlab start

• check env

# 检测gitlab执行的环境bundle exec rake gitlab:env:info RAILS_ENV=production# 检测gitlab所依赖的东西bundle exec rake gitlab:check RAILS_ENV=production

• 编译静态文件配置nginx配置

# 编译静态文件bundle exec rake assets:precompile RAILS_ENV=production#　配置nginx# 注意： nginx的配置的用户为 git cp lib/support/nginx/gitlab /usr/local/nginx/conf/conf.d/gitlab.conf

• 绑定host

vim /etc/hosts127.0.0.1 your_domain

• 部署成功

按照上面的部署：最终部署成功后： 访问域名# that‘s all# username: admin@local.host# password: 5iveL!fe# 第一次进入后，需要重设密码，设置成功后部署成功

• 安装文档refer:

http://www.digitalsanctuary.com/tech-blog/general/installing-gitlab-on-redhat-enterprise-5-rhel-5.html

https://gitlab.com/gitlab-org/gitlab-ce/blob/6-6-stable/doc/install/installation.md

将gitolite迁移到gitlab步骤

1. 初始化mysql 配置

bundle exec rake gitlab:setup RAILS_ENV=production

初始化后：即可以登陆超级管理员账户：

username: admin@local.host password: 5iveL!fe

2. 将现有的项目导入到gitlab中

bundle exec rake gitlab:import:repos RAILS_ENV=production

3. 获取root的api密钥token 并写如客户端配置并执行api相关操作

• 创建用户并塞入对应的 ssh-key， 新创建的用户无创建分组的权限。
• 获取已经创建的 分组， 并根据分组，将用户写入不同的分组中
• 将admin 管理员加入所有的分组中, 手动将对应的用户设置为管理员，并允许创建分组
• 有邮箱的用户操作，涉及到线上数据库的更新，线上测试机器的拉取，手动创建虚拟用户并添加对应的权限

  线下机器是没有push权限的，设置为Reporter

• 合并人员需要设置为master 针对该项目
• 管理员账户，并修改他们对应的权限控制以及创建的项目数

4. 写脚本将所有通过api创建的用户的确认状态修改为已确认状态，并在项目下执行操作

$ vim lib/task/gitlab/user.rake

namespace :gitlab do  desc "Update all users‘confirmed is true"  task :update_confirmed => :environment do.     User.find_each do |user|       user.confirmation_token = nil       user.confirmed_at = Time.now       user.save     end  endend

执行操作

bundle exec rake gitlab:updateconfirmed RAILSENV=production

其他的相关配置

• 配置smtp 邮件服务

cd /home/git/gitlab

$ vim config/environments/production.rb

  config.action_mailer.delivery_method       = :smtp  config.action_mailer.perform_deliveries    = true  config.action_mailer.raise_delivery_errors = true  config.action_mailer.smtp_settings = {    :address              => ‘smtp.exmail.qq.com‘,    :port                 => 465,    :domain               => ‘qq.com‘,    :user_name            => ‘email_address‘,    :password             => ‘password‘,    :authentication       =>  :plain,    :enable_starttls_auto => true  }

• 配置ldap

cd /home/git/gitlab

$ vim config/gitlab.yml

  ldap:    enabled: true    host: your_ldap_host    base: ‘ou=Accounts,dc=domain,dc=com‘    port: your_port    uid: ‘uid‘    method: ‘plain‘ # "tls" or "ssl" or "plain"    bind_dn: ‘cn=binder,dc=domain,dc=com‘    password: ‘your_password‘    allow_username_or_email_login: true  # 是否允许使用username或者email登陆，设置为false,登陆入口只会显示ldap入口

NOTES: 迁移项目遇到的坑

1. 通过接口获取用户数据，默认只能获取20条， 可以分页，每页最多100条数据

2. 通过接口获取项目，默认只能获取20条

3. 如果是迁移项目，若以前的git项目是有多层级接口，需要修正为一层，比如 java/abc/aaa.git => java/abc_aaa.git, 因为gitlab是不支持多层级结构的

4. 项目创建中有些带有关键字的项目是不能创建成功的，比如 java/admin.git , ruby/services.git

5. gitlab clone项目无论是ssh, http 都会调用http请求，通过http请求判断用户的权限等操作。而我们的http请求是做了ldap访问权限设置的，因此需要对将本机（gitlab服务器）的IP加入ldap的白名单中

相关命令参考

• 将现有的项目导入到gitlab中去

bundle exec rake gitlab:import:repos RAILS_ENV=production

* 添加所有的用户到所有的分组中（admin的角色是owner）

bundle exec rake gitlab:import:all_users_to_all_groups RAILS_ENV=production

* 添加所有的用户到所有的项目中（admin的角色是master）

bundle exec rake gitlab:import:all_users_to_all_projects RAILS_ENV=production

* 添加一个特殊的用户到所有的分组中（角色为developer）

bundle exec rake gitlab:import:user_to_groups[email] RAILS_ENV=production

* 添加一个特殊的用户到所有的项目中（角色为developer）

bundle exec rake gitlab:import:user_to_projects[email] RAILS_ENV=production

## gitlab 其他相关参考 #### API相关 如果gitlab中有你的公钥，你就可以通过authentication_token来调用api

curl --header "PRIVATE-TOKEN: ArTMXVSWjFEYn9DQrL7f" "http://git.tuan800-inc.com/api/v3/user/keys"

gitlab api gem

refere: https://github.com/NARKOZ/gitlab

问题： 这个gem包的接口是v2的，但是gitlab 现在稳定版的是 V3了，但是部分功能能用，有些接口中描述的功能是需要自己去写的

other helps

refer：http://mrk1869.com/blog/gitlab_installation/

git升级解决方案

How to Upgrade Git version >= 1.7.10 on CentOS 6

refer：http://tecadmin.net/how-to-upgrade-git-version-1-7-10-on-centos-6/#

git clone项目时报无环境变量

refer：http://thoughtpointers.net/2013/04/18/using-rbenv-with-gitlab-shell-on-os-x/

git push error

test [master] % ggpushCounting objects: 3, done.Writing objects: 100% (3/3), 229 bytes | 0 bytes/s, done.Total 3 (delta 0), reused 0 (delta 0)remote: GitLab: An unexpected error occurred (redis-cli returned 127).remote: error: hook declined to update refs/heads/masterTo git@git.58share.com:huhongda/test.git ! [remote rejected] master -> master (hook declined)error: failed to push some refs to ‘git@git.58share.com:huhongda/test.git‘

解决： 修改 gitlab-shell/config/gitlab.yml 中的redis-cli 的路径为正确的路径

#### 检测gitlab运行环境是否正确bundle exec rake gitlab:check RAILS_ENV=production#### errorsAll migrations up? ... rake aborted!Cannot allocate memory - git log --pretty=format:‘%h‘ -n 1/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/core_ext/kernel/agnostics.rb:7:in ``‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/core_ext/kernel/agnostics.rb:7:in ``‘/home/git/gitlab/config/initializers/2_app.rb:3:in `‘/home/git/gitlab/config/initializers/2_app.rb:1:in `‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:223:in `load‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:223:in `block in load‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:214:in `load_dependency‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:223:in `load‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/engine.rb:609:in `block (2 levels) in ‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/engine.rb:608:in `each‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/engine.rb:608:in `block in ‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:30:in `instance_exec‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:30:in `run‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:55:in `block in run_initializers‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:44:in `each‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:44:in `tsort_each_child‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:54:in `run_initializers‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/application.rb:215:in `initialize!‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/railtie/configurable.rb:30:in `method_missing‘/home/git/gitlab/config/environment.rb:5:in `‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:229:in `require‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:229:in `block in require‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:214:in `load_dependency‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:229:in `require‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/application.rb:189:in `require_environment!‘/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/application.rb:250:in `block in run_tasks_blocks‘Tasks: TOP => db:migrate:status => environment(See full trace by running task with --trace)

解决： 是由于缺少内存导致的，如果用的是vps的话，用free -m 看看是否是内存太少，或者是没有使用swap内存，如果没有swap，需要加swap，一般是内存的1倍或者1.5倍

# 加swapmkdir -p /data/swapdircd /data/swapdirdd if=/dev/zero of=swapfile bs=1024  count=1024000mkswap /data/swapdir/swapfileswapon swapfile  # 开启swapswapoff swapfile # 关闭swap# 可以使用free -m 查看内存情况# 加入开启重启echo ‘/data/swapdir/swapfile  swap  swap defaults 0 0‘ >> /etc/fstab

Reference

http://mrk1869.com/blog/gitlab_installation/ http://www.digitalsanctuary.com/tech-blog/general/installing-gitlab-on-redhat-enterprise-5-rhel-5.html https://gitlab.com/gitlab-org/gitlab-ce/blob/6-6-stable/doc/install/installation.md http://git.58share.com/help/api/README

this is a project for gitlab api

https://github.com/NARKOZ/gitlab

https://github.com/gitlabhq/gitlabhq/blob/master/doc/api/groups.md

This entry was posted in git, linux