首页 > 代码库 > 带你认识spark安装包的目录结构

带你认识spark安装包的目录结构

 

 

  其实啊,将spark的压缩包解压好,就已经是spark的最简易安装了。

其实啊,想说的是,只要将spark这压缩包解压好,就已经是spark的最简易安装了。

 技术分享

[spark@sparksinglenode spark-1.6.1-bin-hadoop2.6]$ ll
total 1408  
drwxr-xr-x. 2 spark spark    4096 Feb 27  2016 bin             (可执行)
-rw-r--r--. 1 spark spark 1343562 Feb 27  2016 CHANGES.txt
drwxr-xr-x. 2 spark spark    4096 Feb 27  2016 conf            (配置文件)
drwxr-xr-x. 3 spark spark    4096 Feb 27  2016 data       (例子里用到的一些数据)
drwxr-xr-x. 3 spark spark    4096 Feb 27  2016 ec2
drwxr-xr-x. 3 spark spark    4096 Feb 27  2016 examples     (自带的例子一些源代码) 
drwxr-xr-x. 2 spark spark    4096 Feb 27  2016 lib          (jar包)
-rw-r--r--. 1 spark spark   17352 Feb 27  2016 LICENSE
drwxr-xr-x. 2 spark spark    4096 Feb 27  2016 licenses
-rw-r--r--. 1 spark spark   23529 Feb 27  2016 NOTICE
drwxr-xr-x. 6 spark spark    4096 Feb 27  2016 python
drwxr-xr-x. 3 spark spark    4096 Feb 27  2016 R         
-rw-r--r--. 1 spark spark    3359 Feb 27  2016 README.md      (包含一些入门的spark说明)
-rw-r--r--. 1 spark spark     120 Feb 27  2016 RELEASE
drwxr-xr-x. 2 spark spark    4096 Feb 27  2016 sbin        (集群启停,因为spark有自带的集群环境)
[spark@sparksinglenode spark-1.6.1-bin-hadoop2.6]$ pwd
/usr/local/spark/spark-1.6.1-bin-hadoop2.6
[spark@sparksinglenode spark-1.6.1-bin-hadoop2.6]$

 

 

 

技术分享

[spark@sparksinglenode bin]$ pwd
/usr/local/spark/spark-1.6.1-bin-hadoop2.6/bin
[spark@sparksinglenode bin]$ ll
total 92
-rwxr-xr-x. 1 spark spark 1099 Feb 27  2016 beeline
-rw-r--r--. 1 spark spark  932 Feb 27  2016 beeline.cmd
-rw-r--r--. 1 spark spark 1910 Feb 27  2016 load-spark-env.cmd
-rw-r--r--. 1 spark spark 2143 Feb 27  2016 load-spark-env.sh
-rwxr-xr-x. 1 spark spark 3459 Feb 27  2016 pyspark
-rw-r--r--. 1 spark spark 1486 Feb 27  2016 pyspark2.cmd
-rw-r--r--. 1 spark spark 1000 Feb 27  2016 pyspark.cmd
-rwxr-xr-x. 1 spark spark 2384 Feb 27  2016 run-example
-rw-r--r--. 1 spark spark 2682 Feb 27  2016 run-example2.cmd
-rw-r--r--. 1 spark spark 1012 Feb 27  2016 run-example.cmd
-rwxr-xr-x. 1 spark spark 2858 Feb 27  2016 spark-class
-rw-r--r--. 1 spark spark 2365 Feb 27  2016 spark-class2.cmd
-rw-r--r--. 1 spark spark 1010 Feb 27  2016 spark-class.cmd
-rwxr-xr-x. 1 spark spark 1049 Feb 27  2016 sparkR
-rw-r--r--. 1 spark spark 1010 Feb 27  2016 sparkR2.cmd
-rw-r--r--. 1 spark spark  998 Feb 27  2016 sparkR.cmd
-rwxr-xr-x. 1 spark spark 3026 Feb 27  2016 spark-shell
-rw-r--r--. 1 spark spark 1528 Feb 27  2016 spark-shell2.cmd
-rw-r--r--. 1 spark spark 1008 Feb 27  2016 spark-shell.cmd
-rwxr-xr-x. 1 spark spark 1075 Feb 27  2016 spark-sql
-rwxr-xr-x. 1 spark spark 1050 Feb 27  2016 spark-submit
-rw-r--r--. 1 spark spark 1126 Feb 27  2016 spark-submit2.cmd
-rw-r--r--. 1 spark spark 1010 Feb 27  2016 spark-submit.cmd
[spark@sparksinglenode bin]$ 

 

带你认识spark安装包的目录结构