±à¼ÍƼö: |
±¾ÎÄÖ÷Òª½éÉÜÁËZeppelin¿ÉÒÔʵÏÖʲô£¬ÌØÐÔ¼°ZeppelinµÄ°²×°²¿Êð¡£
±¾ÎÄÀ´×Ôcsdn£¬ÓÉ»ðÁú¹ûÈí¼þAnna±à¼¡¢ÍƼö¡£ |
|
Zeppelin½éÉÜ
Apache ZeppelinÌṩÁËweb°æµÄÀàËÆipythonµÄnotebook£¬ÓÃÓÚ×öÊý¾Ý·ÖÎöºÍ¿ÉÊÓ»¯¡£±³ºó¿ÉÒÔ½ÓÈ벻ͬµÄÊý¾Ý´¦ÀíÒýÇæ£¬°üÀ¨spark,
hive, tajoµÈ£¬ÔÉúÖ§³Öscala, java, shell, markdownµÈ¡£ËüµÄÕûÌåÕ¹ÏÖºÍʹÓÃÐÎʽºÍDatabricks
CloudÊÇÒ»ÑùµÄ£¬¾ÍÊÇÀ´×ÔÓÚµ±Ê±µÄdemo¡£
Zeppelin¿ÉʵÏÖÄãËùÐèÒªµÄ£º
- Êý¾Ý²É¼¯
- Êý¾Ý·¢ÏÖ
- Êý¾Ý·ÖÎö
- Êý¾Ý¿ÉÊÓ»¯ºÍÐ×÷
Ö§³Ö¶àÖÖÓïÑÔ£¬Ä¬ÈÏÊÇscala(±³ºóÊÇspark shell)£¬SparkSQL,
Markdown ºÍ Shell¡£

ÉõÖÁ¿ÉÒÔÌí¼Ó×Ô¼ºµÄÓïÑÔÖ§³Ö¡£ÈçºÎдһ¸özeppelin½âÊÍÆ÷
ZeppelinÌØÐÔ
Apache Spark ¼¯³É
Zeppelin ÌṩÁËÄÚÖÃµÄ Apache Spark ¼¯³É¡£Äã²»ÐèÒªµ¥¶À¹¹½¨Ò»¸öÄ£¿é¡¢²å¼þ»òÕ߿⡣
ZeppelinµÄSpark¼¯³ÉÌṩÁË£º
- ×Ô¶¯ÒýÈëSparkContext ºÍ SQLContext
- ´Ó±¾µØÎļþϵͳ»òmaven¿âÔØÈëÔËÐÐʱÒÀÀµµÄjar°ü¡£¸ü¶à¹ØÓÚÒÀÀµÔØÈëÆ÷
- ¿ÉÈ¡Ïûjob ºÍ չʾjob½ø¶È
Êý¾Ý¿ÉÊÓ»¯
һЩ»ù±¾µÄͼ±íÒѾ°üº¬ÔÚZeppelinÖС£¿ÉÊÓ»¯²¢²»Ö»ÏÞÓÚSparkSQL²éѯ£¬ºó¶ËµÄÈκÎÓïÑÔµÄÊä³ö¶¼¿ÉÒÔ±»Ê¶±ð²¢¿ÉÊÓ»¯¡£
Bank

¶¯Ì¬±í¸ñ
Zeppelin ¿ÉÒÔÔÚÄãµÄ±Ê¼Ç±¾Öж¯Ì¬µØ´´½¨Ò»Ð©ÊäÈë¸ñʽ¡£

Ð×÷
Notebook µÄ URL ¿ÉÒÔÔÚÐ×÷Õß¼ä·ÖÏí¡£ Zeppelin È»ºó¿ÉÒÔʵʱ¹ã²¥Èκα仯£¬¾ÍÏñÔÚ
Google docs ÖÐÒ»Ñù¡£

·¢²¼
ZeppelinÌṩÁËÒ»¸öURLÓÃÀ´½ö½öչʾ½á¹û£¬ÄǸöÒ³Ãæ²»°üÀ¨ZeppelinµÄ²Ëµ¥ºÍ°´Å¥¡£ÕâÑù£¬Äã¿ÉÒÔÇáÒ׵ؽ«Æä×÷Ϊһ¸öiframe¼¯³Éµ½ÄãµÄÍøÕ¾¡£

ZeppelinµÄ°²×°²¿Êð
ÓÉÓÚZeppelinĿǰ²»Ìṩbinary°²×°°ü£¬ËùÒÔÕâÀïZeppelinµÄ°²×°ÐèÒª×Ô¼º±àÒë¡£
ÕâÀï¿ÉÒԲο¼Zeppelin GithubºÍInstall Zeppelin
×¼±¸¹¤×÷
ÐèÒª
Java 1.7
Tested on Mac OSX, Ubuntu 14.X, CentOS 6.X
Maven (if you want to build from the source code)
Node.js Package Manager
ÔÚUbuntu»·¾³Ï¿ÉÒÔÕâÑù°²×°£º
sudo apt-get
update
sudo apt-get install openjdk-7-jdk
sudo apt-get install git
sudo apt-get install maven
sudo apt-get install npm |
×¢Ò⣺ÕâÀïµÄmaven¹¤¾ßÈç¹û²»ÊÇ×îеÄÔ´µÄ»°£¬¿ÉÄÜÖ»ÊÇmaven2£¬zeppelinµÄ±àÒëÐèÒªmaven3£¬²»È»Ò»Ð©¹¤¾ßµÄÏÂÔØ»áÊܵ½Ó°Ï죬¿ÉÒÔ´Ómaven¹ÙÍøÏÂÔØ¶þ½øÖÆÑ¹Ëõ°ü£¬Ö±½ÓʹÓá£
ÕâÀﻹÐèÒªnodeÃüÁapt-get°²×°npmʱºò»á×Ô¶¯°²×°nodejsÃüÁÕâÀïÖ»ÐèÒª½¨Á¢Ò»¸öÁ´½Ó¾Í¿ÉÒÔ£ºsudo
ln -s /usr/bin/nodejs /usr/bin/node
zeppelin-webÏîÄ¿µÄ°²×°ÅäÖÃ
ÎÒÔÚ֮ǰ¶ÔzeppelinÕû¸öÏîÄ¿½øÐÐmaven²¿ÊðµÄʱºò×ÜÊdzöÏÖzeppelin-webÏîÄ¿µÄʧ°Ü£¬²»µÃÆä½â£¬²ÎÕÕÍøÉϵķ½·¨£¬¶Ôzeppelin-webÏîÄ¿½øÐе¥¶ÀµÄ°²×°ÅäÖá£
ÕâÀïÿһ²½¶¼ºÜ¹Ø¼ü£¬ÎÒÔÚÕâÀïµÄÅäÖð²×°ÕÛÌÚÁ˺ܶà´Î£¬×îÖÕ²ÅÄÜÕý³£µÄÍê³É°²×°£¬ÏÂÃæÒ»Ò»µÀÀ´¡£
ɾ³ýzeppelin-webÏîÄ¿µÄpom.xmlÏÂÃæ¸ø³öµÄÄÚÈÝ£¬»»×öÊÖ¶¯°²×°£º
<plugin>
<groupId>com.github.eirslett</groupId>
<artifactId>frontend-maven-plugin</artifactId>
<version>0.0.23</version> <executions>
<execution>
<id>install node and npm</id>
<goals>
<goal>install-node-and-npm</goal>
</goals>
<configuration>
<nodeVersion>v0.10.18</nodeVersion>
<npmVersion>1.3.8</npmVersion>
</configuration>
</execution>
<execution>
<id>npm install</id>
<goals>
<goal>npm</goal>
</goals>
</execution>
<execution>
<id>bower install</id>
<goals>
<goal>bower</goal>
</goals>
<configuration>
<arguments>--allow-root install</arguments>
</configuration>
</execution>
<execution>
<id>grunt build</id>
<goals>
<goal>grunt</goal>
</goals>
<configuration>
<arguments>--no-color --force</arguments>
</configuration>
</execution>
</executions>
</plugin> |
ÊÖ¶¯°²×°²½Ö裺
1. °²×°ºÃnpmºÍnode
2. ½øÈëzeppelin-webĿ¼Ï£¬Ö´ÐÐnpm install¡£Ëü»á¸ù¾Ýpackage.jsonµÄÃèÊö°²×°Ò»Ð©gruntµÄ×é¼þ£¬°²×°bower£¬È»ºóÔÙĿ¼ÏÂÉú²úÒ»¸önode_modulesĿ¼¡£
3. Ö´ÐÐbower ¨C-allow-root install£¬»á¸ù¾Ýbower.json°²×°Ç°¶Î¿âÒÀÀµ£¬ÓеãÀàËÆÓÚjavaµÄmvn¡£
4. Ö´ÐÐgrunt --no-color ¨C-force£¬»á¸ù¾ÝGruntfile.jsÕûÀíwebÎļþ¡£
µÚ3¡¢4²½Òª×¢Ò⣬±¾À´¸ø¶¨µÄbowerºÍgruntÎļþÖÐʹÓõÄ"node/node"ÃüÁÒòΪʹÓÃmaven×Ô¶¯°²×°Ê±£¬»áÔÚµ±Ç°Ä¿Â¼ÏÂÉú³ÉnodeĿ¼£¬ÆäÖаüº¬nodeÃüÁî¡£ÎÒÃÇ֮ǰÒѾ°²×°ÁËnodejsÃüÁ²¢ÐÂÁ´½ÓÁËÃüÁînode£¬ËùÒÔÕâÀïÐèÒª½«ÆäÐÞ¸ÄΪ"node"¡£
5. Ö´ÐÐmvn install -DskipTests£¬°ÑwebÏîÄ¿´ò°ü£¬ÔÚtargetĿ¼Ï»áÉú³Éwar
pom.xmlÔÚÉú³Éwar°üµÄʱºò£¬Òª²ÎÕÕdist\WEB-INF\web.xmlÎļþ£¬ËùÒÔÔÚÖ´Ðиò½Öè֮ǰ£¬ÒªÃ÷È·zeppelin-webĿ¼ÏÂÓÉdistĿ¼£¬²ÅÄÜ×îÖÕÉú³ÉÕýÈ·µÄwar°ü¡£
ÆäËûzeppelinÏîÄ¿µÄ±àÒë
ÆäËûÏîÄ¿µÄ±àÒëÒÀÕÕÕý³£³ÌÐò½øÐоͿÉÒÔ£¬°²×°Îĵµ.
¸ù¾Ý×Ô¼ºµÄ·½Ê½½øÐбàÒ룺
Local mode£º
mvn install -DskipTests
Cluster mode£º
mvn install -DskipTests -Dspark.version=1.1.0 -Dhadoop.version=2.2.0
ÅäÖÃ
ÅäÖÃÎļþΪ»·¾³±äÁ¿Îļþ(conf/zeppelin-env.sh)ºÍJavaÊôÐÔÎļþ(conf/zeppelin-site.xml)¡£¸ù¾Ý×Ô¼ºµÄÒªÇó½øÐÐÅäÖá£
Æô¶¯¡¢¹Ø±Õ
Æô¶¯¡¢¹Ø±ÕZeppelin½ø³ÌÃüÁîΪ£º
bin/zeppelin-daemon.sh start
bin/zeppelin-daemon.sh stop
|