Äú¿ÉÒÔ¾èÖú£¬Ö§³ÖÎÒÃǵĹ«ÒæÊÂÒµ¡£

1Ôª 10Ôª 50Ôª





ÈÏÖ¤Â룺  ÑéÖ¤Âë,¿´²»Çå³þ?Çëµã»÷Ë¢ÐÂÑéÖ¤Âë ±ØÌî



  ÇóÖª ÎÄÕ ÎÄ¿â Lib ÊÓÆµ iPerson ¿Î³Ì ÈÏÖ¤ ×Éѯ ¹¤¾ß ½²×ù Model Center   Code  
»áÔ±   
   
 
     
   
 ¶©ÔÄ
  ¾èÖú
Spark½»»¥Ê½·ÖÎöƽ̨Apache ZeppelinµÄ°²×°
 
×÷ÕߣºJasonDing1354
 
  2552  次浏览      27
2020-8-26 
 
±à¼­ÍƼö:
±¾ÎÄÖ÷Òª½éÉÜÁËZeppelin¿ÉÒÔʵÏÖʲô£¬ÌØÐÔ¼°ZeppelinµÄ°²×°²¿Êð¡£
±¾ÎÄÀ´×Ôcsdn£¬ÓÉ»ðÁú¹ûÈí¼þAnna±à¼­¡¢ÍƼö¡£

Zeppelin½éÉÜ

Apache ZeppelinÌṩÁËweb°æµÄÀàËÆipythonµÄnotebook£¬ÓÃÓÚ×öÊý¾Ý·ÖÎöºÍ¿ÉÊÓ»¯¡£±³ºó¿ÉÒÔ½ÓÈ벻ͬµÄÊý¾Ý´¦ÀíÒýÇæ£¬°üÀ¨spark, hive, tajoµÈ£¬Ô­ÉúÖ§³Öscala, java, shell, markdownµÈ¡£ËüµÄÕûÌåÕ¹ÏÖºÍʹÓÃÐÎʽºÍDatabricks CloudÊÇÒ»ÑùµÄ£¬¾ÍÊÇÀ´×ÔÓÚµ±Ê±µÄdemo¡£

Zeppelin¿ÉʵÏÖÄãËùÐèÒªµÄ£º

- Êý¾Ý²É¼¯

- Êý¾Ý·¢ÏÖ

- Êý¾Ý·ÖÎö

- Êý¾Ý¿ÉÊÓ»¯ºÍЭ×÷

Ö§³Ö¶àÖÖÓïÑÔ£¬Ä¬ÈÏÊÇscala(±³ºóÊÇspark shell)£¬SparkSQL, Markdown ºÍ Shell¡£

ÉõÖÁ¿ÉÒÔÌí¼Ó×Ô¼ºµÄÓïÑÔÖ§³Ö¡£ÈçºÎдһ¸özeppelin½âÊÍÆ÷

ZeppelinÌØÐÔ

Apache Spark ¼¯³É

Zeppelin ÌṩÁËÄÚÖÃµÄ Apache Spark ¼¯³É¡£Äã²»ÐèÒªµ¥¶À¹¹½¨Ò»¸öÄ£¿é¡¢²å¼þ»òÕ߿⡣

ZeppelinµÄSpark¼¯³ÉÌṩÁË£º

- ×Ô¶¯ÒýÈëSparkContext ºÍ SQLContext

- ´Ó±¾µØÎļþϵͳ»òmaven¿âÔØÈëÔËÐÐʱÒÀÀµµÄjar°ü¡£¸ü¶à¹ØÓÚÒÀÀµÔØÈëÆ÷

- ¿ÉÈ¡Ïûjob ºÍ չʾjob½ø¶È

Êý¾Ý¿ÉÊÓ»¯

һЩ»ù±¾µÄͼ±íÒѾ­°üº¬ÔÚZeppelinÖС£¿ÉÊÓ»¯²¢²»Ö»ÏÞÓÚSparkSQL²éѯ£¬ºó¶ËµÄÈκÎÓïÑÔµÄÊä³ö¶¼¿ÉÒÔ±»Ê¶±ð²¢¿ÉÊÓ»¯¡£

Bank

¶¯Ì¬±í¸ñ

Zeppelin ¿ÉÒÔÔÚÄãµÄ±Ê¼Ç±¾Öж¯Ì¬µØ´´½¨Ò»Ð©ÊäÈë¸ñʽ¡£

Э×÷

Notebook µÄ URL ¿ÉÒÔÔÚЭ×÷Õß¼ä·ÖÏí¡£ Zeppelin È»ºó¿ÉÒÔʵʱ¹ã²¥Èκα仯£¬¾ÍÏñÔÚ Google docs ÖÐÒ»Ñù¡£

·¢²¼

ZeppelinÌṩÁËÒ»¸öURLÓÃÀ´½ö½öչʾ½á¹û£¬ÄǸöÒ³Ãæ²»°üÀ¨ZeppelinµÄ²Ëµ¥ºÍ°´Å¥¡£ÕâÑù£¬Äã¿ÉÒÔÇáÒ׵ؽ«Æä×÷Ϊһ¸öiframe¼¯³Éµ½ÄãµÄÍøÕ¾¡£

ZeppelinµÄ°²×°²¿Êð

ÓÉÓÚZeppelinĿǰ²»Ìṩbinary°²×°°ü£¬ËùÒÔÕâÀïZeppelinµÄ°²×°ÐèÒª×Ô¼º±àÒë¡£

ÕâÀï¿ÉÒԲο¼Zeppelin GithubºÍInstall Zeppelin

×¼±¸¹¤×÷

ÐèÒª

Java 1.7

Tested on Mac OSX, Ubuntu 14.X, CentOS 6.X

Maven (if you want to build from the source code)

Node.js Package Manager

ÔÚUbuntu»·¾³Ï¿ÉÒÔÕâÑù°²×°£º

sudo apt-get update
sudo apt-get install openjdk-7-jdk
sudo apt-get install git
sudo apt-get install maven
sudo apt-get install npm

 

×¢Ò⣺ÕâÀïµÄmaven¹¤¾ßÈç¹û²»ÊÇ×îеÄÔ´µÄ»°£¬¿ÉÄÜÖ»ÊÇmaven2£¬zeppelinµÄ±àÒëÐèÒªmaven3£¬²»È»Ò»Ð©¹¤¾ßµÄÏÂÔØ»áÊܵ½Ó°Ï죬¿ÉÒÔ´Ómaven¹ÙÍøÏÂÔØ¶þ½øÖÆÑ¹Ëõ°ü£¬Ö±½ÓʹÓá£

ÕâÀﻹÐèÒªnodeÃüÁapt-get°²×°npmʱºò»á×Ô¶¯°²×°nodejsÃüÁÕâÀïÖ»ÐèÒª½¨Á¢Ò»¸öÁ´½Ó¾Í¿ÉÒÔ£ºsudo ln -s /usr/bin/nodejs /usr/bin/node

zeppelin-webÏîÄ¿µÄ°²×°ÅäÖÃ

ÎÒÔÚ֮ǰ¶ÔzeppelinÕû¸öÏîÄ¿½øÐÐmaven²¿ÊðµÄʱºò×ÜÊdzöÏÖzeppelin-webÏîÄ¿µÄʧ°Ü£¬²»µÃÆä½â£¬²ÎÕÕÍøÉϵķ½·¨£¬¶Ôzeppelin-webÏîÄ¿½øÐе¥¶ÀµÄ°²×°ÅäÖá£

ÕâÀïÿһ²½¶¼ºÜ¹Ø¼ü£¬ÎÒÔÚÕâÀïµÄÅäÖð²×°ÕÛÌÚÁ˺ܶà´Î£¬×îÖÕ²ÅÄÜÕý³£µÄÍê³É°²×°£¬ÏÂÃæÒ»Ò»µÀÀ´¡£

ɾ³ýzeppelin-webÏîÄ¿µÄpom.xmlÏÂÃæ¸ø³öµÄÄÚÈÝ£¬»»×öÊÖ¶¯°²×°£º

<plugin>
<groupId>com.github.eirslett</groupId>
<artifactId>frontend-maven-plugin</artifactId>
<version>0.0.23</version>
<executions>

<execution>
<id>install node and npm</id>
<goals>
<goal>install-node-and-npm</goal>
</goals>
<configuration>
<nodeVersion>v0.10.18</nodeVersion>
<npmVersion>1.3.8</npmVersion>
</configuration>
</execution>
<execution>
<id>npm install</id>
<goals>
<goal>npm</goal>
</goals>
</execution>

<execution>
<id>bower install</id>
<goals>
<goal>bower</goal>
</goals>
<configuration>
<arguments>--allow-root install</arguments>
</configuration>
</execution>

<execution>
<id>grunt build</id>
<goals>
<goal>grunt</goal>
</goals>
<configuration>
<arguments>--no-color --force</arguments>
</configuration>
</execution>
</executions>
</plugin>

ÊÖ¶¯°²×°²½Ö裺

1. °²×°ºÃnpmºÍnode

2. ½øÈëzeppelin-webĿ¼Ï£¬Ö´ÐÐnpm install¡£Ëü»á¸ù¾Ýpackage.jsonµÄÃèÊö°²×°Ò»Ð©gruntµÄ×é¼þ£¬°²×°bower£¬È»ºóÔÙĿ¼ÏÂÉú²úÒ»¸önode_modulesĿ¼¡£

3. Ö´ÐÐbower ¨C-allow-root install£¬»á¸ù¾Ýbower.json°²×°Ç°¶Î¿âÒÀÀµ£¬ÓеãÀàËÆÓÚjavaµÄmvn¡£

4. Ö´ÐÐgrunt --no-color ¨C-force£¬»á¸ù¾ÝGruntfile.jsÕûÀíwebÎļþ¡£

µÚ3¡¢4²½Òª×¢Ò⣬±¾À´¸ø¶¨µÄbowerºÍgruntÎļþÖÐʹÓõÄ"node/node"ÃüÁÒòΪʹÓÃmaven×Ô¶¯°²×°Ê±£¬»áÔÚµ±Ç°Ä¿Â¼ÏÂÉú³ÉnodeĿ¼£¬ÆäÖаüº¬nodeÃüÁî¡£ÎÒÃÇ֮ǰÒѾ­°²×°ÁËnodejsÃüÁ²¢ÐÂÁ´½ÓÁËÃüÁînode£¬ËùÒÔÕâÀïÐèÒª½«ÆäÐÞ¸ÄΪ"node"¡£

5. Ö´ÐÐmvn install -DskipTests£¬°ÑwebÏîÄ¿´ò°ü£¬ÔÚtargetĿ¼Ï»áÉú³Éwar

pom.xmlÔÚÉú³Éwar°üµÄʱºò£¬Òª²ÎÕÕdist\WEB-INF\web.xmlÎļþ£¬ËùÒÔÔÚÖ´Ðиò½Öè֮ǰ£¬ÒªÃ÷È·zeppelin-webĿ¼ÏÂÓÉdistĿ¼£¬²ÅÄÜ×îÖÕÉú³ÉÕýÈ·µÄwar°ü¡£

ÆäËûzeppelinÏîÄ¿µÄ±àÒë

ÆäËûÏîÄ¿µÄ±àÒëÒÀÕÕÕý³£³ÌÐò½øÐоͿÉÒÔ£¬°²×°Îĵµ.

¸ù¾Ý×Ô¼ºµÄ·½Ê½½øÐбàÒ룺

Local mode£º

mvn install -DskipTests

Cluster mode£º

mvn install -DskipTests -Dspark.version=1.1.0 -Dhadoop.version=2.2.0

ÅäÖÃ

ÅäÖÃÎļþΪ»·¾³±äÁ¿Îļþ(conf/zeppelin-env.sh)ºÍJavaÊôÐÔÎļþ(conf/zeppelin-site.xml)¡£¸ù¾Ý×Ô¼ºµÄÒªÇó½øÐÐÅäÖá£

Æô¶¯¡¢¹Ø±Õ

Æô¶¯¡¢¹Ø±ÕZeppelin½ø³ÌÃüÁîΪ£º

bin/zeppelin-daemon.sh start

bin/zeppelin-daemon.sh stop

 

 

 
   
2552 ´Îä¯ÀÀ       27
Ïà¹ØÎÄÕÂ

»ùÓÚEAµÄÊý¾Ý¿â½¨Ä£
Êý¾ÝÁ÷½¨Ä££¨EAÖ¸ÄÏ£©
¡°Êý¾Ýºþ¡±£º¸ÅÄî¡¢ÌØÕ÷¡¢¼Ü¹¹Óë°¸Àý
ÔÚÏßÉ̳ÇÊý¾Ý¿âϵͳÉè¼Æ ˼·+Ч¹û
 
Ïà¹ØÎĵµ

GreenplumÊý¾Ý¿â»ù´¡Åàѵ
MySQL5.1ÐÔÄÜÓÅ»¯·½°¸
ijµçÉÌÊý¾ÝÖÐ̨¼Ü¹¹Êµ¼ù
MySQL¸ßÀ©Õ¹¼Ü¹¹Éè¼Æ
Ïà¹Ø¿Î³Ì

Êý¾ÝÖÎÀí¡¢Êý¾Ý¼Ü¹¹¼°Êý¾Ý±ê×¼
MongoDBʵս¿Î³Ì
²¢·¢¡¢´óÈÝÁ¿¡¢¸ßÐÔÄÜÊý¾Ý¿âÉè¼ÆÓëÓÅ»¯
PostgreSQLÊý¾Ý¿âʵսÅàѵ
×îл¼Æ»®
DeepSeek´óÄ£ÐÍÓ¦Óÿª·¢ 6-12[ÏÃÃÅ]
È˹¤ÖÇÄÜ.»úÆ÷ѧϰTensorFlow 6-22[Ö±²¥]
»ùÓÚ UML ºÍEA½øÐзÖÎöÉè¼Æ 6-30[±±¾©]
ǶÈëʽÈí¼þ¼Ü¹¹-¸ß¼¶Êµ¼ù 7-9[±±¾©]
Óû§ÌåÑé¡¢Ò×ÓÃÐÔ²âÊÔÓëÆÀ¹À 7-25[Î÷°²]
ͼÊý¾Ý¿âÓë֪ʶͼÆ× 8-23[±±¾©]
 
×îÐÂÎÄÕÂ
´óÊý¾Ýƽ̨ϵÄÊý¾ÝÖÎÀí
ÈçºÎÉè¼ÆÊµÊ±Êý¾Ýƽ̨£¨¼¼Êõƪ£©
´óÊý¾Ý×ʲú¹ÜÀí×ÜÌå¿ò¼Ü¸ÅÊö
Kafka¼Ü¹¹ºÍÔ­Àí
ELK¶àÖּܹ¹¼°ÓÅÁÓ
×îпγÌ
´óÊý¾Ýƽ̨´î½¨Óë¸ßÐÔÄܼÆËã
´óÊý¾Ýƽ̨¼Ü¹¹ÓëÓ¦ÓÃʵս
´óÊý¾ÝϵͳÔËά
´óÊý¾Ý·ÖÎöÓë¹ÜÀí
Python¼°Êý¾Ý·ÖÎö
³É¹¦°¸Àý
ijͨÐÅÉ豸ÆóÒµ PythonÊý¾Ý·ÖÎöÓëÍÚ¾ò
Ä³ÒøÐÐ È˹¤ÖÇÄÜ+Python+´óÊý¾Ý
±±¾© Python¼°Êý¾Ý·ÖÎö
ÉñÁúÆû³µ ´óÊý¾Ý¼¼Êõƽ̨-Hadoop
ÖйúµçÐÅ ´óÊý¾Ýʱ´úÓëÏÖ´úÆóÒµµÄÊý¾Ý»¯ÔËӪʵ¼ù