Äú¿ÉÒÔ¾èÖú£¬Ö§³ÖÎÒÃǵĹ«ÒæÊÂÒµ¡£

1Ôª 10Ôª 50Ôª





ÈÏÖ¤Â룺  ÑéÖ¤Âë,¿´²»Çå³þ?Çëµã»÷Ë¢ÐÂÑéÖ¤Âë ±ØÌî



  ÇóÖª ÎÄÕ ÎÄ¿â Lib ÊÓÆµ iPerson ¿Î³Ì ÈÏÖ¤ ×Éѯ ¹¤¾ß ½²×ù Model Center   Code  
»áÔ±   
   
 
     
   
 ¶©ÔÄ
  ¾èÖú
Apache KylinÔÚ4399´óÊý¾Ýƽ̨µÄÓ¦ÓÃ
 
  2593  次浏览      27
 2018-7-25
 
±à¼­ÍƼö:
±¾ÎÄÀ´×ÔÓÚcsdn£¬±¾ÎÄÖ÷Òª½²ÈçºÎ½«Apache Kylin ÉÏÏßÓ¦ÓÃÒÔ¼°Kylin µÄƽ̨¼Ü¹¹ÔÚ4399´óÊý¾Ýƽ̨ӦÓá£

±³ ¾°

ÔÚ¿ªÊ¼°¸Àý·ÖÏíǰ£¬Ïȼòµ¥½éÉÜһϠ4399 ÒÔ¼° 4399 µÄ´óÊý¾ÝÍŶÓ

1.4399 ÊÇÖйú×îÔçµÄºÍÁìÏȵÄÔÚÏßÐÝÏÐСÓÎϷƽ̨£¬ÈÕ»îÔ¾´ï 2000 ¶àÍò

2.4399 ÓÎÏ·ºÐÊÇ 4399 ÆìϵÄÊÖÓηַ¢Æ½Ì¨£¬ÈÕ»î¹ý 350w

3.4399 µÄ´óÊý¾ÝÍŶӹæÄ£ÔÚ 15 ÈË×óÓÒ£¬Ö÷Òª¹¤×÷ÄÚÈÝΪÓÎÏ·ÍÆ¼ö¡¢ÓÎÏ·ËÑË÷¡¢¾º¼Û¹ã¸æ£¬¶àά·ÖÎö¡¢´óÊý¾Ýƽ̨µÈµÈ

4399 ´Ó Kylin v1.5 °æ±¾¿ªÊ¼Ê¹Óã¬Ê¹ÓÃ°æ±¾Ò²Ëæ×Źٷ½°æ±¾µÄÉý¼¶ÔÚÉý¼¶£¬ÏÖÉú²úϵͳÁ½¸ö°æ±¾Í¬Ê±ÔÚÔËÐУºKylin v2.0.0¡¢Kylin v2.3.0£¬¹²ÓÐ 20 ¸ö Cube ΪÎÒÃǵĴóÊý¾Ýƽ̨Ìṩ·ÖÎö·þÎñ£¬Èç©¶·Ä£ÐÍ·ÖÎöµÈ¡£ÆäÖÐ×î´óµÄ Cube£¬Ã¿µ½ÖÜÄ©ÐèÒª¹¹½¨ 2.5 ÒÚÌõµÄÊý¾Ý£¬18 ¸öά¶È£¬9 ¸öÖ¸±ê£¬¹¹½¨ºÄʱ 80 ·ÖÖÓ×óÓÒ¡£Kylin µÄÒýÈëʹÓÃÖ÷Òª°ïÎÒÃǽâ¾öÁËÈý´óÎÊÌ⣺

Ìṩ ANSI-SQL ½Ó¿Ú£¬ÈÃͳ¼Æ·ÖÎöÓÉ·±ÔÓ±äµÃ¼òµ¥¡£

1.½â¾ö¿Ú¾¶²»Ò»ÖÂÎÊÌâ¡£Ô­ÏÈÿ¸öÐèÇó¹ýÀ´£¬ÐèÒªÖØÐ´Í³¼ÆÂß¼­£¬±àдÈËÔ±²»Í¬¾Í»áµ¼Ö¿ھ¶²»Ò»Ö£¬Êý¾Ý³öÈë½Ï´ó£¬Ð£×¼¹¤×÷Á¿´ó¡£ÏÖÔÚͳһÕûÀíÒ»ÕÅÊÂʵ±í£¬Ïà¹ØÐèÇóͨ¹ý SQL ²éѯͬһÕÅ±í£¬¿Ú¾¶Ò»Ö£¬Ð£×¼¼òÒס£

2.Ôö¼Óά¶È»òÕßÖ¸±êʱ£¬´ó´ó½µµÍÁËËùÐ蹤×÷Á¿¡£

3.½â¾öÕâÈý´óÎÊÌâµÄͬʱ£¬Kylin »¹±£Ö¤ÁË¿ìËÙµÄÏìӦʱ¼ä¡£Kylin ά¶È×éºÏÉè¼ÆµÄºÏÀíÐÔÌØµã£¬²»½öÄܹ»¼õÉÙ Cube ¹¹½¨Ê±¼ä£¬»¹ÄÜÈÃÎÒÃÇ»ñµÃºÏÀíµÄ²éѯÏìӦʱ¼ä¡£ÏÖÉú²ú×î´óµÄÊÂʵ±í£¬°üº¬ 18 ¸öά¶È¡¢9 ¸öÖ¸±ê£¬95% µÄ SQL ÄÜÔÚ 3 ÃëÒÔÄÚ·µ»ØÕýÈ·½á¹û¡£

4399 ´óÊý¾Ýƽ̨½éÉÜ

Ëæ×ÅÒµÎñµÄÔö¼Ó£¬4399 µÄÊý¾Ý¹æÄ£³Ê±¬Õ¨Ê½Ôö³¤£¬ÏëÒªÍêÕûµÄÊÕ¼¯Êý¾Ý£¬²¢´ÓÊý¾ÝÖÐÍÚ¾ò³öÉÌÒµ¼ÛÖµ£¬´óÊý¾Ýƽ̨µÄÒýÈëÊÆÔÚ±ØÐС£ÎÒ˾ÔÚǰ¼¸Ä꿪ʼÒýÈë´óÊý¾Ýƽ̨£¬Ê¹ÓÃÁ÷ÐеĿªÔ´µÄ×é¼þ£¬´î½¨³ö·ûºÏ¹«Ë¾ÒµÎñÐèÇóµÄƽ̨¡£ÎªÁ˱£Ö¤Êý¾ÝÂäÅÌÃݵȲÙ×÷¡¢Ð´ÈëÏû·ÑµÄ Exactly-One£¬ÎÒÃÇÏàÓ¦µØ¿ª·¢Ò»Ð©Ð¡¹¤¾ß¡£

·¢Õ¹µ½ÏÖÔÚ£¬¹«Ë¾´óÊý¾Ýƽ̨ÒѾ­ÓµÓÐ 50 ¶à¸ö½Úµã£¬Ö÷ÒªÖ°Ôð°üº¬Èý´ó¿é£º

1.ÊÕ¼¯Ô­Ê¼ÈÕÖ¾£¬Ã¿ÌìÐÂÔöÈÕÖÊÁ¿ÔÚ 5T ×óÓÒ

2.OLAP - ¶ÔÈÕÖ¾×ö¶àάÊý¾Ý·ÖÎö£¬Õⲿ·ÖʹÓõÄÊÇ Kylin

3.Óû§»­Ïñ£¬»úÆ÷ѧϰ¡£·¢¾òÓû§¼ÛÖµ

Apache Kylin ÉÏÏßÓ¦ÓÃ

ÔÚ 4399 µÄ´óÊý¾Ýƽ̨ÖУ¬Hadoop ΪÎÒÃÇÌṩÁËÊý¾Ý¹ÜÀí¹¦ÄÜ£¬µ«ÊÇÏÖÓеÄÒµÎñ·ÖÎö¹¤¾ß£¨Èç Tableau¡¢Microstrategy µÈ£©´æÔںܴóµÄ¾ÖÏÞÐÔ£¬ÀýÈçÄÑÒÔˮƽÀ©Õ¹¡¢ÎÞ·¨´¦Àí³¬´ó¹æÄ£Êý¾Ý¡¢È±ÉÙ¶Ô Hadoop µÄÖ§³ÖµÈ¡£Êý¾Ý²Ö¿â Hive ËäȻҲÌṩÁË SQL ²éѯ½Ó¿Ú£¬µ«ÊÇÏìӦʱ¼ä²îÇ¿ÈËÒâ¡£ÔÚÕâÑùµÄ±³¾°Ï£¬Kylin Äܹ»ÔÚÑÇÃë¼¶²éѯ¾Þ´óµÄ Hive ±í£¬²¢Ö§³Ö¸ß²¢·¢, ¿ÉÒÔ˵ÊÇÓ¦Ô˶øÉúÁË¡£

a) Kylin ƽ̨¼Ü¹¹

Èçͼ 2-1 Kylin ÔÚ 4399 Ó¦Óõļ¼Êõ¼Ü¹¹Í¼£¬Ö÷Òª°üº¬²éѯºÍ¹¹½¨·þÎñÆ÷¡£

ͼ±í 2-1 Kylin ƽ̨¼Ü¹¹Í¼

i. ²¿ÊðÇé¿ö

ΪÁ˱£Ö¤²éѯ·þÎñµÄÎȶ¨ÐÔ£¬ÎÒÃÇʹÓà Nginx ÅäÖøºÔؾùºâ¡£

Éú²ú»·¾³£ºÈý̨²éѯ¡¢Ò»Ì¨¹¹½¨£»HBase ¼¯Èº°üº¬ 23 ½Úµã¡£

²âÊÔ»·¾³£ºÒ»Ì¨²éѯ¡¢Ò»Ì¨¹¹½¨ºÍ²éѯ¡£

¶à°æ±¾Í¬Ê±²¿Êð£¬ÐèÒªÐÞ¸ÄÅäÖã¬Ê¹µÃ Zookeeper µÄ znode ·¾¶ÒÔ¼° kylin_metadata ·Ö¿ª£¬±ÜÃâÏ໥ӰÏì¡£

ii. Êý¾ÝÁ÷Ïò

ÒÔÎÒÃÇÓ¦ÓÃÆ½Ì¨ 4399 ÓÎÏ·ºÐµÄ©¶·Ä£ÐÍ·ÖÎö£¨´Óչʾµ½µã»÷ÏÂÔØÆô¶¯Áô´æ£©ÎªÀý£¬·ÖÎöÊý¾ÝÁ÷Ïò¡£

ͼ±í 2-2 ©¶·Ä£ÐÍÊý¾ÝÁ÷Ïòͼ

Èçͼ±í 2-2£¬Ê×ÏÈÒªÕûÀíºÃÊÂʵ±íºÍά¶È±í£¬¹¹³ÉÐÇÐÍÄ£ÐÍ£¨»òÑ©»¨Ä£ÐÍ£©£¬·ÖÎöËùÐèµÄγ¶ÈºÍÖ¸±ê£¬ÅäÖà Kylin Ä£ÐÍ£¬½Ó×ÅÅäÖÃÏàÓ¦µÄ cube¡£¾­¹ý Kylin µÄ¹¹½¨£¬¾ÍÄÜʹÓà SQL Óï¾ä²éѯ Kylin¡£

b) Õ¹Ê¾Ò³Ãæ

ΪÁË·½±ãÔËÓªÈËÔ±µÄ²é¿´Êý¾Ý£¬ÌåÏÖ³ö Apache Kylin µÄ¶àά·ÖÎöÒýÇæÓÅÊÆ£¬×Ô¼º¿ª·¢ÁËÒ»Ì×¶àά·ÖÎöÕ¹Ê¾Ò³Ãæ¡££¨ÏÂÁÐͼ±íʹÓÃÁËÄ£ÄâÊý¾Ý¡££©

Èçͼ±í 2-3£¬ÕâÊÇÏÂÔØÍê³ÉµÄ·ÖÎöÄ£ÐÍ¡£ÉÏÃæÊÇά¶ÈÏà¹ØµÄÌõ¼þɸѡºÍ·Ö×éÕ¹¿ª¡£×óϽÇÊÇÐÐΪ·¾¶Í³¼ÆÊ÷״ͼ£¬¸÷·¾¶ÏÂÔØ×ÜÁ¿ºÍÕ¼±ÈһĿÁËÈ»£¬ÓÒϽÇÖ¸±êµÄ×ßÊÆÍ¼ºÍÖ¸±êά¶ÈÏÂ×êÁÐ±í¡£ËùÓеÄά¶È¶¼Ö§³ÖÌõ¼þɸѡºÍ·Ö×éÕ¹¿ª£¬¸÷ά¶ÈµÄÖ¸±ê¶Ô±È£¬Ê¹µÃ·ÖÎöÄܸüÖ±¹ÛµÄ¸ÐÊÜÊý¾ÝÇ÷ÊÆµÄÄÚÔÚÔ­Òò¡£

ͼ±í 2-3 ¶àά·ÖÎö½çÃæ

°´ÕÕÓÎϷά¶È·Ö×éÕ¹¿ªµÄЧ¹ûÈçͼ±í 2-4¡£

ͼ±í 2-4 ÓÎϷά¶È·Ö×éÕ¹¿ª

c) Apache Kylin ÓÅ»¯½¨Òé

ÖÚËùÖÜÖª£¬Kylin µÄºËÐÄ˼ÏëÊÇÔ¤¼ÆË㣬¼´¶Ô¶àά·ÖÎö¿ÉÄÜÓõ½µÄ¶ÈÁ¿Öµ½øÐÐÔ¤¼ÆË㣬½«¼ÆËãºÃµÄ½á¹û±£´æ³É Cube£¬Ìṩ²éѯ¡£ËùÒÔÉæ¼°µ½Á½¸ö·½ÃæµÄÐÔÄÜÎÊÌ⣺

²éѯʱµÄÏìӦʱ¼ä¡£

Ô¤¼ÆË㻨·ÑµÄʱ¼äºÍ¿Õ¼ä¡£

i. ²éѯʱ¼äÓÅ»¯

Kylin µÄ²éѯ¹ý³ÌÖ÷Òª°üº¬Ëĸö²½Ö裺½âÎö SQL£¬´Ó HBase »ñÈ¡Êý¾Ý£¬¶þ´Î¾ÛºÏÔËË㣬·µ»Ø½á¹û¡£ÏÔÈ»ÓÅ»¯µÄÖØµã¾ÍÂäÔÚÈçºÎ¼Ó¿ì HBase »ñÈ¡Êý¾ÝµÄËٶȺͼõÉÙ¶þ´Î¾ÛºÏÔ¤Ëã¡£

Ìá¸ß HBase ÏìӦʱ¼ä£ºÐÞ¸ÄÅäÖã¬ÐÞ¸Ä Cache µÄ²ßÂÔ£¬Ôö¼Ó Block Cache µÄÈÝÁ¿

¼õÉÙ¶þ´Î¾ÛºÏÔËË㣺ºÏÀíÉè¼ÆÎ³¶È£¬Ê¹²éѯʱ¾¡Á¿Äܾ«È·ÃüÖÐ Cuboid¡£È¥ÖØÖµÊ¹ÓÃÓÐËðËã·¨¡£

d) Ô¤¼ÆËãÓÅ»¯

Ô¤¼ÆËãµÄÓÅ»¯£¬Ö÷Òª¿¼ÂÇÓкÎËõ¶Ì¹¹½¨»¨·ÑµÄʱ¼ä£¬ÒÔ¼°Öмä½á¹ûºÍ×îÖÕ½á¹ûÕ¼ÓõĿռ䡣ÿ¸öÒµÎñµ¥¶ÀÒ»¸ö Cube£¬±ÜÃâÿ¸ö Cube ´ó¶øÈ«£¬¼õÉÙ²»±ØÒªµÄ¼ÆËã¡£

i.Cube ÓÅ»¯

Ëæ×Åά¶ÈÊýÄ¿µÄÔö¼Ó£¬Cuboid µÄÊýÁ¿³ÉÖ¸Êý¼¶Ôö³¤¡£ÎªÁË»º½â Cube µÄ¹¹½¨Ñ¹Á¦£¬Kylin ÌṩÁË Cube µÄ¸ß¼¶ÉèÖá£ÕâЩ¸ß¼¶ÉèÖðüÀ¨¾ÛºÏ×飨Aggregation Group£©¡¢ÁªºÏά¶È£¨Joint Dimension£©¡¢²ã¼¶Î¬¶È£¨Hierarchy Dimension£©ºÍ±ØÒªÎ¬¶È£¨Mandatory Dimension£©µÈ¡£

ºÏÀíµ÷Õûγ¶ÈÅäÖ㬶ÔÐè¹¹½¨µÄ Cuboid ½øÐмôÖ¦£¬Ë¢Ñ¡³öÕæÕýÐèÒªµÄ Cuboid£¬ÓÅ»¯¹¹½¨ÐÔÄÜ£¬½µµÍ¹¹½¨Ê±¼ä£¬´ó´óÌá¸ßÁ˼¯Èº×ÊÔ´µÄÀûÓÃЧÂÊ¡£ÓÅ»¯Ç°ºóµÄЧ¹û¶Ô±ÈÈç±í 2-5£º

ͼ±í 2-5 ÓÅ»¯ºóЧ¹û¶Ô±È

1. ±ØÐëά¶È

²éѯʱ£¬¾­³£Ê¹ÓõÄά¶È£¬ÒÔ¼°µÍ»ùÊýγ¶È¡£Èç¸Ãά¶È»ùÊý<10£¬¿ÉÒÔ¿¼ÂÇ×÷Ϊ±ØÐëά¶È¡£

2. ²ã¼¶Î¬¶È

ά¶È¹ØÏµÓÐÒ»¶¨²ã¼¶ÐÔ¡¢»ùÊýÓÐСµ½´óÇé¿ö¿ÉÒÔʹÓò㼶ά¶È¡£

3.Joint ά¶È

ά¶ÈÖ®¼äÊÇͬʱ³öÏֵĹØÏµ£¬¼°²éѯʱ£¬¾ø´ó²¿·ÖÇé¿ö¶¼ÊÇͬʱ³öÏֵġ£¿ÉÒÔʹÓà joint ά¡£

4. ά¶È×éºÏ×é

½«ÎªÎ¬¶È½øÐзÖ×飬²éѯʱ×éÓë×éÖ®¼äµÄά¶È²»»áͬʱ³öÏÖ¡£

ii. ÅäÖÃÓÅ»¯

ÅäÖÃÓÅ»¯£¬°üÀ¨ Kylin ×ÊÔ´µÄÅäÖÃÒÔ¼° Hadoop ¼¯ÈºÅäÖÃÏà¹ØÐ޸ġ£

1. ¹¹½¨×ÊÔ´

ÿ¸ö Cube ¹¹½¨Ê±£¬ËùÐèµÄ×ÊÔ´²»Ì«Ò»Ñù£¬ÐèÒª½øÐÐÏàÓ¦µÄ×ÊÔ´µ÷Õû¡£

2. µ÷Õû¸±±¾

¼¯ÈºÄ¬ÈϵÄÎļþ¸±±¾ÊýΪ 3£¬Cube ¹¹½¨Ê±£¬½«¸±±¾Êýµ÷Ϊ 2£¬¸ö±ðÖмäÈÎÎñ»¹¿ÉÒÔµ÷ÕûΪ 1£¬ÕâÑù¿ÉÒÔ½µµÍ¹¹½¨ÈÎÎñʱ¼¯Èº IO¡£ÎªÁ˱£Ö¤²éѯµÄÎȶ¨ÐÔ£¬HBase ¸±±¾ÊýÒÀȻΪ 3¡£

3. ÆôÓÃѹËõ

Hadoop ¼¯ÈºÆôÓà Snappy ѹËõ£¬HBase Ò²ÆôÓà Snappy£¬×îÖÕÉú³ÉµÄ HFILE£¬×î´óѹËõÂʿɴï 70% ×óÓÒ£¬´ó´ó½µµÍÁ˼¯Èº IO ¸ºÔØ¡£

ºó¼Ç

ÔÚ 4399 ´óÊý¾Ýƽ̨ÉÏÏÖÔÚ»¹´æÔÚ¼¸¸öÎÊÌ⣺HBase ¼¯Èº²»¹»Îȶ¨£¬²éѯÏìӦʱ¼ä²»¹»Îȶ¨£¬¸ö±ðÓï¾äÏìӦʱ¼ä²»ÀíÏ룬Cube segment ÖØÐ¹¹½¨Ô­±¾ HBase ±í²»»á×Ô¶¯É¾³ý¡£Î§ÈÆÕ⼸¸öÎÊÌ⣬ÎÒÃǺóÐø»áÔÙ½øÐÐһЩÓÅ»¯¡£

HBase ¼¯Èº¶ÀÁ¢³öÀ´£¬±ÜÃâ±»¼¯ÈºÆäËûÈÎÎñËùÓ°Ï죬µ÷ÕûÅäÖÃÓÅ»¯²éѯ£¬Ôö¼Ó²éѯµÄ cache ÄÚ´æ±ÈÀý¡£

¸ö±ð׼ʵʱ¹¹½¨ÈÎÎñ½á¹ûµ÷ÕûΪ HBase µÄÄÚ´æ±í£¬¼õÉÙÏìӦʱ¼ä£¬ÄÜ´ó·ù¶ÈÌá¸ßÏìӦʱ¼äµÄÎȶ¨ÐÔ¡£

ÐÞ¸ÄÔ´Âë£¬ÖØÐ¹¹½¨½áÊøºó×Ô¶¯ÇåÀí¹ýÆÚ HBase ±í£¬½µµÍ HBase Ë÷ÒýµÄѹÁ¦¡£

   
2593 ´Îä¯ÀÀ       27
Ïà¹ØÎÄÕÂ

»ùÓÚEAµÄÊý¾Ý¿â½¨Ä£
Êý¾ÝÁ÷½¨Ä££¨EAÖ¸ÄÏ£©
¡°Êý¾Ýºþ¡±£º¸ÅÄî¡¢ÌØÕ÷¡¢¼Ü¹¹Óë°¸Àý
ÔÚÏßÉ̳ÇÊý¾Ý¿âϵͳÉè¼Æ ˼·+Ч¹û
 
Ïà¹ØÎĵµ

GreenplumÊý¾Ý¿â»ù´¡Åàѵ
MySQL5.1ÐÔÄÜÓÅ»¯·½°¸
ijµçÉÌÊý¾ÝÖÐ̨¼Ü¹¹Êµ¼ù
MySQL¸ßÀ©Õ¹¼Ü¹¹Éè¼Æ
Ïà¹Ø¿Î³Ì

Êý¾ÝÖÎÀí¡¢Êý¾Ý¼Ü¹¹¼°Êý¾Ý±ê×¼
MongoDBʵս¿Î³Ì
²¢·¢¡¢´óÈÝÁ¿¡¢¸ßÐÔÄÜÊý¾Ý¿âÉè¼ÆÓëÓÅ»¯
PostgreSQLÊý¾Ý¿âʵսÅàѵ