±à¼ÍƼö: |
±¾ÎĽéÉÜÎÒÃÇÔÚÉÏÔÆ¹ý³ÌÖÐһЩʵ¼ùºÍ¾Ñ飬ÒÔ¼°Ò»Ð©Ë¼¿¼ºÍÑ¡Ôñ¡£
±¾ÎÄÀ´×ÔÓÚÌÚÑ¶ÔÆÔÉú£¬ÓÉAlice±à¼¡¢ÍƼö¡£ |
|
ÕªÒª
Ò½ÁÆ×ÊѶҵÎñÔÚ¸ßËÙ·¢Õ¹¹ý³ÌÖУ¬ÐγÉÁ˸²¸Ç²»Í¬³¡¾°¡¢²»Í¬Óû§¡¢²»Í¬ÇþµÀµÄ¼¸Ê®¸öÒµÎñ£¬ÒÔ¼°ÉÏǧ¸ö·þÎñ¡£ÎªÁ˸ßЧÂú×ãÓû§¶àÑù»¯µÄÐèÇó£¬ÌÚѶҽÁƼ¼ÊõÍŶÓͨ¹ý TKE ÉÏÔÆ£¬Ê¹Óà Coding DevOps ƽ̨£¬ÒÔ¼°ÔÆÉϿɹ۲⼼Êõ£¬ À´ÌáÉýÑз¢Ð§ÂÊ¡¢½µµÍÔËÓªÔËά³É±¾ ¡£±¾ÎĽéÉÜÎÒÃÇÔÚÉÏÔÆ¹ý³ÌÖÐһЩʵ¼ùºÍ¾Ñ飬ÒÔ¼°Ò»Ð©Ë¼¿¼ºÍÑ¡Ôñ¡£
ÒµÎñ±³¾°
stage1: ÌÚѶҽÁÆ×ÊѶƽ̨Ö÷Òª°üÀ¨ÁËÒ½µä¡¢Ò½Éú¡¢Ò½Ò©µÈºËÐÄÒµÎñ£¬ÆäÖÐÒ½µäÖ÷ÒªÌṩҽÁÆÏà¹ØÄÚÈÝ»ñÈ¡¡¢Ò½ÁÆÖªÊ¶¿ÆÆÕ´«µÝ£»Ò½ÉúÂú×ãÒ½ÉúºÍ»¼ÕߵĻ¥Áª£»Ò½Ò©·þÎñÁ˹ã´óÒ©Æó¡£ÔÚÒµÎñ·¢Õ¹¹ý³ÌÖÐÎÒÃÇÔÀ´»ùÓÚ taf ƽ̨¹¹½¨ÁË´óÁ¿ºǫ́·þÎñ£¬Íê³ÉÁ˳õÆÚÒµÎñµÄ¿ìËٴ¡£
ÓÉÓÚ ÒµÎñÊýÁ¿½Ï¶à£¬´óÁ¿ÒµÎñÓÐ¶àµØÓòµÄÊöÇó£¬ ×îÖÕÎÒÃÇÔÚ taf ƽ̨²¿Êð¶à¸öÒµÎñ¼¯Èº¡£Õâ¸öʱºò·¢²¼¡¢ÔËά¡¢ÎÊÌâÅŲ鴿¿¿È˹¤½×¶Î£¬Ð§Âʽϵ͡£
ÒµÎñÉÏÔÆ
stage2: Ëæ×ÅÒµÎñ¹æÄ£µÄ¼±ËÙÀ©ÕÅ£¬´«Í³µÄ¿ª·¢¡¢ÔËά·½Ê½ÔÚÃô½Ý¡¢×ÊÔ´¡¢Ð§ÂÊ·½Ãæ¶ÔÒµÎñµü´úÐγɽϴóµÄÖÆÔ¼¡£Ëæ×Ź«Ë¾×ÔÑÐÉÏÔÆÏîÄ¿ÍÆ½ø£¬ Óµ±§ÔÆÔÉú»¯£¬»ùÓÚ K8s À´Âú×ãÒµÎñ¶Ô²»Í¬×ÊÔ´¶àÑù»¯ÐèÇóºÍµ¯ÐÔµ÷¶È£¬»ùÓÚÏÖÓгÉÊì devops ƽ̨À´½øÐÐÃô½Ýµü´ú£¬Ô½À´Ô½³ÉΪҵÎñÕýÈ·µÄÑ¡Ôñ¡£ Ò½Áƺǫ́ÍŶӿªÊ¼ÁËÕûÌå·þÎñÉÏÔÆµÄÇ¨ÒÆ¡£
ÉÏÔÆÖ®Ç°£¬»¹Óм¸¸öÎÊÌâÐèÒª¿¼ÂÇ
-
·þÎñÖڶ࣬´úÂëÈçºÎ¹ÜÀí
-
ÉÏ ÔÆºóÔõô¿ìËÙ½øÐÐÎÊÌⶨλ¡¢ÅŲé
-
¼à¿Ø¸æ¾¯Æ½Ì¨ÈçºÎÑ¡Ôñ
-
»ù´¡¾µÏñÔõôѡÔñ
¹ØÓÚ·þÎñ´úÂë¹ÜÀí
ʹÓà git ×ö´úÂë°æ±¾¿ØÖÆ£¬°´ÒµÎñ½¨Á¢ÏîÄ¿×飬ÿ¸ö·þÎñʹÓõ¥¶ÀµÄ´úÂë²Ö¿â£¬²Ö¿âÃûʹÓÃͬһÃüÃû¹æ·¶¡£
¹ØÓÚÎÊÌâÅŲé
µ÷ÑÐÔÆÉÏÓгÉÊìµÄ elk ·þÎñ£¬ÒµÎñÖ»ÐèÒª°ÑÈÕÖ¾·Åµ½Í¬Ò»Ä¿Â¼£¬Í¨¹ý filebeat ²É¼¯ºó£¬Í¨¹ý ETL Âß¼¿ÉÒÔ°ÑÈÕÖ¾·½±ãµ¼Èë Elasticsearch¡£ÕâÑùµÄ×ö·¨»¹ÓиöÓŵã¾ÍÊÇ¿ÉÒÔ Í¬Ê±Ö§³Öǰºó¶Ë·þÎñÈÕÖ¾µÄ²É¼¯ £¬¼¼Êõ½ÏΪ³ÉÊ죬¸´ÓÃÁË×é¼þÄÜÁ¦£¬Í¨¹ýÔÚÇëÇóÖÐÂñµã¼ÓÈë traceid£¬·½±ãÔÚÈ«Á´Â·¶¨Î»ÎÊÌâ¡£

¹ØÓÚ¼à¿Ø¸æ¾¯Æ½Ì¨
CSIG ÌṩÁË»ùÓÚÈÕÖ¾¼à¿ØµÄ CMS ƽ̨£¬½«ÒµÎñÈÕÖ¾µ¼Èëµ½ CMS ºó£¬¿ÉÒÔ»ùÓÚÉϱ¨µÄÈÕÖ¾ÅäÖÃ¼à¿ØºÍ¸æ¾¯£¬¼à¿ØÎ¬¶È¡¢Ö¸±êÒµÎñ¿ÉÒÔ×Ô¼º¶¨Òå¡£ÎÒÃDzÉÓÃÁËÖ÷µ÷¡¢±»µ÷¡¢½Ó¿ÚÃûµÈά¶È£¬µ÷ÓÃÁ¿¡¢ºÄʱ¡¢Ê§°ÜÂʵÈÖ¸±ê£¬Âú×ãÒµÎñ¼à¿Ø¸æ¾¯ËßÇó¡£ »ùÓÚÈÕÖ¾µÄ¼à¿Ø¿ÉÒÔ¸´ÓÃͬһÌõÊý¾Ý²É¼¯Á´Â·£¬ÏµÍ³¼Ü¹¹Í³Ò»¼ò½à¡£

¹ØÓÚ»ù´¡¾µÏñ
ΪÁË·½±ãÒµÎñ³õÆÚ¿ìËÙÉÏÔÆ£¬ÒÔ¼°Í³Ò»·þÎñÆô¶¯¡¢Êý¾Ý²É¼¯Éϱ¨£¬ÓбØÒª¶ÔÒµÎñµÄ»ù´¡¾µÏñ½øÐд¦Àí£¬Ô¤ÏȽ¨Á¢¶ÔӦĿ¼£¬Ìṩ½Å±¾ºÍ¹¤¾ß£¬·½±ãÒµÎñ¿ìËÙ½ÓÈë¡£ÕâÀïÎÒÃÇÌṩÁ˲»Í¬ÓïÑÔ¡¢°æ±¾µÄ»ù´¡¾µÏñ£¬·â×°ÁË supervisord ºÍ filebeat£¬Í¨¹ý supervisord À´ÀÆð filebeat ºÍÒµÎñ·þÎñ¡£

Devops
stage3: ÔÚÉÏÔÆ¹ý³ÌÖУ¬Ò²Í¨¹ýºÍÖÊÁ¿Í¬Ñ§Öð²½ÍêÉÆ£¬½«¿ª·¢¹ý³ÌÖÐÔÓÐÈ˹¤²Ù×÷µÄ²½Öè pipeline »¯£¬À´Ìá¸ßµü´úЧÂÊ£¬¹æ·¶¿ª·¢Á÷³Ì£»Í¨¹ýµ¥²âºÍ×Ô¶¯»¯²¦²â£¬ÌáÉý·þÎñÎȶ¨ÐÔ¡£ ²ÉÓÃͳһµÄÁ÷Ë®Ïߺ󣬿ª·¢¡¢²¿ÊðЧÂÊ´ÓÔÀ´µÄСʱ¼¶±ð½µµÍµ½·ÖÖÓ¼¶±ð¡£
ÕâÀïÖ÷ҪʹÓÃÁË coding ƽ̨£¬ÎªÁËÇø·Ö²»Í¬»·¾³£¬½¨Á¢ÁË¿ª·¢¡¢²âÊÔ¡¢Ô¤·¢²¼¡¢²âÊÔËÄÌײ»Í¬Á÷Ë®ÏßÄ£°å£¬»¹ÒýÈëÁ˺ÏÁ÷»úÖÆÀ´¼ÓÈëÈ˹¤ code review ½×¶Î¡£ ÔÚºÏÁ÷½×¶Î£º ͨ¹ý MR HOOK£¬×Ô¶¯ÂÖѯ code review ½á¹û£¬È·±£´úÂëÔÚ review ͨ¹ýºó²ÅÄܽøÐÐÏÂÒ»²½£¨²»Í¬ÍŶӿÉÄÜÒªÇó²»Ò»Ñù£©¡£

ÔÚ CI ½×¶Î£º ͨ¹ý´úÂëÖÊÁ¿·ÖÎö£¬À´ÌáÉý´úÂë¹æ·¶ÐÔ£¬Í¨¹ýµ¥Ôª²âÊÔ£¬À´±£Ö¤·þÎñÖÊÁ¿¡£

ÔÚ CD ½×¶Î£º ͨ¹ýÒýÈëÈ˹¤ÉóÅúºÍ×Ô¶¯»¯²¦²â£¬Ìá¸ß·þÎñÎȶ¨ÐÔ¡£

×ÊÔ´ÀûÓÃÂÊÌáÉý
stage4£º ÔÚÒµÎñÕûÌåÉÏÔÆºó£¬ÓÉÓÚ²»ÉÙÒµÎñÓÐ¶àµØÓò²¿Ê𣨹ãÖÝ¡¢ÄϾ©¡¢Ìì½ò¡¢Ïã¸Û£©µÄÊöÇ󣬼ÓÉÏÿ¸ö·þÎñÐèÒªËÄÌ×£¨¿ª·¢¡¢²âÊÔ¡¢Ô¤·¢²¼¡¢Õýʽ£©²»Í¬µÄ»·¾³£¬ÉÏÔÆºóÎÒÃdzõ²½ÕûÀí£¬Ò»¹²ÓÐ3000+²»Í¬ workload¡£ÓÉÓÚ²»Í¬ÒµÎñ·ÃÎÊÁ¿¾ßÓкܴó²»È·¶¨ÐÔ£¬³õÆÚ»ù±¾Éϰ´ÕÕÀíÏë״̬À´ÅäÖÃ×ÊÔ´£¬´æÔÚ²»ÉÙµÄÀË·Ñ¡£
 ΪÁËÌá¸ß×ÊÔ´ÕûÌåÀûÓÃÂÊ£¬ÎÒÃǽøÐÐÁËһϵÁÐÓÅ»¯£¬´óÖÂ×ñÑÈçϹ淶£º

ÕâÀïÓÉÓÚ HPA »áµ¼ÖÂÒµÎñÈÝÆ÷¶¯Ì¬À©Ëõ£¬ÔÚÍ£Ö¹¹ý³ÌÖÐÈç¹ûÔÓÐÁ÷Á¿»¹ÔÚ·ÃÎÊ£¬»òÕ߯ô¶¯»¹Î´Íê³É¾Íµ¼ÈëÁ÷Á¿£¬»áµ¼ÖÂÒµÎñµÄʧ°Ü£¬Òò´Ë ÐèÒªÔ¤ÏÈ¿ªÆô TKE ÉÏ preStop ÒÔ¼°¾ÍÐ÷¼ì²âµÈÅäÖà ¡£
ÓÅÑÅÍ£Ö¹£¬½ø³ÌֹͣǰµÈ±±¼«ÐÇ¡¢cl5 ·ÓÉ»º´æ¹ýÆÚ£»Èë¿Ú£ºtke->¹¤×÷¸ºÔØ->¾ßÌåÒµÎñ->¸üй¤×÷¸ºÔØ Èç¹ûʹÓõķþÎñ·¢ÏÖÊÇ CL5£¬ÍƼö preStop70s£¬±±¼«ÐÇÅäÖà 10s ×ã¹»ÁË¡£
¾ÍÐ÷¡¢´æ»î¼ì²â£¬½ø³ÌÆô¶¯Íê³ÉºóÔÙµ÷ÅäÁ÷Á¿£»Èë¿Ú£ºtke->¹¤×÷¸ºÔØ->¾ßÌåÒµÎñ->¸üй¤×÷¸ºÔØ£¬¸ù¾Ý²»Í¬ÒµÎñÅäÖò»Í¬Ì½²â·½Ê½ºÍʱ¼ä¼ä¸ô¡£
ͨ¹ýÉÏÃæÒ»ÏµÁе÷ÕûÓÅ»¯£¬ ÎÒÃǵÄ×ÊÔ´ÀûÓÃÂÊ´ó·ùÌáÉý £¬Í¨¹ý TKE Éϵ¯ÐÔÉýËõ£¬ ÔÚ±£Ö¤ÒµÎñÕý³£·ÃÎÊͬʱ£¬¾Ö²¿¸ß·å·ÃÎÊ×ÊÔ´²»×ãµÄÎÊÌâ»ù±¾½â¾ö£¬±ÜÃâÁË×ÊÔ´ÀË·Ñ£¬Ò²ÌáÉýÁË·þÎñÎȶ¨ÐÔ £»µ«¶à»·¾³ÎÊÌ⻹ÊǻᵼÖ´æÔÚÒ»¶¨ËðºÄ¡£
¿É¹Û²âÐÔ¼¼Êõ
stage4£º ³õÆÚʹÓûùÓÚÈÕÖ¾µÄ·½Ê½À´×ö£¨log/metric/tracing£©£¬Âú×ãÁËÒµÎñ¿ìËÙÉÏÔÆ¡¢ÎÊÌâÅŲéЧÂÊÌáÉýµÄ³õ²½ÊöÇ󣬵«Ëæ×ÅÒµÎñ¹æÄ£Ôö³¤£¬Óú¼ÓÅÓ´óµÄÈÕÖ¾Á÷Õ¼ÓÃÁËÔ½À´Ô½¶àµÄ×ÊÔ´£¬ÈÕÖ¾¶Ñ»ýÔڸ߷åÆÚ³ÉΪ³£Ì¬£¬ CMS ¸æ¾¯¿ÉÄܺÍʵ¼Ê·¢ÉúʱÒѾ¼ä¸ôÁ˰ë¸öСʱ£¬ELK µÄά»¤³É±¾Ò²¼±¾çÉÏÉý¡£ ÔÆÔÉúµÄ¿É¹Û²â¼¼ÊõÒѾ³ÉΪ±ØÒª £¬ÕâÀïÎÒÃÇÒýÈëÁË Coding Ó¦ÓùÜÀíËùÍÆ¼öµÄ¿É¹Û²â¼¼Êõ·½°¸£¬Í¨¹ýͳһµÄ coding-sidecar ¶ÔÒµÎñÊý¾Ý½øÐвɼ¯£º

- ¼à¿Ø£ºÔÆ¼à¿ØÖÐ̨
- ÈÕÖ¾£ºCLS
- Tracing£ºAPM

ͨ¹ý½ÓÈëÕâЩƽ̨µÄÄÜÁ¦£¬ÎÒÃÇµÄ ÎÊÌâ·¢ÏÖ¡¢¶¨Î»¡¢ÅŲéЧÂÊÓÐÁ˼«´óµÄÌá¸ß£¬ÒµÎñµÄÔËӪά»¤³É±¾½Ï´ó½µµÍ ¡£Í¨¹ý¼à¿Ø¡¢ºÍ tracing£¬Ò²·¢ÏÖÁ˲»ÉÙϵͳDZÔÚµÄÎÊÌ⣬Ìá¸ßÁË·þÎñÖÊÁ¿¡£
½áβ
×îºó£¬Òª¸ÐлÉÏÔÆ¹ý³ÌÖÐÈ«Ì忪·¢Í¬Ñ§µÄÐÁÇÚ¸¶³ö£¬ÒÔ¼°¸÷λÑз¢ leader µÄ´óÁ¦Ö§³Ö¡£
|