±¾ÎIJ»½ö½öÏêϸ½²ÊöÁË
IBM InfoSphere DataStage ¼¯ÈºµÄ¹¹½¨ÓëÅäÖã¬Í¬Ê±£¬Ò²ÒÔ¼¸ÖÖµäÐ͵ÄÓ¦Ó󡾰ΪÀý£¬ÎªÓû§ÌṩÁËÏêϸ¶øÈ«ÃæµÄ²Î¿¼¼ÛÖµ¡£²¢ÇÒÖ¸µ¼¿ª·¢ÈËÔ±Éè¼ÆºÍ¹¹½¨¸üΪ¸ßЧºÍ¿ÉÀ©Õ¹ÐÔµÄ
DataStage Êý¾Ý´¦Àí»·¾³¡£
ǰÑÔ
ÔÚ¿ªÊ¼Ö®Ç°£¬ÏÂÃæÁгöÁË×¼±¸ÒÔ¼°ÅäÖà DataStage ¼¯Èº»·¾³£¨ÔÚÕâÀïÒÔ
Linux »·¾³ÎªÀý£©ÎÒÃÇÒª×öµÄÖ÷Òª²½Ö裬×÷Õß¿ÉÒԲο¼ÏÂÃæµÄ²½ÖèÀ´ÔĶÁ±¾ÎÄ£º
1.×¼±¸¼¯Èº»·¾³»úÆ÷£¬°üÀ¨ NAS Server¡¢Domain Server¡¢Engine
Server¡¢Client Server
2.ΪËùÓм¯Èº½Úµã´´½¨ dsadm Óû§¡¢°üÀ¨Ö÷µ¼½ÚµãÒÔ¼°ÆÕͨ¼ÆËã½Úµã
3.ÔÚËùÓм¯Èº½ÚµãÉÏÅäÖÃÎÞÃÜÂë SSH
4.ÔÚÇ°Ãæ×¼±¸ºÃµÄ»úÆ÷Öа²×° Information Server
5.µ¼³ö¡¢µ¼Èë Information Server Engine µÄ°²×°Ä¿Â¼
6.½ÚµãÅäÖü°³¡¾°Ó¦ÓÃ
IBM InfoSphere DataStage ¼¯Èº¼ò½é
ÏÖ´ú¼¯Èº¼¼Êõ
ÖÚËùÖÜÖª£¬¼¯Èº¼ÆËã»úµÄÄÜÁ¦¿ÉÒÔÔÚ IT ×éÖ¯¼Ü¹¹ÖÐ×î´óÏ޶ȵÄÌá¸ßºÍÀûÓÃϵͳ×ÊÔ´¡£ÏÖ´úÐÅϢϵͳµÄ¼¯³É½â¾ö·½°¸½¨Á¢ÔÚ¼¯Èº¼¼ÊõÖ®ÉÏ¿ÉÒÔ´ó´ó½µµÍ¼ÆËãÄÜÁ¦µÄ³É±¾¡£
InfoSphere DataStage ¼¯ÈºÓë Grid µÄÇø±ð
InfoSphere DataStage ÌṩÁËÁ½ÖÖ¼¼ÊõÀ´ÊµÏÖÒ»¸ö×÷ÒµÄܹ»²¢·¢µÄÔËÐÐÔÚ²»Í¬µÄ¼ÆËã½ÚµãÉÏ£¬µÚÒ»ÖÖÊÇ
DataStage ¼¯Èº£¬µÚ¶þÖÖÊÇ DataStage Grid¡£ÏÂÃæÎÒÃÇÀ´¿´Ò»ÏÂÁ½ÕßµÄÖ÷񻂿±ð¡£Ê×ÏÈ£¬DataStage
¼¯Èº½¨Á¢ÔÚ°üº¬¶à¸ö¼ÆËã´¦Àí½ÚµãµÄÍøÂçÖ®ÉÏ£¬ÔÚÕâÑùÒ»¸öÍøÂç½á¹¹ÖУ¬×÷ÒµµÄÔËÐÐ×ÊÔ´ÓÉÅäÖÃÎļþÀ´Ã÷È·Ö¸¶¨£¬¼´ÅäÖÃÎļþÖеÄ×ÊÔ´ÅäÖÃÐÅÏ¢Ö¸Ã÷ÁË×÷Òµ»áÔËÐÐÔÚÕâЩ×ÊÔ´ÉÏ¡£¶øÔÚ
DataStage Grid ÖУ¬²ÉÓÃ×ÊÔ´¹ÜÀíÆ÷Èí¼þ (WLM) µÄ¶¯Ì¬¼ì²éºÍ·ÖÅä×ÊÔ´£¬Ê¹µÃ×÷ÒµµÄÔËÐÐÎÞÐëÒÀÀµÊÖ¹¤ÉèÖ㬴ӶøÔÚÐÅÏ¢¼¼ÊõÖÐÀûÓÃ×îÉÙµÄ×ÊÔ´À´»ñµÃ×î´óµÄͶ×Ê¡£³£ÓõÄ
WLM ÓÐ Tivoli Workload Scheduler LoadLeveler ºÍ Platform
LFS µÈ . ¶øÎÞÂÛ DataStage ¼¯Èº»¹ÊÇ DataStage Grid£¬¶¼¿ÉÒÔʹÓû§¿ÉÒÔÔÚÒ»¸öÍøÂçϵͳÖв¢ÐÐÔËÐÐ×÷Òµ£¨Job£©¡£Èç¹û×÷ÕßÏëÒªÁ˽â¸ü¶àÓйØ
DataStage Grid ÅäÖõÄÐÅÏ¢£¬¿ÉÒÔÏò IBM Service Ìá³ö×Éѯ¡£
×÷ÒµµÄ²¢Ðд¦Àí¼°ÆäϵͳµÄÍØÆË½á¹¹
ΪÁË×î´óÏ޶ȵÄÌá¸ß IBM InfoSphere Information
Server ÒýÇæµÄÊý¾Ý´¦ÀíЧÂÊ£¬Óû§¿ÉÒÔ²ÉÓÃ×÷ÒµµÄ²¢Ðд¦ÀíÒÔ¼°ÏµÍ³µÄ¼¯Èº¼¼Êõ¡£¶øÔÚ DataStage
¼¯ÈºÍøÂçÍØÆËÖУ¬Ã¿¸ö×÷ÒµµÄ¹¤×÷¸ºÔØ»áÔÚÔËÐÐʱ±»·ÖÅäµ½²»Í¬µÄ´¦ÀíÆ÷ÖнøÐд¦Àí¡£ÕâЩ´¦ÀíÆ÷¿ÉÄÜλÓÚÏàͬµÄ¼ÆËã»úÉÏ£¬Ò²¿ÉÄÜλÓÚÓɼÆËã»úÍøÂçÁ¬½ÓÔÚÒ»ÆðµÄ²»Í¬µÄ¼ÆËã»úÉÏ¡£InfoSphere
Information Server ÒýÇæ»áʹÓÃÕâЩ´¦ÀíÆ÷ºÍÆäËüµÄ¼ÆËã»ú×ÊÔ´²¢·¢µÄÍê³ÉÕâЩ×÷Òµ¡£¶øÕâ¸ö²¢ÐÐÒýÇæºÍ
InfoSphere Information Server ÒýÇæ¹²Í¬×é³ÉÁËÒýÇæÍØÆË²ã¡£
IBM InfoSphere DataStage ϵͳ¼¯ÈºÒÔÒýÇæ½ÚµãΪÖ÷µ¼½Úµã£¨Conductor
Node£©£¬Í¬Ê±ÓÉËüÏò¼¯ÈºÖÐµÄÆÕͨ½Úµã£¨Compute Node£©·¢ËÍÊý¾Ý´¦ÀíÖ¸Áî¡£ÒÔ´ËÎªÌØÕ÷µÄ DataStage
¼¯ÈºÒ²¼«´óµÄÌá¸ßÁËÊý¾Ý´¦ÀíËٶȺÍÄÜÁ¦¡£´ËÍ⣬InfoSphere DataStage »¹¾ßÓи߿ÉÀ©Õ¹ÐÔ£¬¿ÉÒԷdz£ÈÝÒ׵ɏü¶àµÄϵͳ½Úµã¡£
ÔÚ±¾ÎÄÖУ¬ÎÒÃǽ«Öصã½éÉÜ IBM InfoSphere DataStage
ÖÐÌṩµÄÓÃÓÚÔÚ·Ö²¼Ê½Íø¸ñ»·¾³ÖжÔÊý¾Ý½øÐйÜÀíºÍ´¦ÀíµÄ¼¼Êõ¡£
ÏÂͼÊÇ»ùÓÚ¶à¸öÎïÀí¼ÆËã»úʵÌåµÄ¼¯ÈºÏµÍ³ÍØÆË½á¹¹£¬ÕâЩ´¦Àí½Úµãͨ¹ýÍøÂçÁ¬½ÓÔÚÒ»Æð£¬¹²Í¬×é³ÉÁË
DataStage µÄ¼¯Èº»·¾³¡£

ͼ 1. »ùÓÚ¶à¸öÎïÀí¼ÆËã»úʵÌåµÄ¼¯ÈºÏµÍ³ÍØÆË½á¹¹
³õʼ»·¾³×¼±¸
ÔÚÏêϸ½éÉÜÈçºÎÅäÖþßÓжà¸ö½ÚµãµÄ DataStage ¼¯Èº»·¾³Ö®Ç°£¬ÓÐһЩ±ØÒªµÄ³õʼ»·¾³×¼±¸¹¤×÷ÐèÒªÍê³É¡£
´î½¨»·¾³ËùÐèÒªµÄ»úÆ÷×ÊÔ´
¼ÙÉèÎÒÃǵļ¯Èº»·¾³ÖÐ InfoSphere? Information Server
µÄÿ¸ö²ã¶¼¶ÀÁ¢Õ¼ÓÃÒ»¸ö¼ÆËã»ú×ÊÔ´£¬ÒÔÔÚ Linux OS Éϴһ¸ö DataStage µÄ¼¯Èº»·¾³ÎªÀý×Ó£¬ÄÇôÎÒÃÇÖÁÉÙÐèÒªÏÂÃæµÄ×ÊÔ´£º
1.NAS Server£ºLinux OS£¬Host Name ¼ÙÉèΪ
iisperfblade0£¬ÓÃÓÚÌṩ Information Server µÄ Engine °²×°Ä¿Â¼ÒÔµ¼³öµ½Ö÷µ¼½ÚµãºÍÆäËüµÄÆÕͨ½ÚµãÖС£
2.Domain ²ã : Linux OS£¬Host Name ¼ÙÉèΪ
iisperfblade_domain£¬ÓÃÓÚ°²×° Information Server µÄ Services
tier( ·þÎñ ) ÒÔ¼° Metadata repository tier ( ´æ´¢Êý¾Ý¿â )
3.Engine ²ã£ºLinux OS£¬Host Name ¼ÙÉèΪ iisperfblade11£¬ÓÃÓÚ°²×°
Information Server µÄ DataStage Server ÒÔ¼°´¦ÀíÒýÇæ
4.Client ²ã£ºWindows OS£¬Host Name ¼ÙÉèΪ
iisperfblade_client£¬ÓÃÓÚ°²×° Information Server µÄ¿Í»§¶ËÈí¼þ
ÆÕͨ½Úµã£ºLinux OS£¬ÆÕͨ¼ÆËã½ÚµãµÄ¸öÊýÒªÇó²¢Ã»ÓÐÏÞÖÆ£¬µ«ÊÇÒª×é³É¼¯ÈºÖÁÉÙÐèÒªÒ»¸öÆÕͨ¼ÆËã½Úµã¡£ÔÚÎÒÃÇÏÂÃæµÄÀý×ÓÖУ¬¼ÙÉ軹ÓÐÁíÍâµÄÈý¸ö¼ÆËã½Úµã£¬Host
Name ·Ö±ðΪ iisperfblade12£¬iisperfblade13£¬ºÍ iisperfblade14¡£
¶ÔÓÚÿ¸ö»úÆ÷ÒÔ¼°×ÊÔ´µÄ²Ù×÷ϵͳ£¬ÓÉÓÚ Information Server
µÄ Client ²ãÓÃÓÚ°²×° DataStage µÄ¿Í»§¶ËÈí¼þ£¬Ö»Äܰ²×°ÔÚ Windows ÉÏÃæ£¬ËùÒÔ
Client ²ã±ØÐëΪ Windows ²Ù×÷ϵͳ¡£¶ø DataStage µÄ¼¯ÈºÐèÒª½¨Á¢ÔÚ Linux
»·¾³ÖУ¬ÄÇô Information Server Domain ²ã¡¢Engine ²ãÒÔ¼°ËùÓÐµÄÆÕͨ¼ÆËã½Úµã¶¼ÒªÇóΪ
Linux ²Ù×÷ϵͳ¡£
Ϊ DataStage ½Úµã×ÊÔ´´´½¨¹ÜÀíÔ±Óû§
¶ÔÓÚÿһ¸ö InfoSphere DataStage ÒýÇæ¶¼ÐèÒªÒ»¸ö²Ù×÷ϵͳÓû§£¬Ò»°ãÇé¿öÏ»áʹÓÃ
dsadm¡£Óû§¿ÉÒÔÑ¡ÔñÔÚ°²×°µÄ¹ý³ÌÖд´½¨Õâ¸öÓû§£¬Ò²¿ÉÒÔÔÚ°²×°Ö®Ç°ÊÖ¹¤´´½¨ºÃÕâ¸öÓû§£¬È»ºóÔÚ°²×°¹ý³ÌÖÐÑ¡ÔñËü¡£
Õâ¸öÓû§»áÓÃÀ´×öһЩ¹ÜÀíÐÔµÄÈÎÎñ£¬ÀýÈ磺´´½¨ÐµÄÏîÄ¿¡¢¶¨ÒåÏîÄ¿ÊôÐÔ¡¢±àÒëÔËÐÐ×÷ÒµµÈ¡£ÏÂÃæ¸ø³öÁËÔÚ×¼±¸
DataStage ¼¯Èº»·¾³¹ý³ÌÖд´½¨Óû§µÄ²½Öè¡£
1.ÒÔ root Óû§µÇ¼ÿһ¸ö DataStage ½Úµã£¨°üÀ¨Ö÷µ¼½ÚµãÒÔ¼°ÆäËüËùÓÐµÄÆÕͨ¼ÆËã½Úµã£©¡£
2.Èç¹ûÓû§Ï£ÍûÔÚ°²×° DataStage Engine µÄʱºòÈð²×°³ÌÐò×Ô¶¯´´½¨¹ÜÀíÔ±Óû§£¬¶ÁÕß¿ÉÒÔÌø¹ýÔÚÖ÷µ¼½ÚµãÉÏÊÖ¹¤´´½¨µÄ²½Öè¡£
3.Ìí¼ÓÓû§×飺/usr/sbin/groupadd dstage
4.Ìí¼ÓÓû§£º/usr/sbin/useradd -g dstage -d
/home/dsadm dsadm
5.ΪÓû§ÉèÖÃÃÜÂ룺/usr/sbin/passwd dsadm
×¢Ò⣺ĬÈÏÇé¿öÏ£¬ÎÒÃÇÒ»°ãΪ InfoSphere DataStage
´´½¨µÄÓû§ÃûÊÇ dsadm£¬Èç¹ûÊÇÔÚ AIX ϵͳÉÏʹÓÃ×Ô¶¨ÒåÓû§Ãû³Æ£¬Çë²»Òª³¬¹ý 8 ¸ö×Ö·û¡£
ÎÞÃÜÂëµÄ SSH ·þÎñ
IBM InfoSphere DataStage ϵͳ¼¯ÈºÖÐÓÉÖ÷µ¼½Úµã£¨Conductor
Node£©Ïò¼¯ÈºÖÐµÄÆÕͨ½Úµã£¨Compute Node£©·¢ËÍÊý¾Ý´¦ÀíÖ¸ÁÕâ¸ö¹ý³ÌÐèÒªÖ÷µ¼½ÚµãºÍÆÕͨ½ÚµãµÄͨÐÅ¡£ÔÚ
DataStage ϵͳ¼¯ÈºÍøÂçÖУ¬Í¨¹ý SSH£¨Secure Shell£©½øÐÐͨÐÅ¡£
InfoSphere DataStage ¼¯ÈºÖÐÖ÷µ¼½ÚµãºÍÆÕͨ½ÚµãµÄͨÐÅÊÇͨ¹ýÎÞÃÜÂëµÄ
SSH ·þÎñÀ´Íê³ÉµÄ¡£ÆÕͨ¼ÆËã½ÚµãÉϵÄÓû§Í¨¹ýËüµÄ¹²ÓÐÃÜÔ¿À´½øÐÐÈÏÖ¤¡£ÔÚÖ÷µ¼½ÚµãºÍËùÓÐµÄÆÕͨ¼ÆËã½ÚµãÉϽøÐÐÎÞÃÜÂë
SSH ·þÎñµÄÅäÖ÷½·¨ÎÒÃǽ«ÔÚÏÂһС½ÚÖÐÏêϸ½²Êö¡£
DataStage ¼¯Èº»·¾³¹¹½¨ÓëÅäÖÃ
±¾Ð¡½Ú½ÓÏÂÀ´µÄ¼¸¸ö²¿·Ö½«ÒÔÒ»ÖÖµäÐ͵ÄÍøÂçÍØÆË½á¹¹£ºµ¥ DataStage
·þÎñÆ÷ÒýÇæ¼´µ¥¼¯Èº»·¾³ÎªÀý£¬Ïêϸ½²Êö InfoSphere DataStage ¼¯ÈºµÄ¹¹½¨ÓëÅäÖ÷½·¨¡£
InfoSphere Information Server ·þÎñÆ÷°²×°ÓëÅäÖÃ
InfoSphere Information Server ÌṩÁ˶àÖÖÓû§°²×°·½Ê½£¬Ëü¿ÉÒÔ·ÖΪµ¥²ã°²×°¡¢Ë«²ã°²×°¡¢Èý²ã°²×°ÒÔ¼°¶àÒýÇæ½ÚµãµÄ¶à²ã°²×°µÈ¡£ÏÂͼ¾ÍÊÇÒ»ÖÖ
Information Server Èý²ã°²×°·½Ê½µÄ×ÜÌåÍØÆË½á¹¹Í¼¡£ÏÂÃæÎÒÃǽ«Ê¹ÓõڶþС½ÚÖÐËùÁгöµÄ×ÊÔ´ÒÔÒ»¸öµ¥·þÎñÆ÷ÒýÇæ½ÚµãµÄ°²×°·½Ê½ÎªÀýÀ´½éÉÜ
InfoSphere DataStage ¼¯ÈºµÄ¹¹½¨ÓëÅäÖ÷½·¨¡£

ͼ 2. Information Server
Èý²ã°²×°·½Ê½µÄ×ÜÌåÍØÆË½á¹¹
µ¥·þÎñÆ÷ÒýÇæ
Ê×ÏÈ£¬ÎÒÃǽéÉÜ×î¼òµ¥µÄÒ»ÖÖ DataStage ¼¯Èº¹¹½¨·½Ê½£¬¾ßÓе¥¸ö·þÎñÆ÷ÒýÇæµÄÍøÂçÍØÆËÀ´¹¹½¨ÎÒÃǵļ¯Èº»·¾³¡£DataStage
ÊÇ InfoSphere Information Server ²úÆ·µÄÖØÒª×é³É²¿·Ö . ¹¹½¨ DataStage
¼¯ÈºÊ×ÏÈÒª°²×° InfoSphere Information Server¡£InfoSphere Information
Server µÄ°²×°·½Ê½²ÉÓÃÈý²ã°²×°£¬¼´¿Í»§¶ËÈí¼þÒ»¸ö²ã´Î£¬Information Server ·þÎñÈí¼þºÍ´æ´¢Êý¾Ý¿â
(XMETA) Ò»¸ö²ã´Î , ÒÔ¼° Information Server Engine Ò»¸ö²ã´Î£¬ÈçÏÂͼËùʾ¡£ÔÚ
Information Server Engine ÕâÒ»²ã£¬ÓÐÒ»¸öÖ÷µ¼½Úµã (Head Node) ºÍÈý¸öÆÕͨ¼ÆËã½Úµã
(Compute Node)£¬ÆäÖУ¬ÓÉÖ÷µ¼½ÚµãÀ´Óë Information Server ·þÎñ²ã½øÐÐͨÐÅ£¬Í¬Ê±£¬ÓÉÖ÷µ¼½ÚµãÀ´ÓëÆäËüµÄÆÕͨ½Úµã½øÐÐͨÐÅ
, ¼°ÆÕͨ½Úµã¼äµÄͨѶ¡£

ͼ 3. ¾ßÓе¥·þÎñÆ÷ÒýÇæµÄ¼¯Èº»·¾³
¶à·þÎñÆ÷ÒýÇæ
´Ë´¦£¬ÎÒÃǽéÉÜÁíÍâÒ»ÖÖ°²×°ÍØÆË½á¹¹£¬¼´ÓÐÁ½¸ö·þÎñÆ÷ÒýÇæ¼´Ë«¼¯Èº»·¾³µÄÍøÂçÍØÆË¡£Í¬Ñù£¬ÎÒÃǰÑ
Information Server µÄ×ÜÌåÍØÆË½á¹¹·ÖΪÈý¸ö²ã´Î£ºÒ»Êǿͻ§¶Ë²ã£¬ÓÃÓÚ°²×° Information
Server µÄ¿Í»§¶ËÈí¼þ¡£Ò»ÊÇ Information Server ÒýÇæ²ã¡£ÔÚÕâ¸öÍØÆËÖÐÓÐÁ½¸öÒýÇæ²ã£¬ÔÚÿ¸öÒýÇæ²ãÖи÷ÓÐÒ»¸öÒýÇæÊµÀý£¬Òò´ËÓÖÁ½¸öÖ÷µ¼½Úµã¡£×îºóÒ»¸öÊÇ
Information Server µÄ·þÎñ¼° XMETA Êý¾Ý¿â²ã£¬ÓÃÓÚ°²×°Äܹ»Ìṩ¸÷ÖÖ·þÎñµÄÈí¼þϵͳ¡£Í¬µ¥·þÎñÆ÷ÒýÇæÒ»Ñù£¬¸÷ÒýÇæÓÉÖ÷µ¼½ÚµãÀ´Óë
Information Server ·þÎñ²ã½øÐÐͨÐÅ£¬Í¬Ê±£¬ÔÚͬһÒýÇæÄÚÖ÷µ¼½ÚµãÓëÆäËüµÄÆÕͨ½Úµã½øÐÐͨÐÅ
, ¼°ÆÕͨ½Úµã¼äµÄͨÐÅ¡£ÏÂͼÏÔʾÁË´ËÍøÂçÍØÆËµÄÏêϸ¼Ü¹¹Í¼¡£

ͼ 4. ¾ßÓÐË«·þÎñÆ÷ÒýÇæµÄ¼¯Èº»·¾³ÍØÆËͼ
Secure Shell ·þÎñ£¨SSH£©ÅäÖÃ
ÔÚÉÏһС½ÚÖн²ÊöÁËÁ½ÖÖ DataStage ¼¯Èº¼Ü¹¹£¬Í¬Ê±·Ö±ðÌṩÁËËüÃǵÄÍøÂçÍØÆË½á¹¹¡£±¾Ð¡½Ú¼¯ÈºÅäÖÃÖУ¬ÎÒÃǰ´ÕÕµÚ¶þ½ÚÖÐÌṩµÄ¼ÆËã»ú×ÊÔ´£¬ÒÔÒ»¸ö
DataStage ¼¯ÈºÎªÀýÏêϸ½²ÊöÆä»·¾³ÅäÖ÷½Ê½¡£
¸ù¾ÝÉÏÊö×ÊÔ´£¬¶Ô Information Server ½øÐÐÈý²ã°²×°£¬¶ÔÓÚÿ¸ö²ãÉϵݲװ²½Öè¶¼±È½ÏµäÐÍ£¬ÔÚÕâÀï²»ÔÙ׸Êö£¬×÷Õß¿ÉÒԲο¼
Information Server ÐÅÏ¢ÖÐÐÄÉϵݲװÎĵµ
http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r5/index.jsp
¡£ ÔÚÍê³ÉÉÏÊöÅäÖð²×°Íê³ÉÖ®ºó£¬ÎªÁ˹¹½¨Ò»¸ö¼¯Èº»·¾³£¬ÎÒÃÇÐèҪΪÕâ¸ö»·¾³Ìí¼ÓÐÂµÄÆÕͨ¼ÆËã½Úµã¡£¶øÕâЩ½ÚµãÖеÄͨÐÅÊÇͨ¹ý
SSH À´Íê³ÉµÄ£¬½ÓÏÂÀ´ÎÒÃÇÀ´½²ÊöÈçºÎÔÚÕâЩ½ÚµãÖÐÅäÖÃÎÞÃÜÂë SSH ·þÎñ¡£
ÔÚ¿ªÊ¼Ö®Ç°£¬ÎÒÃÇÀ´Á˽âϼ¯Èº»·¾³Öи÷½Úµã¼äµÄ SSH ͨÐÅ·½Ê½¼°ÔÀí¡£InfoSphere
DataStage ¼¯ÈºÖÐÆÕͨ¼ÆËã½ÚµãÉϵÄÓû§Í¨¹ýËüµÄ¹²ÓÐÃÜÔ¿À´½øÐÐÈÏÖ¤¡£¶øÕâÊÇÔÚÿ¸öÐèÒªÔËÐÐ×÷ÒµµÄ¼ÆËã½ÚµãÉ϶¼±ØÐëÒª½øÐеÄÒ»¸öÈÏÖ¤´¦Àí¹ý³Ì¡£
¼ÙÉè DataStage Ö÷µ¼½ÚµãÊÇ iisperfblade11£¬ÐèÒªÏòÕâ¸ö»·¾³ÖÐÌí¼ÓÒ»¸öÆÕͨ¼ÆËã½Úµã
iisperfblade14¡£ÏÂÃæÊÇÔÚÖ÷µ¼½ÚµãÒÔ¼°ÆÕͨ¼ÆËã½ÚµãÉÏÅäÖÃÎÞÃÜÂëµÄ SSH µÄÏêϸ·½Ê½£º
1. ÔÚÖ÷µ¼½ÚµãÉÏÉú³É±¾ÉíµÄ¹²ÓкÍ˽ÓÐÃÜÔ¿¶Ô£¨RSA key pair£©£º
Çåµ¥ 1. ÔÚÖ÷µ¼½ÚµãÉÏÉú³É±¾ÉíµÄ¹²ÓкÍ˽ÓÐÃÜÔ¿¶Ô
[dsadm@iisperfblade11 ~]$ ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (/home/dsadm/.ssh/id_rsa): Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/dsadm/.ssh/id_rsa. Your public key has been saved in /home/dsadm/.ssh/id_rsa.pub. The key fingerprint is: d0:dc:31:0c:76:04:ab:46:c4:01:bd:00:e6:2e:43:92 dsadm@iisperfblade11 [dsadm@iisperfblade11 ~]$ |
2. ÔÚÉÏÊöÃüÁîÔËÐÐÖУ¬ÏµÍ³ÌáʾÊäÈëÃÜÂëÉèÖã¬Á¬Ðø°´»Ø³µ£¨enter£©Á½´Î£¬¼´ÉèÖÃÒ»¸ö¿ÕµÄÃÜÂë¡£ÉÏÊöÃüÁîÐèÒªÒÔ
InfoSphere DataStage Óû§£¨Ò»°ãÇé¿öÏÂÊÇ dsadm£©Ö´ÐУ¬²úÉúµÄ¹²ÓкÍ˽ÓÐÃÜÔ¿¶Ô»áÔÚ
dsadm Óû§µÄ home Ŀ¼ÖÐµÄ ~/.ssh/id_rsa ÏÂÃæ¡£
3. °ÑÖ÷µ¼½Úµã iisperfblade11 ÉϲúÉúµÄ¹²ÓÐÃÜÔ¿·¢Ë͸øÆÕͨ¼ÆËã½Úµã£¨ÒÔ
iisperfblade14 ΪÀý£©£º
Çåµ¥ 2. °ÑÖ÷µ¼½Úµã iisperfblade11 ÉϲúÉúµÄ¹²ÓÐÃÜÔ¿·¢Ë͸øÆÕͨ¼ÆËã½Úµã
cd /home/dsadm/.ssh/ [dsadm@iisperfblade11 .ssh]$ ssh-copy-id -i dsadm/.ssh/id_rsa.pub dsadm@iisperfblade14 27 The authenticity of host 'iisperfblade14 (192.168.1.12)' can't be established. RSA key fingerprint is e2:f9:98:cc:a5:2a:19:c5:c9:d4:ec:e6:47:1a:c3:a0. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'iisperfblade14, ' (RSA) to the list of known hosts. dsadm@iisperfblade11's password: Now try logging into the machine, with "ssh 'dsadm@iisperfblade11'", and check in: .ssh/authorized_keys to make sure we haven't added extra keys that you weren't expecting. [dsadm@iisperfblade11 ~]$ |
4. Èç¹ûÉÏÊöÃüÁîÎÞ·¨ÕýÈ·Ö´ÐУ¬×÷Õß¿ÉÒԵǼµ½ÆÕͨ¼ÆËã½Úµã iisperfblade14
ÉÏ£¬°ÑÕâ¸ö¹²ÓÐÃÜÔ¿Ìí¼Óµ½×ÔÉíµÄÊÚȨÃÜÔ¿ÁбíÖУ¬Í¬Ê±ÐÞ¸ÄÕâ¸öÊÚȨÎļþµÄȨÏÞ£º
Çåµ¥ 3. °Ñ¹²ÓÐÃÜÔ¿Ìí¼Óµ½×ÔÉíµÄÊÚȨÃÜÔ¿ÁбíÖÐ
cd .ssh cat id_rsa.pub >>authorized_keys chmod 640 authorized_keys rm -f id_rsa.pub |
5. ½á¹ûÑéÖ¤£º
ÏÖÔÚÄã¿ÉÒÔ´Ó InfoSphere DataStage µÄÖ÷µ¼½ÚµãÉÏ¿ÉÒÔͨ¹ýÎÞÃÜÂëµÄ
SSH Á¬½Óµ½ÆÕͨ¼ÆËã½ÚµãÉÏÁË¡£
Çåµ¥ 4. ½á¹ûÑéÖ¤
[dsadm@iisperfblade11 .ssh]$ ssh iisperfblade14 Last login: Sun Jun 26 23:03:09 2011 from iisperfblade11.svl.ibm.com IISPERFBLADE14 Security level of data on this Machine, Use of this system is subject to audit at any time by management. Last APAR security update: Sun Aug 8 12:09:08 PDT 2010 [dsadm@iisperfblade14 ~]$ |
½á¹ûÏÔʾÖ÷µ¼½ÚµãÓëÆÕͨ¼ÆËã½ÚµãͨÐųɹ¦¡£°´ÕÕ´ËÅäÖ÷½·¨£¬ÔÚÆäËüµÄ¼ÆËã½Úµã
iisperfblade12, iisperfblade13 ÉÏÒ²ÅäÖÃÉÏÎÞÃÜÂëµÄ SSH¡£
InfoSphere DataStage Ö÷µ¼½Úµã£¨Conductor
Node£©¹¹½¨
1. ͨ¹ý NFS Server iisperfblade0 µ¼³ö NAS
ÉϵĹ²ÏíĿ¼ /install
ÔÚÕâÀïÎÒÃÇÐèÒª°Ñ NAS ÉϵÄĿ¼¹²Ïí¸øÖ÷µ¼½Úµã iisperfblade11
ºÍÆÕͨ¼ÆËã½Úµã iisperfblade12, iisperfblade13, iisperfblade14¡£ÐÞ¸Ä
/etc Ŀ¼Ï嵀 exports Îļþ£¬¶ÔÓÚÿһ¸ö½Úµã·Ö±ðÌí¼ÓÒ»ÐÐ :
/install hostname(rw,no_root_squash,async)
rw ÔÊÐíÕâЩ½Úµã¶ÔÕâ¸ö¹²ÏíĿ¼¿É¶Á¿Éд£¬no_root_squash
ÔÊÐí NFS µÄ¿Í»§¶Ë¿ÉÒÔÒÔ root Óû§Á¬½Ó¡£Ìí¼ÓºóµÄÎļþÈçÏ£º

ͼ 5. Ìí¼Ó DataStage ½ÚµãºóµÄ
exports Îļþ
2. ÖØÆô NFS Server ʹµÃµ¼³öÉúЧ
Çåµ¥ 5. ÖØÆô NFS Server
# /etc/init.d/nfs stop # /etc/init.d/nfs start »òÕß # /etc/init.d/nfs restart |
3. ÔÚ DataStage ½ÚµãÉϵ¼Èë¹²ÏíĿ¼
ÉÏÊö²Ù×÷µÄÄ¿µÄÊÇ°Ñ NAS É쵀 /install Ŀ¼¹²Ïí¸ø DataStage
½Úµã£¨°üÀ¨Ö÷µ¼½ÚµãºÍÆÕͨ½Úµã£©£¬Ê¹ËüÃÇÄܹ»¶ÔÕâһĿ¼¿É¶Á¿Éд£¬²¢ÇÒÈ·±£ NFS µÄ¿Í»§¶Ë¿ÉÒÔÓà root
Óû§Á¬½Ó¡£Íê³ÉÉÏÊöÅäÖÃÖ®ºó£¬ÎÒÃǵǼµ½ iisperfblade11 ÉÏÃæ£¬°ÑÕâ¸öĿ¼µ¼Èë½øÀ´¡£¾ßÌå²½ÖèÈçÏ£º
3.1 ÒÔ root Óû§µÇ¼ iisperfblade11
3.2 ÐÞ¸Ä /etc Ŀ¼Ï嵀 fstab Îļþ£¬Ìí¼ÓÏÂÃæÒ»Ðе½Õâ¸öÎļþ£º
iisperfiisperfblade0:/install /install
nfs rw,nolock 0 0
Ìí¼ÓºóµÄ /etc/fstab ÎļþÈçÏ£º

ͼ 6. Ìí¼ÓºóµÄ /etc/fstab
Îļþ
3.3 ÔÚ iisperfblade11 ¸ùĿ¼Ï´´½¨ /install
Ŀ¼
3.4 ʹÓà mount ÃüÁîµ¼Èë iisperfblade0 ÉϵÄĿ¼
/insall£ºmount /install¡£µ¼ÈëºóµÄÎļþϵͳÈçÏ£º

ͼ 7. µ¼ÈëºóµÄ iisperfblade11
Îļþϵͳ
4. ÔÚÖ÷µ¼½Úµã blade11 Éϰ²×° Information Server
Engine
¶ÔÓÚ Information Server Engine µÄ°²×°£¬Ã¿¸ö²½Öè¶¼±È½ÏµäÐÍ£¬ÔÚÕâÀï²»ÔÙ׸Êö£¬×÷Õß¿ÉÒԲο¼
Information Server ÐÅÏ¢ÖÐÐÄÉϵݲװÎĵµ http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r5/index.jsp
¡£ ÔÚ°²×°¹ý³ÌÖУ¬ÐèҪעÒâµÄÊǰ²×°Ä¿Â¼ÒªÑ¡ÔñÒѾÅäÖÃºÃµÄ /install Ŀ¼¡£
InfoSphere DataStage ÆÕͨ½Úµã£¨Compute
Node£©ÅäÖÃ
µ½Ä¿Ç°ÎªÖ¹£¬ÎÒÃÇÒѾÔÚÖ÷µ¼½Úµã iisperfblade11 Éϰ²×°ÁË
Information Server Engine¡£Í¬Ê±Ò²ÅäÖúÃÁËÖ÷µ¼½ÚµãºÍÆäËüµÄÈý¸öÆÕͨ½Úµã iisperfblade12,
iisperfblade13, iisperfblade14 ÎÞÃÜÂëµÄ SSH ͨÐÅ¡£½ÓÏÂÀ´ÎÒÃÇÐèÒª°Ñ
Information Server Engine µÄ°²×°Ä¿Â¼µ¼³ö£¨export£©µ½ÆÕͨ½ÚµãÉÏ¡£
¾ßÌåµÄµ¼³ö²½ÖèºÍÖ÷µ¼½ÚµãÉϵÄ×ö·¨ÀàËÆ£¬×÷Õß¿ÉÒԲο¼ÉÏһС½ÚÖеIJ½Öè¡£
ϵͳ¹¹½¨Ð¡½Ú
°´ÕÕÉÏÊö·½Ê½ÅäÖúÃϵͳ»·¾³ºó£¬Datastage ¼¯Èº»·¾³ÖеÄÖ÷½ÚµãÒÔ¼°ÆÕͨ½Úµã¾Íͨ¹ý¼ÆËã»úÍøÂçÁ¬½ÓÔÚÒ»Æð£¬²¢ÇÒ¿ÉÒÔͨ¹ýÎÞÃÜÂë
SSH ½øÐÐͨÐÅ¡£
×¢Ò⣺ Èç¹ûÔÚ DataStage µÄ×÷ÒµÖÐʹÓõ½ÁË Oracle Êý¾Ý¿âÁ¬½Ó
Stage£¬ÄÇôÐèÒª×öÈçÏÂÅäÖãº
1.ÕÒµ½ $APT_ORCHHOME/etc Ŀ¼
2.°Ñ remsh.example ÖØÃüÃûΪ remsh
3.ÐÞ¸Ä remsh Îļþ£¬°Ñ rsh ¸ÄΪ ssh
4.°Ñ remcp.example ÖØÃüÃûΪ remcp
ϵͳ¸ºÔعÜÀíÓë·ÖÅä
±¾Ð¡½ÚÖØµã½²ÊöÈçºÎÔÚÒ»¸ö¼¯Èº»·¾³Öиù¾ÝÏîÄ¿µÄʵ¼ÊÔËÐÐÐèÒª£¬È¨ºâϵͳµÄ¸ºÔØ£¬½øÐÐÕýÈ·µÄ·ÖÅäÒÔ¼°¹ÜÀí¡£
DataStage ½ÚµãÅäÖÃÎļþ´´½¨ºÍ×÷ÓÃ
DataStage µÄ½ÚµãÅäÖÃÎļþÓÃÀ´¶¨ÒåÆÕͨ½ÚµãºÍÖ÷µ¼½ÚµãÓÃÒÔÔËÐÐ×÷ÒµµÄ¼ÆËã»ú×ÊÔ´£¬ÔÚÅäÖÃÎļþÖÐÿ¸ö½Úµã¶¼ÓÐËü×Ô¼ºµÄʵÌåÓÃÀ´¶¨ÒåËüµÄÂß¼ÉϵĽڵãÃû×Ö£¬Ò»°ãÇé¿öÏÂÊÇËüµÄ
hostname£¬ÅäÖÃÎļþÖнÐ×ö fastname¡£
ÔÚÅäÖÃÎļþÖаüº¬¶à¸ö½Úµã¿é£¬Ã¿¸ö½Úµã¿é¶¨ÒåÁËËü±¾ÉíÂß¼ÉϽڵãµÄÃû×Ö£¬»úÆ÷µÄ
host name£¬½Úµã pool µÄÃû×ÖÒÔ¼°´æ´¢×ÊÔ´µÈ¡£ÏÂÃæÊÇÒ»¸ö°üº¬¶à¸ö½ÚµãµÄÅäÖÃÎļþʾÀý£º
Çåµ¥ 6. ½ÚµãÅäÖÃÎļþʾÀý
{ node "CONDUCTOR" { fastname "production_conductor_node" pools "conductor" resource disk "/u1/Datasets" {pools ""} resource scratchdisk "/u1/Scratch" {pools ""} } node "COMPUTERNODE1" { fastname "production_node1" pools "" resource disk "/u1/Datasets" {pools ""} resource scratchdisk "/u1/Scratch" {pools ""} } node "COMPUTERNODE2" { fastname "production_node2" pools "" resource disk "/u1/Datasets" {pools ""} resource scratchdisk "/u1/Scratch" {pools ""} } node "COMPUTERNODE3" { fastname "production_node3" pools "" resource disk "/u1/Datasets" {pools ""} resource scratchdisk "/u1/Scratch" {pools ""} } } |
node: ½ÚµãµÄÂß¼Ãû³Æ£¬Í¨³£Çé¿öϸù¾Ý´Ë½Úµã±¾Éí¾ßÓеŦÄÜÀ´¶¨Òå¡£ÅäÖÃÎļþÖв»Äܰüº¬¶à¸öÏàͬµÄ½ÚµãÃû×Ö¡£
Fastname: »úÆ÷µÄ host name
Pools: ¶¨ÒåÁËÕâ¸ö½Úµã±»·ÖÅäµ½µÄ½Úµã pool µÄÃû³Æ£¬Ò»¸ö½Úµã¿ÉÒÔ·ÖÅäµ½¶à¸ö½Úµã
pool ÖС£Òò´ËÕâÀïµÄ pools ¿ÉÒÔÓжà¸öÖµ¡£Èç¹ûÕâ¸öֵΪ¿Õ£¬ÄÇô½«Ê¹ÓÃĬÈÏ pool£¬Ä¬ÈÏ pool
¶ÔËùÓÐµÄ stage ¶¼ÊÇ¿ÉÓõÄ
resource disk: ¶¨ÒåÁËÕâ¸ö½ÚµãÓÃÀ´´æ´¢³Ö¾ÃÊý¾ÝµÄ´æ´¢×ÊÔ´
resource scratchdisk: ¶¨ÒåÁËÕâ¸ö½ÚµãÓÃÀ´´æ´¢ÁÙʱÊý¾ÝµÄ´æ´¢×ÊÔ´
ÐÔÄÜÓÅ»¯Ìáʾ£ºÔÚÉÏÃæµÄʾÀýÅäÖÃÖУ¬Ã¿¸ö½Úµã¶¼Ê¹ÓÃÁËÏàͬµÄ scratchdisk
/u1/Scratch£¬Õâ²¢²»ÊÇÒ»¸öºÃµÄʵ¼ù¡£³öÓÚÐÔÄܵĿ¼ÂÇ£¬Ò»°ãÇé¿öϲ¢²»½¨ÒéÕâô×ö£¬¶øÊÇÕë¶Ôÿһ¸ö½Úµã¶¼Ê¹ÓÃÒ»¸ö±¾ÉíרÓõÄ
resource scratchdisk¡£
DataStage ÅäÖÃÎļþÉè¼ÆÓë¹ÜÀí
ÔÚ±¾Ð¡½ÚÖÐÎÒÃÇ¿ÉÒÔʹÓà InfoSphere DataStage ¿Í»§¶ËºÍ
InfoSphere Administrator ¿Í»§¶ËÀ´Éè¼ÆÏîÄ¿ÅäÖÃÎļþ£¬¸ù¾Ý¼¯Èº»·¾³ÖеÄ×ÊÔ´Çé¿ö£¬Îª
DataStage ÏîÄ¿¶¨ÒåʹÓÃ×ÊÔ´¡£
Óû§¿ÉÒÔ¸ù¾Ýʵ¼ÊÐèҪΪÿ¸öÏîÄ¿´´½¨Ò»¸öÅäÖÃÎļþ£¬ÄÇô¶¨ÒåÖ®ºóÕâ¸öÏîÄ¿ÖеÄËùÓеÄ×÷ÒµÔËÐÐʱ¶¼»áÑ¡ÔñÕâ¸öÏîÄ¿µÄÅäÖÃÎļþ¡£ÏÂÃæÎÒÃÇÀ´½²ÊöÔõôΪÏîÄ¿¶¨ÒåÅäÖÃÎļþ¡£
ΪÕû¸öÏîÄ¿¶¨ÒåÅäÖÃÎļþ²½ÖèÈçÏ£º
1.ʹÓà InfoSphere DataStage Design ¿Í»§¶Ë£¬¸ù¾Ýʵ¼ÊÐèÒª´´½¨ºÍÐÞ¸ÄÅäÖÃÎļþ
2.½øÈë DataStage Design ¿Í»§¶ËÑ¡Ôñ Tools ²Ëµ¥
.
3.Ñ¡Ôñ Configurations Ñ¡Ï³öÏÖÅäÖô°¿Ú£¬Ñ¡Ôñн¨£¬ÈçÏÂͼËùʾ£º

ͼ 8. н¨ÅäÖô°¿Ú
4.¸ù¾Ýʵ¼ÊµÄ¼ÆËã»ú×ÊÔ´Ð޸ĴËÅäÖÃÎļþ
5.ÐÞ¸ÄÍê³Éºó£¬µã»÷ Check ÒÔÑéÖ¤Õâ¸öÅäÖÃÎļþ£¬È»ºóµã»÷±£´æ²¢¹Ø±ÕÖ÷ÅäÖÃÎļþÐ޸Ĵ°¿Ú
6.È»ºó´ò¿ª Administrator ¿Í»§¶Ë£¬Ñ¡ÔñÒ»¸öÄãÐèÒª¹ÜÀíµÄÏîÄ¿

ͼ 9. Ñ¡ÔñÐèÒª¹ÜÀíµÄÏîÄ¿
7.Ñ¡Ôñ Properties->Environment->Parallel
8.ÕÒµ½ APT_CONFIG_FILE ²ÎÊý£¬ÊäÈë»òÕßË«»÷Ñ¡ÔñÇ°Ãæ¶¨ÒåºÃµÄÅäÖÃÎļþ

ͼ 10. ÊäÈë»òÕßÑ¡ÔñÇ°Ãæ¶¨ÒåºÃµÄÅäÖÃÎļþ
ÔÚÍê³ÉÉÏÊö²Ù×÷Ö®ºó£¬Õâ¸öÏîĿϵÄËùÓеÄ×÷ÒµÔÚÔËÐÐʱ¶¼»áʹÓÃÕâ¸öÅäÖÃÎļþÖеÄ×ÊÔ´¡£´ËÖÐÅäÖ÷½Ê½µÄÓŵãÊǼòµ¥·½±ã£¬µ«ÊDz»ÄÜÎªÌØÊâµÄ×÷ÒµÖ¸¶¨¼¯ÈºÖеÄ×ÊÔ´¡£ÏÂÃæ½²ÊöΪÏîÄ¿ÖÐÌØ¶¨µÄ×÷Òµ¶¨ÒåÅäÖÃÎļþ¡£
ÎªÌØ¶¨×÷Òµ¶¨ÒåÅäÖÃÎļþ²½ÖèÈçÏ£º
1.ʹÓà InfoSphere DataStage Design ¿Í»§¶Ë£¬Ñ¡Ôñ½øÈë×÷ÒµËùÔÚµÄÏîÄ¿
2.Ñ¡Ôñ´Ë×÷Òµ£¬È»ºóÓÒ»÷µ¥»÷ÊôÐÔ£¬È»ºóÑ¡Ôñ Parameters->Add
Environment Variables£¬ÈçÏÂͼËùʾ£º

ͼ 11. Ñ¡Ôñ Add Environment
Variables
3.Ñ¡Ôñ Configuration file£¬ÈçÏÂͼËùʾ£º

ͼ 12. Ñ¡Ôñ Configuration
file
4.Ñ¡ÔñÒ»¸öÒѾ¶¨ÒåºÃµÄÅäÖÃÎļþ£¬ÈçÏÂͼËùʾ£º

ͼ 13. Ñ¡ÔñÒ»¸öÒѾ¶¨ÒåºÃµÄÅäÖÃÎļþ
ÔÚÍê³ÉÉÏÊö²Ù×÷Ö®ºó£¬Õâ´Î×÷ÒµÔÚÔËÐеÄʱºò»áÑ¡ÔñÕâ¸öÅäÖÃÎļþ¡£
DataStage ½ÚµãÅäÖÃÎļþ·ÖÅä
µ½Ä¿Ç°ÎªÖ¹£¬ÎÒÃÇ¿ÉÒÔ¸ù¾Ý¼¯Èº»·¾³ÖеÄ×ÊԴʹÓà InfoSphere DataStage
Design ¿Í»§¶Ë´´½¨ÅäÖÃÎļþ£¬¿ÉÒÔʹÓà InfoSphere Administrator ¿Í»§¶ËΪÏîĿָ¶¨ÅäÖÃÎļþ£¬Í¬Ê±»¹¿ÉÒÔʹÓÃ
DataStage Design ¿Í»§¶Ë¶¨ÒåÌØÊâ×÷ÒµÅäÖÃÎļþ¡£ÄÇôÏÂÃæ½ÓÏÂÀ´ÎÒÃǽ«½²ÊöËûÃÇÖ®¼äµÄ·ÖÅä¹ØÏµÒÔ¼°ÓÅÏȼ¶Ë³Ðò¡£
¼¯ÈºµÄÅäÖÃÎļþ¶¨ÒåÁËϵͳÖпÉÓõÄ×ÊÔ´£¬ÕâЩ×ÊÔ´°üÀ¨¹Ì¶¨µÄÃû³Æ£¬ÈçÊý¾Ý¿â·þÎñÆ÷£¬SAN
·þÎñÆ÷£¬SAS ·þÎñÆ÷£¬Ô¶³Ì´æ´¢´ÅÅÌ·þÎñÆ÷¡£
ÄÇô£¬¶ÔÓÚ¼¯ÏîÄ¿ÅäÖÃÎļþÒÔ¼°×÷ÒµÅäÖÃÎļþ£¬ËûÃǵĹØÏµºÍÓÅÏȼ¶Ë³ÐòÈçÏ£ºÔÚÒ»¸ö×÷ÒµÔËÐеĹý³ÌÖУ¬Èç¹ûΪÕâ¸ö×÷Òµ¶¨ÒåÁË×÷ÒµÅäÖÃÎļþ£¬ÄÇô
InfoSphere DataStage ÒýÇæ»áÓÅÏÈÑ¡Ôñ×÷ÒµÉϵÄÅäÖÃÎļþ£¬Ê¹ÓÃÕâ¸öÅäÖÃÎļþÀïÃæµÄ×ÊÔ´ÔËÐÐÕâ¸ö×÷Òµ¡£Èç¹ûûÓÐΪÕâ¸ö×÷Òµ¶¨Òå×÷ÒµÅäÖÃÎļþ£¬ÄÇô
InfoSphere DataStage ÒýÇæ»áÑ¡Ôñ×÷ÒµËùÔÚµÄÏîÄ¿ÅäÖÃÎļþ£¬Ê¹ÓÃÏîÄ¿ÅäÖÃÎļþÖеÄ×ÊÔ´ÔËÐÐÕâ¸ö×÷Òµ£¬Èç¹ûûÓÐΪ×÷ÒµËùÔÚµÄÏîÄ¿¶¨ÒåÅäÖÃÎļþ£¬ÄÇô
InfoSphere DataStage ÒýÇæ»áʹÓÃĬÈϵÄÅäÖÃÎļþ default.apt¡£
DataStage ¼¯ÈºÓ¦ÓÃʵ¼ù
ÔÚ±¾ÎĵÚÈýС½ÚÒÔ¼°µÚËÄС½ÚÖУ¬Ïêϸ½²ÊöÁË DataStage ¼¯Èº¹¹½¨ÅäÖúÍϵͳ¸ºÔعÜÀíÓë·ÖÅ䣬±¾½ÚÔÚÈý¡¢ËĽڵĻù´¡ÉÏ×ÅÖØÂÛÊö
DataStage ¼¯ÈºÔÚʵ¼Ê²úÆ·»·¾³ÖеÄÓ¦Ó᣶ÔÓÚ¼¯Èº»·¾³ÖÐʵ¼ÊµÄ×ÊÔ´Çé¿öºÍϵͳÔËÐÐÐèÇó£¬Óû§¿ÉÒÔÐ޸ĺÍÖ¸¶¨ÅäÖÃÎļþ£¬ÒÔʹµÃËüÃÇÄܹ»ºÍʵ¼ÊµÄϵͳ×ÊÔ´ÏàÆ¥Å䡣Ȼºó£¬ÒÔÁ½ÖÖµäÐ͵ÄÓ¦Ó㺲àÖØ´¦ÀíÆ÷£¨CPU)
»òÕßÊÇϵͳÄڴ棨Memory) µÄÓ¦ÓÃÒÔ¼°²àÖØÓ²Å̶Áд£¨Disk IO) µÄÓ¦ÓÃΪÀý£¬Ö¸µ¼Óû§¸ù¾Ý¶ÔÐÔÄܵÄÐèÇóÒÔ¼°ÈíÓ²¼þ×ÊÔ´µÄÓµÓÐÇé¿öºÏÀíÑ¡ÔñÊʺϵķ½·¨²¢Ó¦ÓÃÓÚʵ¼ÊÏîÄ¿ÖС£
Ê×ÏÈ£¬¼ÙÉèÎÒÃÇÒѾÓÐÁËÔÚÇ°ÃæÕ½ÚÖдºÃµÄ DataStage µÄ¼¯Èº»·¾³£¬Í¬Ê±É趨Õû¸ö¼¯Èº»·¾³ÖÐÖ÷µ¼½ÚµãΪ
iisperfblade11£¬Èý¸öÆÕͨµÄ¼ÆËã½Úµã iisperfblade12, iisperfblade13,
iisperfblade14¡£¶øÕâЩ¼ÆËã½Úµã¼ÆËãÄÜÁ¦ºÍÊý¾Ý´¦ÀíÐÔÄÜÓÖ¸÷²»Ïàͬ£¬ÀýÈçÓÐЩ¾ßÓкÜÇ¿µÄ´¦ÀíÆ÷ÔËËãËÙ¶È£¬ÓÐЩ¾ßÓкܿìµÄÊý¾Ý¶ÁдÄÜÁ¦£¬ÓÐЩ¾ßÓкܴóµÄϵͳÄÚ´æµÈ¡£
Ó¦Óó¡¾°Ò»£º²»Í¬ÏîÄ¿ÖеÄ×÷ÒµÔËÐÐÔÚ²»Í¬×ÊÔ´½ÚµãÖÐ
¼¯ÈºµÄ×î´óµÄ×÷ÓþÍÊÇ·Öɢϵͳ¸ºÔص½¼¯ÈºÖеĸ÷¸ö×ÊÔ´ÉÏ£¬Ê¹µÃÿ¸ö½Úµã¶¼³Ðµ£¹¤×÷¸ºÔØ¡£¼ÙÉèÎÒÃǸù¾ÝÏîÄ¿ÐèÇó£¬ÐèÒªÔÚ¾ø´ó¶àÊýʱ¼äÀï²¢·¢ÔËÐÐÒ»°Ù¸ö×÷Òµ£¬ÓÉÓÚµ¥¸ö»úÆ÷µÄ×ÊÔ´ÓÐÏÞ£¬ÀýÈç²»¾ßÓÐÇ¿´óµÄ´¦ÀíÆ÷À´²¢·¢Ö´ÐÐÕâô¶à×÷Òµ¡£ÄÇôÎÒÃÇÏÖÔÚ¾ÍÐèÒª°ÑÕâЩ¹¤×÷¸ºÔØ·ÖÅäµ½¼¯ÈºÖеÄËùÓнڵãÉÏ¡£
Ê×ÏÈ£¬¸ù¾Ý¼¯ÈºµÄËĸö×ÊÔ´½Úµã´´½¨Ëĸö²»Í¬µÄÅäÖÃÎļþ£¬ÒÔÏÂÌṩÁ˸÷¸ö½ÚµãÅäÖù©×÷Õ߲ο¼£¬¾ßÌåµÄ´´½¨²½Öè¿ÉÒԲο¼Ç°ÃæÐ¡½ÚÖеĴ´½¨·½Ê½¡£
Ö÷µ¼½Úµã iisperfblade11 ÅäÖÃÎļþʾÀýÈçÏ£º
Çåµ¥ 7. Ö÷µ¼½Úµã iisperfblade11 ÅäÖÃÎļþʾÀý
{ node "node1" { fastname "iisperfblade11" pools "conductor" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node2" { fastname "iisperfblade11" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node3" { fastname "iisperfblade11" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node4" { fastname "iisperfblade11" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node5" { fastname "iisperfblade11" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} }
} |
ÆÕͨ½Úµã iisperfblade12 ÅäÖÃÎļþʾÀýÈçÏ£º
Çåµ¥ 8. ÆÕͨ½Úµã iisperfblade12 ÅäÖÃÎļþʾÀý
{ node "node1" { fastname "iisperfblade11" pools "conductor" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node2" { fastname "iisperfblade12" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node3" { fastname "iisperfblade12" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node4" { fastname "iisperfblade12" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node5" { fastname "iisperfblade12" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} }
} |
ÆÕͨ½Úµã iisperfblade13 ºÍ iisperfblade14
µÄÅäÖÃÎļþÓë iisperfblade12 µÄÏàËÆ£¬¶ÁÕß¿ÉÒԲο¼½øÐÐÅäÖá£
Æä´Î£¬Îª²»Í¬µÄÏîĿָ¶¨ÆäÔËÐÐËùÐèÒªµÄÅäÖÃ×ÊÔ´£¬·ÖÉ¢¹¤×÷¸ºÔØ¡£¾ßÌåµÄÖ¸¶¨²½Öè×÷Õß¿ÉÒԲο¼
DataStage ÅäÖÃÎļþÉè¼ÆÓë¹ÜÀíС½ÚÖеķ½·¨¡£ÔÚÕâÒ»¹ý³ÌÖУ¬ÎÒÃÇ¿ÉÒÔ¾¡Á¿°ÑËùÓеÄ×÷ҵƽ¾ù·ÖÅäµ½¼¯ÈºÖÐËùÓÐ×ÊÔ´½ÚµãÉÏ¡£ÆäÖУ¬ÓÐÒ»µãÐèҪעÒ⣺Èý¸öÆÕͨ¼ÆËã½ÚµãµÄÅäÖÃÎļþ¶¼ÐèÒª°üº¬Ö÷µ¼½ÚµãÐÅÏ¢£¬ÒÔÈÃ
DataStage ȥʶ±ð³öÖ÷µ¼½Úµã¡£ÀýÈ磬ÔÚÕâÀïÎÒÃǰüº¬ÁËÒ»¸öÃû³ÆÎª conductor µÄ node
pool£¬ËüµÄ fastname ΪÖ÷µ¼½Úµã iisperfblade11¡£Èç¹ûÔÚÅäÖÃÎļþÖÐÈ·ÉÙÁËÕâ¸öÖ÷µ¼½ÚµãµÄÐÅÏ¢£¬ÄÇôÏîÄ¿ÖеÄ×÷Òµ½«ÎÞ·¨ÔËÐС£µ±ÕâÒ»¹ý³ÌÍê³ÉÖ®ºó£¬¾ÍʵÏÖÁ˲»Í¬ÏîÄ¿ÖеÄ×÷ÒµÔËÐÐÔÚÁ˼¯Èº»·¾³ÖеIJ»Í¬×ÊÔ´ÉÏ¡£
´ÓÕâÀï¿ÉÒÔ¿´³ö£¬ÕâÖÖ·½Ê½ÅäÖñȽϷ½±ã£¬Ö»ÐèÒª¼òµ¥µÄ¼¸¸ö²½Öè¾Í¿ÉÒÔ°Ñϵͳ¸ºÔØ·Öµ£µ½²»Í¬µÄ¼¯Èº½ÚµãÉÏ¡£µ«ÊǶÔÓÚÄ³Ð©ÌØÊâµÄ×÷ÒµÐèÒªÔËÐÐÔÚÌØ¶¨µÄ×ÊÔ´½ÚµãÉÏ£¬ÕâÖÐÅäÖ÷½·¨¾ÍÎÞÄÜΪÁ¦ÁË¡£ÏÂÃæÎÒÃǽ²ÊöÈçºÎÅäÖÃÌØ¶¨µÄ×÷ÒµÔËÐе½Ìض¨µÄ×ÊÔ´½ÚµãÉϵÄÓ¦Óá£
Ó¦Óó¡¾°¶þ£ºÌض¨µÄ×÷Òµ Stage ÔËÐе½Ìض¨µÄ×ÊÔ´½ÚµãÉÏ
Èç¹ûÒ»¸öÏîÄ¿µÄÅäÖÃÎļþÄܹ»ÊʺÏÕâ¸öÏîÄ¿Öеľø´ó¶àÊý×÷ÒµÔËÐУ¬ÀýÈçÕâЩ×÷Òµ¶¼ÐèÒªÕ¼ÓúܶàµÄϵͳÄڴ棬¶øÅäÖÃÎļþÖеÄ×ÊÔ´¶¼¾ßÓкܴóµÄÄÚ´æ¡£µ«¶ÔÓÚÄ³Ð©ÌØÊâµÄ
Stage ²»ÐèÒªºÜ´óµÄϵͳÄÚ´æ¶ø½ö½öÐèÒªºÜ¿ìµÄ Disk I/O ËÙ¶È¡£ÅäÖÃÎļþÖеÄ×ÊÔ´¶¼²»¾ßÓпìËÙµÄ
Disk I/O ¶ÁдÄÜÁ¦£¬ÄÇôÎÒÃÇ¿ÉÒÔ°´ÕÕÏÂÃæµÄ·½Ê½½øÐÐÅäÖã¬ÒÔÊÊÓÃÕâÑùµÄÌØÊâµÄÐèÇó¡£
¼ÙÉ輯ȺÖеÄÒ»¸ö½Úµã iisperfblade12 ¾ßÓпìËÙµÄ Disk
I/O ¶ÁдÄÜÁ¦£¬ÎÒÃÇ¿ÉÒÔÔÚÅäÖÃÎļþÖÐÌí¼ÓÕâ¸ö½Úµã£¬ÅäÖÃÈçÏ£º
Çåµ¥ 9. ÅäÖÃÎļþÖÐÌí¼Ó½Úµã iisperfblade12 ʾÀý
{ node "node1" { fastname "iisperfblade11" pools "conductor" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node2" { fastname "iisperfblade14" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node3" { fastname "iisperfblade14" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node4" { fastname "iisperfblade14" pools "" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} } node "node5" { fastname "iisperfblade12" pools "io" resource disk "/tmp" {pools ""} resource scratchdisk "/tmp" {pools ""} }
} |
ÔÚÉÏÃæµÄÅäÖÃÖУ¬ÎÒÃÇÌí¼ÓÁËÒ»¸öеĽڵ㣬Ȼºó°ÑËüµÄ fastname ¶¨ÒåΪ¾ßÓпìËÙ
Disk I/O ¶ÁдÄÜÁ¦µÄ iisperfblade12 ½Úµã¡£Í¬Ê±£¬ÎªÁ˽ö½öʹ×÷ÒµÖеÄÄ³Ð©ÌØÊâµÄ Stage
ʹÓÃÕâ¸ö×ÊÔ´£¬ÐèҪΪËüµÄ node pools ¶¨ÒåÒ»¸öÃû×Ö£¬ÔÚÕâÀﶨÒåΪ¡°io¡±£¬È»ºóΪÕâÐ©ÌØÊâµÄ Stage
ÏÔʽµÄÖ¸¶¨½Úµã¡£Ê¹Óà Designer ¿Í»§¶Ë´ò¿ªÐèÒª´¦ÀíµÄ×÷Òµ£¬Ñ¡Ôñ×÷ÒµÊôÐÔ£¬È»ºó´ò¿ª Advantage
Ò³Ãæ£¬Ñ¡Ôñ Node pool and resource constraint, ͬʱѡÔñÎÒÃÇÔÚÅäÖÃÎļþÖÐÅäÖúõÄ
IO pool£¬¾ßÌå·½·¨ÈçÏÂͼËùʾ£º

ͼ 14. ÎªÌØÊâµÄ Stage ÏÔʽָ¶¨
node pools
Íê³ÉÉÏÊö²Ù×÷Ö®ºó£¬DataStage ¾Í»á°ÑÕâÐ©ÌØÊâµÄ Stage ÔËÐÐÔÚ¼¯ÈºÖеÄÕâ¸ö½ÚµãÉÏ£¬Í¬Ê±ÆäËüµÄ×÷ÒµÈÔÈ»ÔËÐÐÔÚÆäËüµÄºÏÊʵĽڵã×ÊÔ´ÉÏ¡£Õâ¾ÍʹµÃ×÷ÒµÔÚÔËÐÐʱÄÜÑ¡Ôñ¸üÊʺÏÓÚËüÔËÐеļÆËã»ú×ÊÔ´£¬´ó´óµÄÔö¿ìÁËÊý¾Ý´¦ÀíËÙ¶È¡£
Job ¸ºÔؾùºâÓÅ»¯Óë×ܽá
1. ΪÁË×î´ó¿ÉÄܵÄÌá¸ß DataStage ×÷ÒµµÄ´¦ÀíЧÂÊ£¬ÇëΪÿ¸öÏîÄ¿µ¥¶ÀµÄ´´½¨Ò»¸öÅäÖÃÎļþ£¬ÎªÌØÊâµÄ×÷ÒµÉèÖÃÌØÊâµÄ¼¯Èº×ÊÔ´¡£
2. ͨ³£Çé¿öϵÄϵͳ¶¼»áÓв»Í¬µÄÉúÃüÖÜÆÚ£¬Èç¹ûÊÇÔÚ¼¯Èº»·¾³ÖУ¬×î¼Ñʵ¼ùÊÇÐèÒª°ÑÉúÃüÖÜÆÚÖеÄÿ¸ö½×¶Î£¬ÀýÈ翪·¢¡¢²âÊÔºÍÉú²úϵͳ´¦ÓÚ²»Í¬µÄÎïÀí»·¾³ÖС£»ùÓÚЧÂʺͰ²È«µÈÒòËØ£¬²»Òª°ÑÈýÕßÖÃÓÚͬһ¸öÎïÀí¼¯ÈºÖС£
3. ¼¯ÈºµÄÓŵã¾ÍÊǼ¯Èº»·¾³ÖеĽڵãÊýĿԽ¶à£¬¾Í¾ßÓÐÔ½ºÃµÄϵͳÐÔÄÜ¡£ÔÚ
DataStage ¼¯ÈºÖУ¬¼ÆËã½ÚµãµÄÊýĿԽ¶à£¬ÏµÍ³ÍÌÍÂÁ¿¾ÍÔ½´ó¼´¸üºÃµÄÊý¾Ý´¦ÀíÄÜÁ¦¡£ÏÂͼչʾÁ˼¯Èº»·¾³ÖнڵãµÄÊýÄ¿ÓëϵͳÍÌÍÂÁ¿µÄ¹ØÏµ¡£Óû§¿ÉÒÔ¸ù¾Ýʵ¼ÊÐèÒªÀ´È·¶¨¼¯ÈºµÄ½ÚµãÊýÄ¿¡£
×¢£ºÏÂͼÊý¾Ý½ö¹²¶ÁÕ߲ο¼£¬ÐÔÄܲâÊÔËùµÃµ½µÄÊý¾ÝÒ»°ãʹÓÃÌØ¶¨µÄ¼ÆËã»ú»òÕß×é¼þ£¬ÈκÎÓ²¼þ»òÕßÈí¼þÉè¼Æ¡¢ÅäÖÃÉϵIJ»Í¬¶¼»áÓ°Ïìʵ¼ÊËùÈ¡µÃµÄÐÔÄÜÊý¾Ý¡£¶ÁÕßÓ¦¸Ã×Éѯ×ÊÔ´ÖÐÐÄÀ´ÆÀ¹ÀÕýÔÚʹÓõļÆËã»ú¼°Æä×é¼þÐÔÄÜ¡£

ͼ 15. ¼¯Èº»·¾³ÖнڵãµÄÊýÄ¿ÓëϵͳÍÌÍÂÁ¿µÄ¹ØÏµ
×ܽá
±¾ÎIJ»½öÏêϸ½²ÊöÁË IBM InfoSphere DataStage ¼¯ÈºµÄ¹¹½¨ÓëÅäÖã¬Í¬Ê±£¬Ò²ÒÔ¼¸ÖÖµäÐ͵ÄÓ¦Ó󡾰ΪÀý£¬ÎªÓû§ÌṩÁËÏêϸ¶øÈ«ÃæµÄ²Î¿¼¼ÛÖµ¡£²¢ÇÒÖ¸µ¼¿ª·¢ÈËÔ±Éè¼ÆºÍ¹¹½¨¸üΪ¸ßЧºÍ¿ÉÀ©Õ¹ÐÔµÄÊý¾Ý´¦Àí»·¾³¡£
|