±à¼ÍƼö: |
±¾ÎÄÀ´×ÔÓÚcsdn£¬ÎÄÕ½éÉÜÁËÒ»ÖÖ»ùÓÚCNNµÄͼÏñ¸´Ô·½·¨£¬°üÀ¨CNNÍøÂç½á¹¹£¬¹ØÓÚÄÚÈÝÉú³ÉÍøÂçµÄѵÁ·ºÍLoss
NNµÄ¶¨ÒåµÈÏà¹ØÄÚÈÝ¡£ |
|
ͼÏñÐÞ¸´ÎÊÌâ¾ÍÊÇ»¹ÔͼÏñÖÐȱʧµÄ²¿·Ö¡£»ùÓÚͼÏñÖÐÒÑÓÐÐÅÏ¢£¬È¥»¹ÔͼÏñÖеÄȱʧ²¿·Ö¡£

´ÓÖ±¹ÛÉÏ¿´£¬Õâ¸öÎÊÌâÄÜ·ñ½â¾öÊÇ¿´Çé¿öµÄ£¬»¹ÔµÄ¹Ø¼üÔÚÓÚÊ£ÓàÐÅÏ¢µÄʹÓã¬Ê£ÓàÐÅÏ¢ÖÐÈç¹û´æÔÚÓÐȱʧ²¿·ÖÐÅÏ¢µÄpatch£¬ÄÇôʣϵÄÎÊÌâ¾ÍÊÇ´ÓÊ£ÓàÐÅÏ¢ÖÐÅжÏȱʧ²¿·ÖÓëÄÄÒ»²¿·ÖÏàËÆ¡£¶øÕ⣬¾ÍÊÇÏÖÔڱȽÏÁ÷ÐеÄPatchMatchµÄ»ù±¾Ë¼Ïë¡£
CNN³öÏÖÒÔÀ´£¬ÓÐÈô¸É±È½ÏÖØÒªµÄ½øÕ¹£º
±»Ö¤Ã÷ÓÐÄÜÁ¦ÔÚCNNµÄ¸ß²ã²¶×½µ½Í¼ÏñµÄ³éÏóÐÅÏ¢¡£
Perceptual LossµÄ³öÏÖÖ¤Ã÷ÁËÒ»¸öѵÁ·ºÃµÄCNNÍøÂçµÄfeature map¿ÉÒԺܺõÄ×÷ΪͼÏñÉú³ÉÖеÄËðʧº¯ÊýµÄ¸¨Öú¹¤¾ß¡£
GAN¿ÉÒÔÀûÓüලѧϰÀ´Ç¿»¯Éú³ÉÍøÂçµÄЧ¹û¡£ÆäЧ¹ûµÄÔÒòËäÈ»»¹²»¾ß¿É½âÊÍÐÔ£¬µ«ÊÇ¿ÉÒÔÀí½âΪ¿ÉÒÔÒÔÒ»ÖÖ²»Ö±½ÓµÄ·½Ê½Ê¹Éú³ÉÍøÂçѧϰµ½¹æÂÉ¡£
»ùÓÚÉÏÊöÈý¸ö½øÕ¹£¬²Î¿¼ÎÄÏ×[1]Ìá³öÁËÒ»ÖÖ»ùÓÚCNNµÄͼÏñ¸´Ô·½·¨¡£
CNNÍøÂç½á¹¹

¸ÃËã·¨ÐèҪʹÓÃÁ½¸öÍøÂ磬һ¸öÊÇÄÚÈÝÉú³ÉÍøÂ磬ÁíÒ»¸öÊÇÎÆÀíÉú³ÉÍøÂç¡£ÄÚÈÝÉú³ÉÍøÂçÖ±½ÓÓÃÓÚÉú³ÉͼÏñ£¬ÍƶÏȱʧ²¿·Ö¿ÉÄܵÄÄÚÈÝ¡£ÎÆÀíÉú³ÉÍøÂçÓÃÓÚÔöÇ¿ÄÚÈÝÍøÂçµÄ²ú³öµÄÎÆÀí£¬¾ßÌåÔòΪ½«Éú³ÉµÄ²¹È«Í¼ÏñºÍÔʼÎÞȱʧͼÏñÊäÈë½øÎÆÀíÉú³ÉÍøÂ磬ÔÚijһ²ãfeature_mapÉϼÆËãËðʧ£¬¼ÇΪLoss
NN¡£
ÄÚÈÝÉú³ÉÍøÂçÐèҪʹÓÃ×Ô¼ºµÄÊý¾Ý½øÐÐѵÁ·£¬¶øÎÆÀíÉú³ÉÍøÂçÔòʹÓÃÒѾѵÁ·ºÃµÄVGG Net¡£ÕâÑù£¬Éú³ÉͼÏñ¿ÉÒÔ·ÖΪÈçϼ¸¸ö²½Ö裺
¶¨ÒåȱʧÁËij¸ö²¿·ÖµÄͼÏñΪx0
x0ÊäÈë½øÄÚÈÝÉú³ÉÍøÂçµÃµ½Éú³ÉͼƬx
x×÷Ϊ×îºóÉú³ÉͼÏñµÄ³õʼֵ
±£³ÖÎÆÀíÉú³ÉÍøÂçµÄ²ÎÊý²»±ä£¬Ê¹ÓÃLoss NN¶Ôx½øÐÐÌݶÈϽµ£¬µÃµ½×îºóµÄ½á¹û¡£
¹ØÓÚÄÚÈÝÉú³ÉÍøÂçµÄѵÁ·ºÍLoss NNµÄ¶¨Ò壬ÏÂÃæ»áÒ»Ò»½âÊÍ
ÄÚÈÝÉú³ÉÍøÂç

Éú³ÉÍøÂç½á¹¹ÈçÉÏ£¬ÆäËðʧº¯ÊýʹÓÃÁËL2ËðʧºÍ¶Ô¿¹ËðʧµÄ×éºÏ¡£ËùνµÄ¶Ô¿¹ËðʧÊÇÀ´Ô´ÓÚ¶Ô¿¹Éñ¾ÍøÂç.



ÔÚ¸ÃÉú³ÉÍøÂçÖУ¬ÎªÁËÊÇѵÁ·Îȶ¨£¬×öÁËÁ½¸ö¸Ä±ä£º
½«ËùÓеÄReLU/leaky-ReLU¶¼Ì滻ΪELU²ã
ʹÓÃfully-connected layerÌæ´úchnnel-wiseµÄÈ«Á¬½ÓÍøÂç¡£
ÎÆÀíÉú³ÉÍøÂç
ÎÆÀíÉú³ÉÍøÂçµÄLoss NNÈçÏ£º

Ëü·ÖΪÈý¸ö²¿·Ö£¬¼´Pixel-wiseµÄŷʽ¾àÀ룬»ùÓÚÒÑѵÁ·ºÃÎÆÀíÍøÂçµÄfeature layerµÄperceptual
loss£¬ºÍÓÃÓÚÆ½»¬µÄTV Loss¡£
¦ÁºÍ¦Â¶¼ÊÇ5e-6£¬
Pixel-wiseµÄÅ·ÊϾàÀëÈçÏ£º

TV LossÈçÏ£º

Perceptual LossµÄ¼ÆËã±È½Ï¸´ÔÓ£¬ÕâÀïÀûÓÃÁËPatchMatchµÄÐÅÏ¢£¬¼´ÎªÈ±Ê§²¿·ÖÕÒµ½×î½üËÆµÄPatch£¬ÎªÁË´ïµ½ÕâÒ»µã£¬½«È±Ê§²¿·Ö·ÖΪºÜ¶à¸ö¹Ì¶¨´óСµÄpatch×÷Ϊquery£¬Ò²½«ÒÑÓеIJ¿·Ö·ÖΪͬÑù¹Ì¶¨´óСµÄpatch£¬Éú³Édataset
PATCHES£¬ÔÚÆ¥ÅäqueryºÍPATCHESÖÐ×î½üpatchµÄʱºò£¬ÐèÒªÔÚÎÆÀíÉú³ÉÍøÂçÖеÄij¸ölayerµÄ¼¤»îÖµÉϼÆËã¾àÀë¶ø²»ÊǼÆËãÏñËØ¾àÀë¡£
µ«ÊÇ£¬Ñ°ÕÒ×î½üÁÚPatchÕâ¸ö²Ù×÷ËÆºõÊDz»¿É¼ÆËãµ¼ÊýµÄ£¬ÈçºÎÆÆ½âÕâÒ»µãÄØ£¿Í¬MRF+CNNÀàËÆ£¬ÔÚÕâÀÏȽ«PATCHESÖеĸ÷¸öpatchµÄµÄfeature_map³éÈ¡³öÀ´£¬½«Æä×éºÏ³ÉΪһ¸öеľí»ý²ã£¬È»ºóµÃµ½queryµÄfeature
mapºóÊäÈëµ½Õâ¸ö¾í»ý²ãÖУ¬×îÏàËÆµÄpatch½«»ñµÃ×î´óµÄ¼¤»îÖµ£¬ËùÒÔ½«ÆäÔÙÊäÈëµ½Ò»¸ömax-pooling²ãÖУ¬µÃµ½Õâ¸ö×î´óÖµ¡£ÕâÑù£¬¾Í¿ÉÒÔ·´Ïò´«²¥ÁË¡£
¸ßÇåͼÏñÉϵÄÓ¦ÓÃ
±¾Ëã·¨Ö±½ÓÓ¦Óõ½¸ßÇåͼÏñÉÏʱЧ¹û²¢²»ºÃ£¬ËùÒÔ£¬ÎªÁ˸üºÃµÄ³õʼ»¯£¬Ê¹ÓÃÁËStackµü´úËã·¨¡£¼´ÏȽ«¸ßÇåͼÏñdown-scaleµ½Èô¸É¼¶±ð[1,2,3,¡,S]£¬ÆäÖÐS¼¶±ðΪÔͼ±¾Éí£¬È»ºóÔÚ¼¶±ð1ÉÏʹÓÃͼÏñ¾ùÖµ³õʼ»¯È±Ê§²¿·Ö£¬µÃµ½ÐÞ¸´ºóµÄ½á¹û£¬ÔÙÓÃÕâ¸ö½á¹û£¬³õʼ»¯ÏÂÒ»¼¶±ðµÄÊäÈë¡£ÒÔ´ËÀàÍÆ¡£

Ч¹û

ÉÏͼ´ÓÉÏÍùÏÂÒ»´ÎΪ£¬ÓÐȱʧµÄÔͼ£¬PatchMatchËã·¨£¬Context
DecoderËã·¨£¨GAN+L2)ºÍ±¾Ëã·¨¡£
ÄÚÈÝÉú³ÉÍøÂçµÄ×÷ÓÃ

Æðµ½ÁËÄÚÈÝÏÞÖÆµÄ×÷Óã¬ÉÏͼ±È½ÏÁËÓÐÄÚÈÝÉú³ÉÍøÂçºÍûÓÐÄÚÈÝÉú³ÉÍøÂçµÄÇø±ð£¬ÓеĿÉÒÔÔÚÄÚÈÝÉϸü¼Ó·ûºÏÔͼ¡£
Ó¦ÓÃ
ͼÏñµÄÓïÒå±à¼£¬´Ó×óµ½ÓÒÒÀ´ÎΪÔͼ£¬¿Ûµôij²¿·ÖµÄÔͼ£¬PatchMatch½á¹û£¬ºÍ±¾Ëã·¨½á¹û¡£

¿ÉÖª£¬¸Ã·½·¨ËäÈ»²»¿ÉÒÔ¸´ÔÕæÊµµÄͼÏñ£¬µ«È´¿ÉÒÔ²¹È«³ÉÒ»ÕÅÍêÕûµÄͼÏñ¡£ÕâÑù£¬µ±ÅÄÕÕÖÐÓв»Ïë¸ÉµÄÎïÌå»òÈ˽øÈëµ½ÉãÏñÍ·ÖÐʱ£¬ÒÀÈ»¿ÉÒÔ½«ÕÕÆ¬ÐÞ¸´³ÉÒ»ÕÅÍêÕûµÄÕÕÆ¬¡£
×ܽá
CNNµÄ´ó·¢Õ¹£¬Í¼ÏñÔ½À´Ô½Äܹ»±äµÃÓïÒ廯ÁË¡£ÓÐÁËÒÔÉϵÄͼÏñ¸´ÔµÄ»ù´¡£¬¾¡¿ÉÒÔ½øÐз¢»Ó×Ô¼ºµÄÏëÏ󣬯©È磺ÔÚͼÏñÉϼÓÒ»¸ö¶«Î÷£¬µ«ÊǹâÕÕºÍÑÕÉ«µÈȱÃ÷ÏÔ²»´î£¬¿ÉÒÔÓÃÎÆÀíÍøÂç½øÐÐÐÞ¸´¡£
¸Ã·½·¨µÄȱµãÒ²ÊǺÜÃ÷ÏÔ£º
ÐÔÄܺÍÄÚ´æÎÊÌâ
Ö»ÓÃÁËͼƬÄÚµÄpatch£¬¶øÃ»ÓÐÓõ½Õû¸öÊý¾Ý¼¯ÖеÄÊý¾Ý¡£ |