(3.236.214.19) 您好!臺灣時間:2021/05/06 22:02
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果

詳目顯示:::

我願授權國圖
: 
twitterline
研究生:榮芊雯
研究生(外文):Chien-Wen Jung
論文名稱:基於影像集之繪畫場景重現
論文名稱(外文):Painting to Photo: Compositing Photos for Realizing Paintings
指導教授:陳炳宇陳炳宇引用關係
口試委員:王昱舜鄭文皇
口試日期:2013-06-20
學位類別:碩士
校院名稱:國立臺灣大學
系所名稱:資訊網路與多媒體研究所
學門:電算機學門
學類:網路學類
論文種類:學術論文
論文出版年:2013
畢業學年度:101
語文別:英文
論文頁數:46
中文關鍵詞:影像合成影像變形影像分割
外文關鍵詞:Image compositeStructure-aware image warpingSegmentation
相關次數:
  • 被引用被引用:0
  • 點閱點閱:168
  • 評分評分:系統版面圖檔系統版面圖檔系統版面圖檔系統版面圖檔系統版面圖檔
  • 下載下載:0
  • 收藏至我的研究室書目清單書目收藏:0
在照相機等攝影記錄工具還沒有被發明的時代,繪畫一直作為紀錄人物或是美麗風景的主要方式,同時也用來敘述許多重要事蹟。通常這些繪畫都是由專業的藝術家所繪製,因此在顏色與結構等的表現上也相當重視,作出來的作品也大多都符合了人類的美感。

在現代,我們則是利用照相機或攝影機等來拍攝記錄我們周遭的生活。但是對於那些藝術家所畫的繪畫,如果我們想要照出一模一樣的照片基本上是不太可能的。直接利用一般的繪圖軟體去轉換也有一定的難度,無法輕易的將繪畫調成具有真實度的"照片"。

因此在這篇論文中,我們提供了一個方法讓繪畫能夠轉換成類似照片的結果。藉由使用者所提供的與繪畫有部分區塊相似的照片,以及相對應的提示筆畫,根據這些對照片作具結構感知的形變。最後再利用繪畫所含的資訊將這些圖片合成為擁有照片感覺的結果。


Before the widespread of modern capture devices, painting played an important role in depicting and recording the real world for human.
These paintings provide immediate depictions of the real world, and usually have artistic appearances.
While modern devices aim at recording the world in the form of photorealistic appearance, it is challenging to produce a photorealistic counterpart of a painting.
In this paper, we present a method for ``transferring'' an input painting into a photorealistic appearance by referring several photos which are partly similar to the painting.
With a number of user-specified corresponding strokes on both the painting and photos, the ``transferred'' result is generated by deforming these corresponding strokes with a structure-aware warping technique and composing the warped photo regions with the painting-guided compositing technique.
We demonstrate the effectiveness of the proposed method on a variety of paintings.

Table of Contents
Abstract iv
List of Figures vii
Chapter 1 Introduction 1
1.1 Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.3 Proposed Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.4 Contribution and Thesis Organization . . . . . . . . . . . . . . . . . . . . . 3
Chapter 2 Related work 4
2.1 Image-based rendering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.2 Image warping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2.3 Image compositing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Chapter 3 Method 8
3.1 Paint to Photo Framework . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
3.2 Structure-aware warping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
3.2.1 Stroke alignment energy . . . . . . . . . . . . . . . . . . . . . . . . 11
3.2.2 Shape distortion energy . . . . . . . . . . . . . . . . . . . . . . . . 12
3.2.3 Smoothness energy . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
3.2.4 Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
3.3 Painting-guided compositing . . . . . . . . . . . . . . . . . . . . . . . . . . 18
3.3.1 Image Painting segmentation . . . . . . . . . . . . . . . . . . . . . 18
3.3.2 Labeling constraint . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
3.3.3 Graphcut composition . . . . . . . . . . . . . . . . . . . . . . . . . 24
Chapter 4 Experiments and Results 26
4.0.4 Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
4.0.5 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Chapter 5 Conclusions and FutureWork 40
Bibliography 42

Bibliography
[1] http://www.v3wall.com/cht/html/pic_show/pic_show_29520.html.
Accessed: 2013-01-30.
[2] http://travel.network.com.tw/tourguide/mtravel/weekend/631.
html. Accessed: 2013-05-29.
[3] http://katy518.xanga.com/albums/b63e8f22323933/. Accessed: 2013-
05-30.
[4] http://hercyxp.pixnet.net/blog/post/28051985. Accessed: 2013-05-07.
[5] http://www.eghamat24.com/. Accessed: 2013-05-07.
[6] http://toujourstw.pixnet.net/blog/category/1522253. Accessed:
2013-05-07.
[7] http://homepage3.nifty.com/poo-pii/golfranking.htm. Accessed:
2013-05-07.
[8] http://zone.it.sohu.com/thread-11619362-1-1.html. Accessed: 2013-
05-30.
[9] http://www.lakecountyhaygrowers.org/. Accessed: 2013-05-30.
[10] http://www.fotothing.com/MaryamD/photo/
4d528fe870a933b21c295d5d90dc3f42/. Accessed: 2013-04-29.
[11] http://www.flickr.com/photos/15005196@N07/6011539125/. Accessed:
2013-04-29.
[12] http://www.flickr.com/photos/25281731@N07/5239152977/. Accessed:
2013-04-29.
[13] Lands of america. http://www.landsofamerica.com/south_dakota/
land-for-sale/320-acres-in-Sanborn-County-South-Dakota/id/
927592. Accessed: 2013-05-29.
[14] Landscape 2. https://www.flickr.com/photos/evauy/3041280350/in/
pool-comparceiros. Accessed: 2013-05-30.
[15] More hay bales - idaho roadside. http://www.gregmortonphotos.com/index.
php?showimage=132. Accessed: 2013-05-30.
[16] Netherlands, europe. http://place.qyer.com/netherlands/. Accessed: 2013-
05-07.
[17] The Traveled Mindbaddeck canada redwhitehouse2. http://
traveledmind.com/2010/06/cape-breton-and-the-cabot-trail/
baddeck-canada-redwhitehouse2/. Accessed: 2013-01-30.
[18] R. Achanta, S. Hemami, F. Estrada, and S. S‥usstrunk. Frequency-tuned salient region detection.
In Proc. IEEE CVPR ’09, pages 1597 – 1604, 2009.
[19] A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin,
and M. Cohen. Interactive digital photomontage. ACM Trans. Graph., 23(3):294–302,
2004.
[20] M. Bansal and K. Daniilidis. Joint spectral correspondence for disparate image matching.
In Proc. IEEE CVPR ’13, 2013.
[21] Y. Boykov, O. Veksler, and R. Zabih. Fast approximate energy minimization via graph cuts.
IEEE Trans. Pattern Anal. Mach. Intell., 23(11):1222–1239, 2001.
[22] M. Budan. Early hay. http://www.saatchionline.com/MandyBudan. Accessed:
2013-05-30.
[23] D. Burdette. Pastoral vista sutton road northfield township michigan. http:
//commons.wikimedia.org/wiki/File:Pastoral_Vista_Sutton_
Road_Northfield_Township_Michigan.JPG. Accessed: 2013-01-30.
[24] P. Camille. Landscape with flock of sheep. http://www.ss.net.tw/page.asp?
id=Pissarro057. Accessed: 2013-05-29.
[25] R. Carroll, A. Agarwala, and M. Agrawala. Image warps for artistic perspective manipulation.
ACM Trans. Graph., 29(4):127:1–127:9, 2010.
[26] R. Carroll, M. Agrawal, and A. Agarwala. Optimizing content-preserving projections for
wide-angle images. ACM Trans. Graph., 28(3):43:1–43:9, 2009.
[27] T. Chen, M.-M. Cheng, P. Tan, A. Shamir, and S.-M. Hu. Sketch2photo: internet image
montage. In ACM Trans. Graph., volume 28, page 124. ACM, 2009.
[28] Christineg. Stock photos: Hay field new zealand. http://www.dreamstime.com/
stock-photos-hay-field-new-zealand-image4430973. Accessed: 2013-
05-30.
[29] Y.-Y. Chuang, B. Curless, D. H. Salesin, and R. Szeliski. A bayesian approach to digital
matting. In Proc. IEEE CVPR ’01, volume 2, pages 264–271, 2001.
[30] cumin. http://www.nipic.com/show/2/27/4322479k1907756a.html. Accessed:
2013-01-30.
[31] L. da Vinci. Mona lisa. http://zh-yue.wikipedia.org/wiki/File:Mona_
Lisa,_by_Leonardo_da_Vinci,_from_C2RMF_retouched.jpg. Accessed:
2013-05-30.
[32] Z. Farbman, G. Hoffer, Y. Lipman, D. Cohen-Or, and D. Lischinski. Coordinates for instant
image cloning. In ACM Trans. Graph., volume 28, page 67. ACM, 2009.
[33] J. Gomes, L. Darsa, B. Costa, and L. Velho. Warping and morphing of graphical objects.
Morgan Kaufmann Publishers Inc., 1998.
[34] D. C. Hauagge and N. Snavely. Image matching using local symmetry features. In Proc.
IEEE CVPR ’12, pages 206–213, 2012.
[35] T. Igarashi, T. Moscovich, and J. F. Hughes. As-rigid-as-possible shape manipulation. ACM
Trans. Graph., 24(3):1134–1141, 2005.
[36] A. Jacobson, I. Baran, J. Popovi’c, and O. Sorkine. Bounded biharmonic weights for realtime
deformation. ACM Trans. Graph., 30(4):78:1–78:8, 2011.
[37] Jess. mona-lisa-eyes. http://mona-lisa-eyes.deviantart.com/. Accessed:
2013-05-30.
[38] J. Jia, J. Sun, C.-K. Tang, and H.-Y. Shum. Drag-and-drop pasting. ACM Trans. Graph.,
25(3):631–637, 2006.
[39] Jochi. Earth - beach wallpaper. http://wall.alphacoders.com/big.php?i=
399764. Accessed: 2013-01-30.
[40] M. K. Johnson, K. Dale, S. Avidan, H. Pfister, W. T. Freeman, and W. Matusik. Cg2real:
Improving the realism of computer generated images using a large collection of photographs.
IEEE Trans. Vis. Comput. Graph., 17(9):1273–1285, 2011.
[41] V. Kwatra, A. Sch‥odl, I. Essa, G. Turk, and A. Bobick. Graphcut textures: Image and video
synthesis using graph cuts. ACM Trans. Graph., 22(3):277–286, 2003.
[42] M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. Gross. Nonlinear disparity
mapping for stereoscopic 3D. ACM Trans. Graph., 29(4):75:1–75:10, 2010.
[43] A. Levin, D. Lischinski, and Y. Weiss. A closed-form solution to natural image matting.
IEEE Trans. Pattern Anal. Mach. Intell., 30(2):228–242, 2008.
[44] F. Liu, M. Gleicher, H. Jin, and A. Agarwala. Content-preserving warps for 3D video stabilization.
ACM Trans. Graph., 28(3):44:1–44:9, 2009.
[45] S.-J. Luo, I.-C. Shen, B.-Y. Chen,W.-H. Cheng, and Y.-Y. Chuang. Perspective-aware warping
for seamless stereoscopic image cloning. ACM Trans. Graph., 31(6):182:1–182:8, 2012.
[46] T. B. Mathias Eitz, Kristian Hildebrand and M. Alexa. PhotoSketch: A sketch based image
query and compositing system. In ACM SIGGRAPH 2009 Talk, 2009.
[47] Nathan. Cloudy sky. http://sc0rp.deviantart.com/art/
Cloudy-Sky-2-5124965. Accessed: 2013-05-29.
[48] P. P’erez, M. Gangnet, and A. Blake. Poisson image editing. ACM Trans. Graph., 22(3):313–
318, 2003.
[49] M. Pharr and G. Humphreys. Physically Based Rendering: From Theory To Implementation.
Morgan Kaufmann Publishers Inc., 2nd edition, 2010.
[50] T. D. Photography. https://www.facebook.com/pages/
Tanya-DHerville-Photography/139246636159314. Accessed: 2013-01-30.
[51] Y. Rubner, C. Tomasi, and L. J. Guibas. A metric for distributions with applications to image
databases. In Proc. IEEE ICCV ’98, pages 59–66, 1998.
[52] S. Schaefer, T. McPhail, and J. Warren. Image deformation using moving least squares.
ACM Trans. Graph., 25(3):533–540, 2006.
[53] H. B. Schumann. https://www.facebook.com/Hotel.Bei.Schumann. Accessed:
2013-01-30.
[54] A. Shrivastava, T. Malisiewicz, A. Gupta, and A. A. Efros. Data-driven visual similarity for
cross-domain image matching. ACM Trans. Graph., 30(6):154:1–154:10, 2011.
[55] N. Stern. You are not banksy. http://h0410232.blogspot.tw/2012/09/
you-are-not-banksy-ny-nick-stern.html. Accessed: 2013-05-30.
[56] J. Sun, J. Jia, C.-K. Tang, and H.-Y. Shum. Poisson matting. ACM Trans. Graph., 23(3):315–
321, 2004.
[57] V. van Gogh. Starry night over the rhone. http://www.ss.net.tw/page.asp?id=
VanGogh132. Accessed: 2013-04-29.
[58] J. Wang and M. F. Cohen. Simultaneous matting and compositing. In Proc. IEEE CVPR
’07, pages 1–8, 2007.
[59] Y.-S. Wang, H. Fu, O. Sorkine, T.-Y. Lee, and H.-P. Seidel. Motion-aware temporal coherence
for video resizing. ACM Trans. Graph., 28(5):127:1–127:10, 2009.
[60] Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee. Optimized scale-and-stretch for image
resizing. In ACM Trans. Graph., pages 118:1–118:8, 2008.
[61] S. Wijma. Oogsttijd in de carel coenraadpolder. http://simonwijma.blogspot.
tw/2011/01/carel-coenraadpolder.html. Accessed: 2013-05-29.
[62] K. Williamson. Kieron williamson, ’mini monet’. http://okok1111111111.
blogspot.tw/2012/07/kieron-williamson-mini-monet.html. Accessed:
2013-05-07.

QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top
1. 56. 趙雅麗(2001)。〈臺灣地區視障者之媒介使用行為與動機調查研究〉,《新聞學研究》,(66):61-96。
2. 56. 趙雅麗(2001)。〈臺灣地區視障者之媒介使用行為與動機調查研究〉,《新聞學研究》,(66):61-96。
3. 38. 郭大玄(2007)。〈台灣區域空間結構的發展與變遷:全球化與資訊產業的作用〉,《華岡地理學報》,(20):39-57。
4. 38. 郭大玄(2007)。〈台灣區域空間結構的發展與變遷:全球化與資訊產業的作用〉,《華岡地理學報》,(20):39-57。
5. 34. 張紹勳(1999)。〈策略資訊系統促進因素之主要構面探討─以臺灣企業為例〉,《中華管理評論》, 2(7):107-125。
6. 34. 張紹勳(1999)。〈策略資訊系統促進因素之主要構面探討─以臺灣企業為例〉,《中華管理評論》, 2(7):107-125。
7. 27. 夏春祥(1997)。〈文本分析與傳播研究〉,《新聞學研究》,(54):141-166。
8. 27. 夏春祥(1997)。〈文本分析與傳播研究〉,《新聞學研究》,(54):141-166。
9. 23. 林麗雲(2012)。〈公共新聞業:在地實踐〉。國立臺灣大學新聞研究所編,《臺大新聞論壇》,(11):119-131。
10. 23. 林麗雲(2012)。〈公共新聞業:在地實踐〉。國立臺灣大學新聞研究所編,《臺大新聞論壇》,(11):119-131。
11. 19. 林季平、柯音如(2004)。〈勞工流動及資訊流動的初探研究〉,《資訊社會研究》,(6):283-312。
12. 19. 林季平、柯音如(2004)。〈勞工流動及資訊流動的初探研究〉,《資訊社會研究》,(6):283-312。
13. 8. 吳尚庭、陳五洲(2011)。〈社群媒體網站對體育輔助教學之應用—以Facebook粉絲專頁為例〉,《臺灣體育論壇》,(2):3-12。
14. 8. 吳尚庭、陳五洲(2011)。〈社群媒體網站對體育輔助教學之應用—以Facebook粉絲專頁為例〉,《臺灣體育論壇》,(2):3-12。
15. 7. 何旭初(2007)。〈市場導向新聞學之思維與運作:《蘋果日報》個案分析〉,《中華傳播學刊》,(11):244-272。
 
系統版面圖檔 系統版面圖檔