臺灣博碩士論文加值系統

近年來，立體3D影像編輯在電腦圖學領域裡被廣泛地受到重視，編輯立體3D影像與一般的影像編輯不同，除了針對影像中的內容去做編輯之外，也需要考慮到影像中內容的深度。在這篇論文中，我們提出了一個結構性立體3D影像的編輯架構，這個架構額外參考了立體3D影像中所隱含的深度資訊，能讓使用者針對影像內容做編輯調整，並且能產生符合使用者編輯目標的結果。這個架構可以達到立體3D影像的物件仿製和立體3D影像的內容生成。對於物件的仿製，本論文提出的方法會同時處理物件形狀修正以及顏色融合，讓結果不論在深度或是顏色上都能夠自然。對於影像內容生成，我們提出了一個多元且可靠的影像生成技術，可以達成不同的使用者編輯目標，例如：影像縮放(image retargeting)、影像修補(image inpainting)、紋理生成(texture synthesis)。

Recently, stereoscopic 3D image editing has attracted a great deal of research interest in the computer graphics community. Different from conventional 2D image editing, it usually requires adjustment of the image content as well as the perceived depth. In this dissertation, we present a framework for structural stereoscopic 3D image editing. The framework utilizes the additional information in stereoscopic 3D image, depth structure, to manipulate the image content with respect to the user-specified editing goals. We first adapt the framework to achieve two editing operations: stereoscopic 3D image cloning and stereoscopic 3D image synthesis. The proposed stereoscopic image cloning technique performs both shape adjustment and color blending so that the stereoscopic composite is seamless in both the perceived depth and color appearance. Additionally, we introduce a versatile and robust stereoscopic image synthesis technique for synthesizing stereoscopic images with respect to editing constraints used in different editing applications (eg, image retargeting, image inpainting, texture synthesis). We demonstrate several challenging cases to show the success of our proposed techniques.

Chapter 1 Introduction 1
1.1 Motivation 1
1.2 Proposed Method 2
1.3 Dissertation Organization 5
Chapter 2 Related Work 7
2.1 Image Copy and Paste 7
2.2 Image Warping and Deformation 8
2.3 Patch-based Image Synthesis 9
2.4 Stereoscopic Media Editing 10
Chapter 3 Perspective-awareWarping for Seamless Stereoscopic Image Cloning 11
3.1 Stereoscopic Image Seamless Cloning 14
3.1.1 Preprocessing 16
3.1.2 Contour transfer and mesh construction 17
3.1.3 Iterative disparity adaptation 20
3.1.4 Color blending 27
3.2 Results 27
Chapter 4 Geometrically Consistent Patch-based Stereoscopic Image Synthesis 35
4.1 Stereoscopic Image Synthesis 38
4.1.1 Disparity maps and visibility maps construction 40
4.1.2 Depth-aware patch-pair similarity 43
4.1.3 Stereoscopic image similarity 47
4.1.4 Optimization-based stereoscopic image synthesis 48
4.1.5 Editing constraints 54
4.2 Results 55
4.2.1 Applications 56
4.2.2 Performance 66
4.2.3 Quality evaluation 66
4.2.4 Discussion and Limitation 67
Chapter 5 Conclusion and Future Work 71
Bibliography 73

[1] M. Ashikhmin. Synthesizing natural textures. In Proceedings of I3D 2001, pages 217–226, 2001.
[2] S. Avidan and A. Shamir. Seam carving for content-aware image resizing. ACM Transactions on Graphics, 26(3), 2007.
[3] C. Barnes, E. Shechtman, A. Finkelstein, and D. B. Goldman. PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics, 28(3):24:1–24:11, 2009.
[4] T. Basha, Y. Moses, and S. Avidan. Geometrically consistent stereo seam carving. In Proceedings of ICCV 2011, pages 1816–1823, 2011.
[5] R. Carroll, A. Agarwala, and M. Agrawala. Image warps for artistic perspective manipulation. ACM Transactions on Graphics, 29(4):127:1–127:9, 2010.
[6] R. Carroll, M. Agrawal, and A. Agarwala. Optimizing content-preserving projections for wide-angle images. ACM Transactions on Graphics, 28(3):43:1–43:9, 2009.
[7] C.-H. Chang, C.-K. Liang, and Y.-Y. Chuang. Content-aware display adaptation and interactive editing for stereoscopic images. IEEE Transactions on Multimedia, 13(4):589–601, 2011.
[8] T. Chen, M.-M. Cheng, P. Tan, A. Shamir, and S.-M. Hu. Sketch2Photo: internet image montage. ACM Transactions on Graphics, 28(5):124:1–124:10, 2009.
[9] A. Criminisi, P. Perez, and K. Toyama. Object removal by exemplar-based inpainting. In Proceedings of CVPR 2003, volume 2, pages 721–728, 2003.
[10] S. Darabi, E. Shechtman, C. Barnes, D. B. Goldman, and P. Sen. Image melding: combining inconsistent images using patch-based synthesis. ACM TOG, 31(4):82:1–82:10, 2012.
[11] M. Ding and R.-F. Tong. Content-aware copying and pasting in images. The Visual Computer, 26(6-8):721–729, 2010.
[12] I. Drori, D. Cohen-Or, and H. Yeshurun. Fragment-based image completion. ACM Transactions on Graphics, 22(3):303–312, 2003.
[13] A. Efros and T. Leung. Texture synthesis by non-parametric sampling. In Proceedings of ICCV 1999, volume 2, pages 1033–1038, 1999.
[14] A. A. Efros and W. T. Freeman. Image quilting for texture synthesis and transfer. In Proceedings of ACM SIGGRAPH 2001, pages 341–346, 2001.
[15] Z. Farbman, G. Hoffer, Y. Lipman, D. Cohen-Or, and D. Lischinski. Coordinates for instant image cloning. ACM Transactions on Graphics, 28(3):67:1–67:9, 2009.
[16] T. Igarashi, T. Moscovich, and J. F. Hughes. As-rigid-as-possible shape manipulation. ACM Transactions on Graphics, 24(3):1134–1141, 2005.
[17] J. Jia, J. Sun, C.-K. Tang, and H.-Y. Shum. Drag-and-drop pasting. ACM Transactions on Graphics, 25(3):631–637, 2006.
[18] C. Kim, A. Hornung, S. Heinzle, W. Matusik, and M. Gross. Multi-perspective stereoscopy from light fields. ACM Transactions on Graphics, 30(6):190:1–190:10, 2011.
[19] J. Kim, D. M. Hoffman, and M. S. Banks. The zone of comfort: Predicting visual discomfort with stereo displays. Journal of Vision, 11(8):1–29, 2011.
[20] Y. Kim, Y. Lee, H. Kang, and S. Lee. Stereoscopic 3d line drawing. ACM Transactions on Graphics, accepted, 2013.
[21] S. Koppal, C. L. Zitnick, M. Cohen, S. B. Kang, B. Ressler, and A. Colburn. A viewercentric editor for 3D movies. IEEE Computer Graphics and Applications, 31(1):20–35, 2011.
[22] S. Korman and S. Avidan. Coherency sensitive hashing. In Proceedings of ICCV 2011, pages 1607–1614, 2011.
[23] V. Kwatra, I. Essa, A. Bobick, and N. Kwatra. Texture optimization for example-based synthesis. ACM Transactions on Graphics, 24(3):795–802, 2005.
[24] J.-F. Lalonde, D. Hoiem, A. A. Efros, C. Rother, J. Winn, and A. Criminisi. Photo clip art. ACM Transactions on Graphics, 26(3):3:1–3:10, 2007.
[25] M. Lambooij, W. IJsselsteijn, M. Fortuin, and I. Heynderickx. Visual discomfort and visual fatigue of stereoscopic displays: A review. Journal of Imaging Technology and Science, 53(3):030201, 2009.
[26] M. T. M. Lambooij,W. A. IJsselsteijn, and I. Heynderickx. Visual discomfort in stereoscopic displays: a review. In Proceedings of SPIE, volume 6490, page 64900I, 2007.
[27] M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. Gross. Nonlinear disparity mapping for stereoscopic 3D. ACM Transactions on Graphics, 29(4):75:1–75:10, 2010.
[28] L. Liang, C. Liu, Y.-Q. Xu, B. Guo, and H.-Y. Shum. Real-time texture synthesis by patchbased sampling. ACM Transactions on Graphics, 20(3):127–150, 2001.
[29] F. Liu, M. Gleicher, H. Jin, and A. Agarwala. Content-preserving warps for 3D video stabilization. ACM Transactions on Graphics, 28(3):44:1–44:9, 2009.
[30] W.-Y. Lo, J. van Baar, C. Knaus, M. Zwicker, and M. Gross. Stereoscopic 3D copy & paste. ACM Transactions on Graphics, 29(6):147:1–147:10, 2010.
[31] D. G. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91–110, 2004.
[32] B. Mendiburu. 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen. Focal Press, 2009.
[33] Y. Niu, W.-C. Feng, and F. Liu. Enabling warping on stereoscopic images. ACM Trans. Graph., 31(6):183:1–183:7, 2012.
[34] P. P’erez, M. Gangnet, and A. Blake. Poisson image editing. ACM Transactions on Graphics, 22(3):313–318, 2003.
[35] S. Schaefer, T. McPhail, and J. Warren. Image deformation using moving least squares. ACM Transactions on Graphics, 25(3):533–540, 2006.
[36] D. Simakov, Y. Caspi, E. Shechtman, and M. Irani. Summarizing visual data using bidirectional similarity. In Proceedings of CVPR 2008, 2008.
[37] B. Smith, L. Zhang, and H. Jin. Stereo matching with nonparametric smoothness priors in feature space. In Proceedings of CVPR 2009, pages 485–492, 2009.
[38] J. Sun, L. Yuan, J. Jia, and H.-Y. Shum. Image completion with structure propagation. ACM TOG, 24(3):861–868, 2005.
[39] J.Wang and M. F. Cohen. Simultaneous matting and compositing. In Proceedings of CVPR 2007, pages 1–8, 2007.
[40] L. Wang, H. Jin, R. Yang, and M. Gong. Stereoscopic inpainting: Joint color and depth completion from stereo images. In Proceedings of CVPR 2008, 2008.
[41] O.Wang, M. Lang, M. Frei, A. Hornung, A. Smolic, and M. Gross. StereoBrush: interactive 2D to 3D conversion using discontinuous warps. In Proc. SBIM ’11, pages 47–54, 2011.
[42] Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee. Optimized scale-and-stretch for image resizing. ACM Transactions on Graphics, 27(5):118:1–118:8, 2008.
[43] L.-Y. Wei, S. Lefebvre, V. Kwatra, and G. Turk. State of the art in example-based texture synthesis. In EG 2009 STARs, pages 93–117, 2009.
[44] L.-Y. Wei and M. Levoy. Fast texture synthesis using tree-structured vector quantization. In Proceedings of ACM SIGGRAPH 2000, pages 479–488, 2000.
[45] C. Xiao, M. Liu, Y. Nie, and Z. Dong. Fast exact nearest patch matching for patch-based image editing and processing. IEEE Transactions on Visualization and Computer Graphics, 17(8):1122–1134, 2011.
[46] W. Yang, J. Zheng, J. Cai, S. Rahardja, and C. W. Chen. Natural and seamless image composition with color control. IEEE Transactions on Image Processing, 18(11):2584–2592, 2009.