臺灣博碩士論文加值系統

我們提出了一個用區塊紋理合成技術為基礎的架構，將一幅繪畫作品風格轉換到3D物件上，並且使3D物件能夠與繪畫作品融合，讓物件彷彿是繪畫作品中原本的物件。利用紋理合成的和色彩轉換的技術，將繪畫作品的風格轉換到3D物件的投射影像。透過基本顏色類別的分類，和統計學的分析方法，將3D物件的投射影像的色彩轉換，使之能與繪畫作品的色調相仿。然後，我們提出了新的二回合紋理合成架構(Two-passes Texture Synthesis ), 與可以改變筆觸走向的方向場貼圖(direction field)，將繪畫作品的筆觸轉移到3D物件的投射影像上。如此在3D物件的投射影像上所合成的筆觸可以隨著3D物件表面起伏而改變，能夠更自然的模擬畫家描繪真實物體時的筆觸。我們的系統可以將繪畫作品的風格成功的轉移到另外物件上，讓物件能夠與繪畫作品相融。

List of Figures vi

1 Introduction 1
1.1 Motivation 1
1.2 Overview 1
1.2.1 Style Transferring 2
1.2.2 Color Transfer 2
1.3 Organization 3

2 Related Work 4
2.1 Augmented Reality of NPR 4
2.2 Example-based Rendering 6

3 Methods 10
3.1 System Overview 10
3.2 Color Transfer 11
3.2.1 The color transfer process 12
3.2.2 Generate Indirect Color Category 15
3.3 Texture Synthesis 17
3.3.1 One-Pass Texture Synthesis 18
3.3.2 Two-Pass Texture Synthesis Framework 22
3.3.3 Direction Field 24
3.4 Composite Projected Image into Example Painting 27

4 Results 29
4.1 Result of color transfer and direction field 29
4.2 The result of our system 32

5 Conclusion 36
5.1 Summary 36
5.2 Future Work 37

Bibliography 38

[Ash01] M. Ashikhmin. Synthesizing Natural Textures. In Proceedings of the 2001 Symposium Interatcive 3D Graphics, pp.217-226, 2001.

[BK69] B. Berlin, P. Kay. Basic Color Terms: Their Universality and Evolution. University of California Press. 1969.

[Bon1997] J.S.D. Bonet. Multiresolution Sampling Procedure for Analysis and Synthesis of Texture Images. In Proceedings of SIGGRAPH 1997, pp. 361-368, 1997.

[CGZ+05] Yung.Y. Chuang, Dan. B Goldman, Ke.C Zheng, Brian Curless, David H. Salesin, Richard Szelisk. Animating Pictures with Stochastic Motion Textures. In Proceedings of ACM SIGGRAPH 2005, 24(3): pp.853~860, July 2005.

[CSU+04] Y. Chang, S. Saito, K. Uchikawa, and M. Nakajima. Example-based color stylization based on categorical perception. In Proceedings of the First Symposium on Applied Percepton in Graphics and Visualization, pp.91~98, 2004.

[EF01] Alexei A. Efros, Willian T. Freeman. Image Quilting for Texture Synthesis and Transfer. In Proceeding of SIGGRAPH 2001, pp341-346, 2001.

[EL03] A.Efros and T. Leung. Texture Synthesis by Non-Parametric Sampling. In Proceedings of IEEE Int’l Conference Computer Vision (ICCV’ 99), pp. 1033-1038, 1999.

[EPW+00] Alex Eilhauer, Alice Pritikin, Dylan Weed, and Steven J. Gorther. Combineing Textures and Pictures with Specialized Texture Synthesis. 2000. http://www.people.fas.harvard.edu/!pritikin/cs/graphics/
[FBS05] Jan Fischer, Dirk Bartz, Wolfgang Straßer. Stylized Augmented Reality for Improved Immersion. In Proceedings of IEEE Virtual Reality Conference 2005, pp.195-202, 2005.

[Fai1997] Fairchild, M.D. Color Appearance Model. Addison-Wesley. 1997.

[GCS02] Artistic Vision: Painterly Rendering Using Computer Vision Techniques. In Proceeding of Int’l Symp. Non-Photorealistic Animation and Rendering (NPAR 2002), 2002.

[GWH01] Michael Garland, Andrew Willmott, Paul S. Heckbert. Hierarchical Face Clustering on Polygonal Surfaces. In Proceedings of the 2001 symposium on Interactive 3D graphics, pp.49-58, 2001.

[Har2001] P. Harrison. A Non-Hierarchical Procedure for Re-Synthesis of Complex Textures. In Proceedinf of Int’l Conf. in Central Europe Computer Graphics an Visualization (WSCG 2001) pp. 190-197, 2001.

[HB1995] D.J. Heeger and J.R. Bergen. Pyramid Based Texture Analysis/Synthesis. In Proceedings of ACM SIGGRAPH 1995, pp. 229-238, 1995.

[HJO+01] Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, David H. Salesin. Image Analogies. In Proceeding of ACM SIGGRAPH 2001, 2001.

[HS04] Michael Haller, Daniel Sperl. Real-Time Painterly Rendering for MR Applications. In Graphite, International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia. pp.189-194, 2004.

[HZ00] Aaron Hertzmann, Denis Zorin. Illustrating Smooth Surface. In Proceeding of ACM SIGGRAPH 2000, pp.517-526.

[HZ01] Aaron Hertzmann, Denis Zorin. Illustrating smooth surfaces. In ACM Transactions on Graphics (Siggraph 2000), pp.517-526, 2001.

[LLW04] A.Levin, D.Lischinski, Y.Weiss. Colorization using optimization. ACM Transactions on Graphics, 23( 3): pp.689–694, 2004.

[LXG+01]L. Liang, C. Liu, Y.-Q. Xu, B. Gou, and H.-Y. Shum. Real-Time Texture Synthesis by Patch-Based Sampling. In ACM Transaction on Graphics, 20(3): pp. 127-150, 2001.

[PFH00] E. Praun, A. Finkelstein, and H. Hoppe. Lapped Textures. In Proceedings of ACM SIGGRAPH 2000, pp. 465-470, 2000.

[PHW+01] Emil Praun, Hugues Hoppe, Matthew Webb, Adam Finkelstein. Real-Time Hatching. In ACM Transactions on Graphics (Siggraph 2001), pp.581-586(21), 2001.

[RAG+01] E. Reinhard, M.Ashikhmin, B.Gooch, P.Shirley. Color transfer between images. In IEEE Computer Graphics and Applications, pp34-41, vol.21, 2001.

[RLC+06] Lincoln Ritter, Wilmot Li, Brian Curless, Maneesh Agrawala, David Salesin. Painting With Texture. In Eurographics Symposium on Rendering (2006)

[SCA+02 ]C. Soler, M.-P. Cani, and A. Angelidis, Hierarchical Pattern Mapping. In ACM Transactions on Graphics (Siggraph 2002), 21(3): pp. 673-680, 2002.

[Tur01] G. Turk. Texture Synthesis on Surface. In Proceedings of ACM SIGGRAPH 2001, pp. 347-354, 2001.

[TZL+02] X. Tong, J. Zhang, L. Liu, X. Wang, B. Guo, and H.-Y. Shum. Synthesis of Bidirectional Texture Functions on Arbitrary Surfaces. In ACM Transaction on Graphics (SIGGRAPH 2002), 21(3):pp.665-675, 2002.

[WAM02] Tomihisa Welsh, Michael Ashikhmin, Klaus Mueller. Transferring Color to Greyscale Image. ACM Transactions on Graphics, 21(3):pp277-280, 2002.

[WL00] L.-Y. Wei and M. Levoy. Fast Texture Synthesis Using Tree Structured Vector Quantization. In Proceedinf of ACM SIGGRAPH 2000, pp. 479-488, 2000.

[WWY+04] Bin Wang, Wenping Wang, Huaiping Yang, Jiaguang Sun. Efficient Example-Based Painting and Synthesis of 2D Directional Texture. In IEEE Transactions Visualization and Computer Graphics, 10(3):pp.266-277, 2004.


[XGS00] Y.-Q. Xu, B. Guo et and H.-Y. Shum. Chaos Mosaic: Fast and Memory Efficient Texture Synthesis. In Technical Report 32, Microsoft Research Asia, 2000.