臺灣博碩士論文加值系統

影像式塑模與描繪（Image-based Modeling and Rendering）是近年來大量發展的技術。環場影像是重現場景，讓使用者可以在固定的視點上去瀏覽場景中任意視角的技術。立體視覺則是利用讓人類左右眼分別看到場景中相對於左右眼的影像，使觀賞者可以感受到場景中的深度資訊。增添式環場影像（Augmented Panorama）可以讓我們在環場影像中加入虛擬的三維物件或是真實的環物影片並讓使用者可以互動的技術。我們的方法使用到上述的技術， 用影像式的方法建立立體環場影像（Stereo Panorama）與立體環物影片（Stereo Object Movie）之後，將立體環物影片整合到立體環場影像中，讓使用者可以與之互動。
我們提出了一個方法來整合立體環場影像與立體環物影片。在我們的方法中，使用者可以將立體環物影片放在立體環場影像中並在不同的立體顯示設備上展示與互動。我們提供了三種不同的方法讓使用者將立體環物影片擺在立體環場影像中適當的位置，並調整環物影片以達到較好視覺效果。另外使用者也可以在我們的系統中調整左右眼的視差來改善立體視覺的效果。我們也提出一個透過拍攝多張場景影像來合成立體環場影像的系統。

Image-based modeling and rendering draws lots of research works. Panorama, which has a fixed view position, is a technique to represent virtual or real scenes and viewers can view scenes at any viewing direction. Stereo vision makes human sees depth perception by presenting two eyes
different images which are taken from different viewing positions of a scene. Augmented panorama is a technique which we can add virtual objects or object movies into panoramas and users can interact with those objects. Our
work involves above techniques. We use image-based methods to generate stereo panorama and stereo object movies and propose a method to add stereo object movies into stereo panorama.
In this paper, we proposed a method which combines stereo panorama with stereo object movies. In our system, the user can put stereo object movies into stereo panorama, display results on different stereo devices and interact
with it. We provide three different methods for user to integrate stereo object movies into stereo panoramas. Our system also processes stereo object movies to increase visual effects. And the user can interactively adjust the depth perception of stereo object movies. We also provided a system to generate stereo panoramas.

Chapter 1 Introduction................................... 1
1.1 Depth Cues of Human ................................. 2
1.2 Technologies of Stereoscopic Display ................ 5
1.3 Related Work ........................................ 7
Chapter 2 Stereo Object Movies........................... 9
2.1 Image Acquisition of Stereo Object Movies ........... 9
2.1.1 Capturing Stereo Object Movies by Shifting Camera.. 9
2.1.2 Generating Stereo Object Movies by Morphing ...... 12
2.2 Background Removal ................................. 13
Chapter 3 Stereo Panoramas ............................. 15
3.1 Feature Tracking ................................... 23
3.2 Cylindrical Warping ................................ 24
3.3 Tilt-Distortion Correction.......................... 26
3.4 Strips Cutting and Pasting ......................... 28
3.5 Image Blending...................................... 28
3.6 Stereo Panorama Rendering .......................... 29
3.7 Comparison of Stereo Panoramas and Stereo Pairs .... 32
Chapter 4 Augmented Stereo Panoramas .............................................. 34
4.1 Integration ........................................ 35
4.2 Shifting Stereo OMs................................. 40
4.3 Rendering method ................................... 44
Chapter 5 Experimental Results ......................... 47
5.1 Implementation ..................................... 47
5.2 Results of Stereo OMs............................... 48
5.3 Results of Stereo Panoramas ........................ 50
5.4 Results of Augmented Stereo Panoramas............... 54
Chapter 6 Conclusion ................................... 57
6.1 Summary............................................. 57
6.2 Future Work ........................................ 58

[1] Jean-Yves Bouguet, “Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm”, Intel Corporation, Microprocessor Research Labs, OpenCV. Documents, 1999.
[2] M. Brown and D. G. Lowe, “Recognising Panoramas,” Proceedings of International Conference on Computer Vision, ICCV’03, vol. 2, pp. 1218-1225, Oct. 2003.
[3] C. S. Chen, C. K. Yu, Y. P. Hung, “New Calibration-free Approach for Augmented Reality Based on Parameterized Cuboid Structure,”Proceeding of International Conference on Computer Vision, ICCV’99, pp. 30-37, September 1999.
[4] Shenchang Eric Chen, “Quick Time VR: an image-based approach to virtual environment navigation,” Proc. ACM conf. Computer Graphics (SIGGRAPH’95), pp. 29-38, August 1995.
[5] Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, Michael F. Cohen, “The Lumigraph,” Proc. ACM conf. computer Graphics(SIGGRAPH’96), pp. 43-54, August 1996.
[6] Nick Holliman, “3D Display Systems,” Handbook of Optoelectronics, IOP Press.
[7] C. F. Huang, Y. G. Tang, Y. P. Hung, “Panoramic Image Mosaics,”Master Thesis, Institute of Computer Science and Information Engineering, National Taiwan University, 2002.
[8] H. C. Huang, Y. P. Hung, “Panoramic Stereo Imaging System with Automatic Disparity Warping and Seaming,” Graphical Models and Image Processing, vol. 60, no. 3, pp. 196-208, May 1998.
[9] Y. P. Hung, C. S. Chen, Y. P. Tsai and S. W. Lin, “Augmenting panoramas with object movies by generating novel views with disparity-based view morphing,” J. Visualization and Computer Animation 2002, vol. 13, pp. 237-247.
[10] Marc Levoy, Pat Hanrahan, “Light Field Rendering,” Proc. ACM conf. Computer Graphics (SIGGRAPH’96), pp. 31-42, August 1996.
[11] W. Y. Lo, Y. P. Tsai, C. W. Chen, Y. P. Hung, “Stereoscopic Kiosk for Virtual Museum,” International Computer Symposium, Taipei, 2004.
[12] David F. McAllister, “Display Technology: Stereo & 3D Display Technologies,” Department of Computer Science, North Carolina State University.
[13] Leonard McMillan, Gary Bishop, “Plenoptic Modeling: AnImage-Based Rendering System,” Proc. ACM conf. Computer Graphics (SIGGRAPH’95), pp. 39-46, August 1995.
[14] Shmuel Peleg, Joshua Herman, “Panoramic Mosaics by Manifold Projection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, CVPR’97, pp. 338–343, June 1997.
[15] Shmuel Peleg, Moshe Ben-Ezra, “Stereo Panorama with a Single Camera,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, CVPR’99, pp. 395-401, June 1999.
[16] A. Ravishankar Rao and Alejandro Jaimes, “Digital Stereoscopic Imaging,” Proceeding of SPIE, vol. 3639, Stereoscopic Displays and Applications X, pp. 144-154, Jan 1999.
[17] Steven M. Seitz, Charles R. Dyer, “View Morphing,” Proc. ACM conf. Computer Graphics (SIGGRAPH’96), pp. 21-30, August 1996.
[18] Jianbo Shi, Carlo Tomasi, “Good Features to Track,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, CVPR’94, pp.593-600, June 1994.
[19] H. Y. Shum, L. W. He, “Rendering with Concentric Mosaics,” Proc. ACM conf. Computer Graphics (SIGGRAPH’99), pp. 299-306, Aug 1999.
[20] H. Y. Shum and Richard Szeliski, “Stereo Reconstruction from Multiperspective Panoramas,” IEEE Transactions on Pattern Analysisand Machine Intelligence, Vol. 26, pp. 45-62, Jan 2004.
[21] Yu-Pao Tsai, Yi-Ping Hung, Zen-Chung Shih, Jin-Jen Su, and Shang-Ru Tsai, “Background Removal System for Object Movies,” Proceeding of International Conference on Pattern Recognition, ICPR2004, Vol. 1, pp. 608-611, August, 2004.
[22] Zhigang Zhu, Edward M. Riseman, Allen R. Hanson,
“Parallel-Perspective Stereo Mosaics,” Proceeding of International Conference on Computer Vision, ICCV’01, vol. 1, pp. 345-352, July 2001.