臺灣博碩士論文加值系統

本實驗設計並實作自動化可指導立體參數值演算法，旨在加速新製作之立體
動畫的製作流程，以及自動為已完成之三維動畫計算立體相機參數，重做立體版
本。該系統設計去學習立體攝影師經驗法則及滿足導演需求的方式，去自動計算
立體參數以減少整個立體參數設定的工作時程。自動立體設定演算法乃是歸納立
體經驗法則，分別為在立體舒適區中演出、立體變化速度的限制及立體預算的使
用等，及導入導演的指示後，去尋找最佳化及符合這些條件的立體參數值。最
後，我們使用三部動畫短片去驗證此演算法，將其自動算出的結果，與立體攝影
師手動設定的結果作比較，證明本演算法可以計算出與立體攝影師足夠相似的立
體感受。

This work proposes a directable automatic stereoscopic parameter estimation method
(DASPEM) to accelerate the process of setting stereoscopic parameters for computer
graphics animation production. After the director gives his/her instruction, the esti-
mation process is fully automatic. The algorithm is mainly derived from the general
stereoscopic rules of the stereoscopic animators and constrained with the artistic
instructions of the director. The stereoscopic rules derived are as follows: objects
should be placed and played in the comfort zone of stereoscopy, the rate of change
in stereoscopy should be limited for avoidance of discomfort and fatigue and the
amount of stereoscopy should be limited. After formulate these rules and possi-
ble the director's instructions, all a ecting factors are weighed by an opitmization
process to nd an optimal set of stereoscopic parameters for the entire animation.
The algorithm is applied to three CG animations with di erent length and a user
study is conducted to compare the stereoscopic settings of our algorithm and the
stereoscopic animator. The result show that our algorithm can get comparable
stereoscopic settings as the stereoscopic animator.

中文摘要. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . i
Abstract . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ii
目錄. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii
表目錄. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vi
圖目錄. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
演算法目錄. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
1 緒論. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.1 研究動機與目的. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 研究內容與流程. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.3 主要貢獻. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.4 論文架構. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2 相關背景知識. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
2.1 立體幾何. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
2.2 估算拍攝前立體攝影參數. . . . . . . . . . . . . . . . . . . . . . . . 7
2.3 立體內容分析及後製. . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.4 立體上的感受研究. . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
3 立體視覺經驗法則. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
3.1 立體視覺的播放環境. . . . . . . . . . . . . . . . . . . . . . . . . . . 11
3.2 立體經驗法則歸納. . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.2.1 角色都在立體舒適區的範圍中表演. . . . . . . . . . . . . . . 13
3.2.2 每禎之間立體變動控制在大腦成像的速度內. . . . . . . . . . 14
3.2.3 根據影片時間長短決定整體立體刺激程度的比例. . . . . . . 14
3.3 立體多媒體內容的製作. . . . . . . . . . . . . . . . . . . . . . . . . . 15
3.3.1 立體視覺模型. . . . . . . . . . . . . . . . . . . . . . . . . . . 16
3.3.2 應用立體視覺模型到立體經驗法則. . . . . . . . . . . . . . . 19
4 自動化可指導立體參數設定演算法DASPEM . . . . . . . . . . . . . . . . 21
4.1 場景分析及角色視覺焦點. . . . . . . . . . . . . . . . . . . . . . . . 23
4.1.1 特徵立體注視曲線. . . . . . . . . . . . . . . . . . . . . . . . 24
4.2 初始特徵立體注視曲線：立體舒適區及立體預算. . . . . . . . . . . 26
4.2.1 立體舒適區. . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
4.2.2 定義立體感官疲乏與影片長度的關係. . . . . . . . . . . . . . 27
4.3 最佳化特徵立體注視曲線. . . . . . . . . . . . . . . . . . . . . . . . 29
4.3.1 逼近初始的GPDP立體視覺體參數. . . . . . . . . . . . . . . 30
4.3.2 定義立體變動速度及平滑化. . . . . . . . . . . . . . . . . . . 30
4.3.3 導演對特定角色的指示因素. . . . . . . . . . . . . . . . . . . 31
4.3.4 最佳化. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
5 實驗結果與討論. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
5.1 視覺化立體劇本與數學比較. . . . . . . . . . . . . . . . . . . . . . . 32
5.1.1 Warrior . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
5.1.2 GameGold . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
5.1.3 Escape . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
5.2 使用者測試. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
6 結論與未來工作. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
6.1 結論. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
6.2 未來工作. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
參考文獻. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

[1] G. K. von Noorden MD, Binocular Vision and Ocular Motility Theory and Management of Strabismus. Mosby, 6th ed., 2001.
[2] M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. Gross, Nonlinear disparity mapping for stereoscopic 3d," ACM Trans. Graph., vol. 29,
no. 3, p. 10, 2010.
[3] L. Lipton, Foundations of the Stereoscopic Cinema: A Study in Depth. Van Nostrand Reinhold Inc., 1982.
[4] B. Frohlich, S. Barrass, B. Zehner, J. Plate, and M. Gobel, Exploring geoscienti c data in virtual environments," in Visualization '99. Proceedings,
pp. 169-173, 1999.
[5] L. Meesters, W. IJsselsteijn, and P. Seuntiens, A survey of perceptual evaluations and requirements of three-dimensional tv," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 14, no. 3, pp. 381-391, 2004.
[6] D. Broberg, Infrastructures for home delivery, interfacing, captioning, and viewing of 3-d content," Proceedings of the IEEE, vol. 99, no. 4, pp. 684-693, 2011.
[7] H.-P. Chan, M. M. Goodsitt, M. A. Helvie, L. M. Hadjiiski, J. T. Lydick, M. A. Roubidoux, J. E. Bailey, A. Nees, C. E. Blane, and B. Sahiner, Roc study of the e ect of stereoscopic imaging on assessment of breast lesions," Medical Physics, vol. 32, no. 4, pp. 1001-1009, 2005.
[8] F. Zilly, J. Kluger, and P. Kau , Production rules for stereo acquisition," Proceedings of the IEEE, vol. 99, no. 4, pp. 590-606, 2011.
[9] F. Zilly, M. Muller, P. Eisert, and P. Kau , The stereoscopic analyzer-animage-based assistance tool for stereo shooting and 3d production.," in Image Processing (ICIP), 2010 17th IEEE International Conference on Image Pro- cessing, pp. 4029-4032.
[10] A. J.Woods, T. Docherty, and R. Koch, Image distortions in stereoscopic video systems," in Proc. SPIE, Stereoscopic Displays and Applications IV, vol. 1915, pp. 36-48, 1993.
[11] V. S. Grinberg, G. Podnar, and M. W. Siegel, Geometry of binocular imaging," in Proc. of the IS&T/SPIE Symp. on Electronic Imaging, Stereoscopic Displays and applications, Vol.2177, pp. 56-65, 1994.
[12] R. T. Held and M. S. Banks, Misperceptions in stereoscopic displays: a vision science perspective," in Proceedings of the 5th symposium on Applied perception in graphics and visualization, APGV '08, pp. 23-32, 2008.
[13] G. Jones, D. Lee, N. Holliman, and D. Ezra, Controlling perceived depth in stereoscopic images," in Proc. SPIE, Stereoscopic Displays and Virtual Reality Systems VIII, vol. 4297, pp. 42-53, 2001.
[14] R. Mueller, C. Ward, and M. Hu s ak, A systematized WYSIWYG pipeline for digital stereoscopic 3D lmmaking," in Society of Photo-Optical Instrumenta- tion Engineers (SPIE) Conference Series, vol. 6803 of Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Mar. 2008.
[15] S. Koppal, C. Zitnick, M. Cohen, S. B. Kang, B. Ressler, and A. Colburn, A viewer-centric editor for 3d movies," Computer Graphics and Applications, IEEE, vol. 31, no. 1, pp. 20-35, 2011.
[16] S. Heinzle, P. Greisen, D. Gallup, C. Chen, D. Saner, A. Smolic, A. Burg, W. Matusik, and M. Gross, Computational stereo camera system with pro- grammable control loop," ACM Trans. Graph., vol. 30, pp. 94:1-94:10, July 2011.
[17] D. M. Ho man and A. R. Girshick, Vergencevaccommodation con icts hinder visual performance and cause visual fatigue," Journal of Vision, 2008.
[18] H. Pan, C. Yuan, and S. Daly, 3d video disparity scaling for preference and prevention of discomfort," in SPIE. Stereoscopic Displays and Applications XXII, vol. 7863, 2011.
[19] P. Howard and B. Rogers, Seeing in Depth. Oxford Univresity Press, 2002.
[20] C. Wang and A. A. Sawchuk, Disparity manipulation for stereo images and video," in Proc. SPIE, vol. 6803, pp. 68031E-68031E-12, 2008.
[21] L. Wang, H. Jin, R. Yang, and M. Gong, Stereoscopic inpainting: Joint color and depth completion from stereo images," in Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pp. 1-8, 2008.
[22] P. Didyk, T. Ritschel, E. Eisemann, K. Myszkowski, and H.-P. Seidel, A perceptual model for disparity," ACM Trans. Graph., vol. 30, pp. 96:1-96:10, July 2011.
[23] P. Didyk, T. Ritschel, E. Eisemann, K. Myszkowski, H.-P. Seidel, and W. Matusik, A luminance-contrast-aware disparity model and applications," ACM Transactions on Graphics (Proceedings SIGGRAPH Asia 2012, Singapour), vol. 31, no. 6, 2012.
[24] C.-H. Chang, C.-K. Liang, and Y.-Y. Chuang, Content-aware display adaptation and interactive editing for stereoscopic images," Multimedia, IEEE Trans- actions on, vol. 13, no. 4, pp. 589-601, 2011.
[25] T. Basha, Y. Moses, and S. Avidan, Geometrically consistent stereo seamcarving," in Computer Vision (ICCV), 2011 IEEE International Conference on, pp. 1816-1823, 2011.
[26] K.-Y. Lee, C.-D. Chung, and Y.-Y. Chuang, Scene warping: Layer-based stereoscopic image resizing.," in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2012.
[27] W.-Y. Lo, J. van Baar, C. Knaus, M. Zwicker, and M. Gross, Stereoscopic 3d copy & paste," ACM Trans. Graph., vol. 29, pp. 147:1-147:10, Dec. 2010.
[28] Y. Niu, W.-C. Feng, and F. Liu, Enabling warping on stereoscopic images," ACM Trans. Graph., vol. 31, pp. 183:1-183:7, Nov. 2012.
[29] A. Smolic, P. Kau , S. Knorr, A. Hornung, M. Kunter, M. Muller, and M. Lang, Three-dimensional video postproduction and processing," Proceedings of the IEEE, vol. 99, no. 4, pp. 607-625, 2011.
[30] C. Kim, A. Hornung, S. Heinzle, W. Matusik, and M. Gross, Multi-perspective stereoscopy from light elds," ACM Trans. Graph., vol. 30, pp. 190:1-190:10, Dec. 2011.
[31] C.-W. Liu, T.-H. Huang, M.-H. Chang, K.-Y. Lee, C.-K. Liang, and Y.-Y. Chuang, 3d cinematography principles and their applications to stereoscopic media processing," in Proceedings of the 19th ACM international conference on Multimedia, MM '11, pp. 253-262, 2011.
[32] T. Oskam, A. Hornung, H. Bowles, K. Mitchell, and M. Gross, OSCAM -Optimized stereoscopic camera control for interactive 3D," ACM Trans. on Graphics (Proc. SIGGRAPH), vol. 30, no. 6, pp. 189:1-189:8, 2011.
[33] P. Burt and B. Julesz, A disparity gradient limit for binocular fusion," Science, vol. 208, no. 4444, pp. 615-617, 1980.
[34] J. Cutting and P. Vishton, Perceiving layout and knowing distances: The integration, relative potency, and contextual use of di erent information aboutdepth," in Perception of Space and Motion,, 1995.
[35] T. Shibata, J. Kim, D. M. Ho man, and M. S. Banks, The zone of comfort: Predicting visual discomfort with stereo displays," Journal of Vision, vol. 11, no. 6, 2011.
[36] M. Siegel and S. Nagata, Just enough reality: comfortable 3-d viewing via microstereopsis," IEEE Transactions on Circuits and Systems for Video Technology, vol. 10, pp. 387 - 396, April 2000.
[37] K. Akeley, S. J. Watt, A. R. Girshick, and M. S. Banks, A stereo display prototype with multiple focal distances," ACM Trans. Graph., vol. 23, pp. 804-813, Aug. 2004.
[38] B. Mendiburu, 3D Movie Making Stereoscopic Digital Cinema from Script to Screen. Focal Press, 2010.
[39] J. Kim and D. Kane, Visual discomfort and the temporal properties of the vergence-accommodation conicts," SPIE. Stereoscopic Displays and Virtual Reality Systems, 2012.
[40] D. Kane and R. T. Held, Visual discomfort with stereo 3d displays when the head is not upright," SPIE, Stereoscopic Displays and Virtual Reality Systems, 2012.
[41] P. Bourke, Calculating stereo pairs - http://paulbourke.net/stereographics/stereorender/," 2001.
[42] E. Calore and R. Folgieri, Analysis of brain activity and response during monoscopic and stereoscopic visualization," vol. 8288, 2012.
[43] P. Didyk, T. Ritschel, E. Eisemann, K. Myszkowski, and H.-P. Seidel, A perceptual model for disparity," ACM Transactions on Graphics (Proceedings SIGGRAPH 2011, Vancouver), vol. 30, no. 4, 2011.
[44] C. Dsouza, Think in 3D: Food For Thought for Directors, Cinematographers and Stereographers. Clyde DeSouza, 2012.
[45] M. Guttmann, L. Wolf, and D. Cohen-Or, Semi-automatic stereo extraction from video footage," in Computer Vision, 2009 IEEE 12th International Conference on, pp. 136-142, 2009.
[46] D. J. Jobson, Z. Rahman, and G. A. Woodell, Retinex image processing: Improved delity to direct visual observation," in Proceedings of the IS&T Fourth Color Imaging Conference: Color Science, Systems, and Applications, vol. 4, pp. 124-125, The Society for Imaging Science and Technology, 1995.
[47] H. J. Kim, J. W. Choi, A.-J. Chang, and K. Y. Yu, Reconstruction of stereoscopic imagery for visual comfort," in SPIE. Stereoscopic Displays and Virtual Reality Systems, vol. 6803, 2010.
[48] S. Knorr and T. Sikora, An image-based rendering (ibr) approach for realistic stereo view synthesis of tv broadcast based on structure from motion," in Image Processing, 2007. ICIP 2007. IEEE International Conference on, vol. 6, pp. VI - 572-VI - 575, 2007.
[49] R. W. Kroon, 3D A-to-Z: An Encyclopedic Dictionary. McFarland Company Inc., 2012.
[50] H.-S. Lin, S.-H. Guan, C.-T. Lee, and M. Ouhyoung, Stereoscopic 3d experience optimization using cropping and warping," in SIGGRAPH Asia 2011 Sketches, SA '11, pp. 40:1-40:2, 2011.
[51] S.-J. Luo, I.-C. Shen, B.-Y. Chen, W.-H. Cheng, and Y.-Y. Chuang, Perspective-aware warping for seamless stereoscopic image cloning," ACM Trans. Graph., vol. 31, pp. 182:1-182:8, Nov. 2012.
[52] K. Masaoka, A. Hanazato, M. Emoto, H. Yamanoue, Y. Nojiri, and F. Okano, Spatial distortion prediction system for stereoscopic images," Journal of Electronic Imaging, vol. 15, no. 1, pp. 013002-013002-12, 2006.
[53] P. C. D. McNally and M. M. Low, M.a.c.: an automatic stereoscopic calculator for animation pipelines," in Proceedings of the Digital Production Symposium, DigiPro '12, pp. 27-36, 2012.
[54] K. Moustakas, D. Tzovaras, and M. Strintzis, Stereoscopic video generation based on e cient layered structure and motion estimation from a monoscopic image sequence," Circuits and Systems for Video Technology, IEEE Transac- tions on, vol. 15, no. 8, pp. 1065-1073, 2005.
[55] S. Palmer, Vision Science: Photons to Phenomenology. The Press, 2002.
[56] A. Pennington and C. Giardina, Exploring 3D: The New Grammar of Stereoscopic Filmmaking. Focal Press, 2012.
[57] S. Reichelt, R. H?ussler, G. F?tterer, and N. Leister, Depth cues in human visual perception and their realization in 3d displays," in Three-Dimensional Imaging, Visualization, and Display, pp. 76900B:1-76900B:12, 2010.
[58] A. Saxena, M. Sun, and A. Ng, Make3d: Learning 3d scene structure from a single still image," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 31, no. 5, pp. 824-840, 2009.
[59] M. D. Smith and B. T. Collar, Perception of size and shape in stereoscopic 3d imagery," in Proc. SPIE, Stereoscopic Displays and Applications XXIII, vol. 8288, pp. 82881O-82881O-31, 2012.
[60] H. Sohn and Y. J. Jung, Investigation of object thickness for visual discom fort prediction," in Proc. SPIE, Stereoscopic Displays and Applications XXIII, vol. 8288, 2012.
[61] G. Sun and N. S. Holliman, Evaluating methods for controlling depth perception in stereoscopic cinematography," in Proc. SPIE, Stereoscopic Displays and Applications XX, vol. 7237, 2009.
[62] X. Yang, L. Zhang, T.-T. Wong, and P.-A. Heng, Binocular tone mapping," ACM Trans. Graph., vol. 31, pp. 93:1-93:10, July 2012.
[63] Y. L. H. Yee, Spatiotemporal sensistivity and visual attention for e cient rendering of dynamic environments," Master's thesis, Cornell University, 2000.