臺灣博碩士論文加值系統

時間與空間同步展現的多媒體文件已被廣泛應用在眾多領域。如：數位學習〈e-learning〉及娛樂產業等。多媒體的展現若失去互動的特性後，只能算是一個花俏的多媒體幻燈片。使用者的互動在展現時會影響到相關媒體物件的時間/空間關係。在使用者互動產生時如何保持媒體物件間的同步關係是一個重要的議題。本論文除了探討此議題外，並提出一個互動式多媒體同步模型，稱為Spatio-Temporal Object Composition Petri Net〈STOCPN〉。STOCPN主要是以OCPN〈Object Composition Petri Net〉為基礎模型，並以事物驅動〈event-driven〉概念予以擴充。主要的功能在於維持互動式多媒體文件中相關物件的時間/空間關係。本論文所提出的模型已運用於網路式多媒體同步教材〈Web-based Synchronized Multimedia Lecture, WSML〉系統的同步核心實作之中，來協助國立暨南國際大學的學生以最生活化的方式，透過網路來學習外語。

Multimedia document objects with synchronized temporal and spatial presentation features have been widely used in numerous application areas such as e-learning and entertainment. Without interactive features, document presentation is just a fancy slide show with different media objects involved. User interactions in presentation time and/or layout would affect the corresponding temporal and/or spatial relations of involved objects. How to keep them resynchronized after user interaction is an important issue. This thesis addresses this issue and proposes an interactive multimedia synchronization model named Spatio-Temporal Object Composition Petri Net (STOCPN), which is based on OCPN with event-driven arcs extension, for maintaining the spatial and temporal relations of involved media objects in an interactive multimedia document. The proposed model has been applied into the core synchronization implementation in Web-based Multimedia Synchronized Lecture (WSML) system to assist students of the National Chi-Nan University in Taiwan to learn foreign language via web.

Content I
List of Figures III
Abstract V
Chinese Abstract VI
Chapter 1 INTRODUCTION 1
1.1 Motivation 1
1.2 Multimedia Synchronization 1
1.3 User Interactions 2
1.4 Organization of Thesis 2
Chapter 2 RELATED WORK 3
2.1 Petri Net Overview 3
2.2 Timed Petri Net 5
2.3 Augmented Timed Petri Net 5
2.4 Object Composition Petri Net 6
2.5 Extension Models of Petri Net and OCPN 7
Chapter 3 THE PROPOSED MODEL 9
3.1 Definition 9
3.2 Firing Rules 10
3.3 Backtracking Rules of STOCPN 11
Chapter 4 TEMPORAL SYNCHRONIZATION MODEL 12
4.1 Intra-media Temporal Synchronization 12
4.2 Inter-object Temporal Synchronization 13
4.3 Temporal Synchronization with User Interaction 14
4.4 Presentation with User Interaction 17
Chapter 5 SPATIAL SYNCHRONIZATION MODEL 21
5.1 Intra-media Spatial Synchronization 21
5.2 Inter-object Spatial Synchronization 21
5.3 Spatial Relations of Objects in STOCPN 22
5.4 Spatial Synchronization with User Interaction 24
5.5 Spatio-Temporal Synchronization with User Interaction 26
Chapter 6 SYNCHRONIZATION OF REAUTHROING 28
6.1 Adding Objects 28
6.1.1 Temporal synchronization of adding an object 28
6.1.2 Spatial synchronization of adding an object 31
6.2 Deleting Objects 33
6.2.1 Temporal synchronization of deleting objects 33
6.2.2 Spatial synchronization of deleting an object 35
Chapter 7 CONCLUSION AND FUTURE WORK 39
7.1 Conclusion 39
7.2 Future Work 40
REFERENCES 41

[Allen83] Allen, J., F., “Maintaining knowledge about temporal intervals,” Communications of the ACM, Vol. 26, No. 11, 1983, pp. 832-843.
[Blak96] Blakowski, G. and Steinmetz, R., “A media synchronization survey: reference model, specification, and case studies,” IEEE Journal on Selected Areas in Communications, Vol. 14, No. 1, 1996, pp. 5-35.
[Brot98] Brotherton, J. A., Bhalodia, J.R. and Abowd, G. D., “Automated Capture, Integration, and Visualization of Multiple Media Streams,” Proceedings of the IEEE International Conference Multimedia Computing and Systems, 1998, pp. 54-63.
[Chen95] Chen, T., Graf, H. P. and Wang, K., “Lip Synchronization Using Speech-Assisted Video Processing,” IEEE Signal Processing Letters, Vol. 2, No. 4, 1995, pp. 57-59.
[Chen97] Chen, T. and Rao, R. R., “Audio-Visual Interaction in Multimedia Communication,” IEEE International Conference on Acoustics, Speech and Signal Processing, Vol. 1, 1997, pp. 179-182.
[Chen99] Chen, H.Y., Chen G. Y. and Hong, J. S., “Design of a Web-based Synchronized Multimedia Lecture System for Distance Education,” IEEE International Conference on Multimedia Computing and Systems, Vol. 2, 1999, pp.887-891.
[Cool83] Coolahan, J. E. and Roussopoulos, N., “Timing requirement for time-driven systems using augmented Petri nets,” IEEE Transactions on Software Engineering, 1983, SE-9, pp. 603-616.
[Guan98] Guan, S. U., Yu, H. Y. and Yang, J. S., “A prioritized Petri net model and its application in distributed multimedia systems,” IEEE Transactions on Computers, Vol. 47, No. 4, 1998, pp. 477-481.
[Iino93] Iino, M., Day, Y. F. and Ghafoor, A., “An object-oriented model for spatial-temporal synchronization of multimedia information,” Proceedings of the IEEE International Conference on Multimedia Computing and System, 1994, pp. 110-120.
[Jeng99] Jeng, M. D., Wen, Y. L. and Chen, S. L., “Synchronization models for pre-orchestrated interactive multimedia presentations using timed Petri nets,” Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Vol. 5, 1999, pp. 191-196.
[Jour98] Jourdan, M., Roisin, C. and Tardif, L., “Multiviews Interfaces for Multimedia Authoring Environments,” Proceedings of MMM’98, 1998, pp. 72-79.
[Liao98] Liao, W. and Li., O. K., “Synchronization of distributed multimedia systems with user interactions,” Multimedia Systems, Vol, No. 3, 1998, pp 196-205.
[Litt90] Little, T. D. C. and Ghafoor, A., “Synchronization and storage models for multimedia objects,” IEEE Journal of Selected Area in Communications, 1990, Vol. 8, No. 3, pp. 413-427.
[Ma98] Ma, W.H., Lee, Y.J., Du, D. H. C. and McCahill, M. P., “Video-Based Hypermedia for Education-on-Demand,” IEEE Multimedia, Vol. 51, 1998, pp. 72-83.
[Mura89] Murata, T., “Petri nets: Properties, analysis and applications,” Proceedings of the IEEE , Vol. 77, No. 4, 1989, pp. 541 -580.
[Pete77] Peterson, J. L., “Petri Nets,” ACM Computing Surveys, Vol. 9, No. 3, 1977, pp. 223-252.
[Prab93] Prabhakaran, B. and Raghavan, S. V., “Synchronization models for multimedia presentation with user participation,” Proceedings of the ACM International Conference on Multimedia, 1993, pp. 157-166.
[Qazi93] Qazi, N. U., Woo, M. and Ghafoor, A., “A Synchronization and Communication Model for Distributed Multimedia Objects,” Proceedings of the ACM Multimedia, 1993, pp. 147-155.
[Ramc74] Ramchandani, C., “Analysis of asynchronous concurrent systems by Petri nets,” M.I.T., Cambridge, MA, Project MAC, TR-120, 1974.
[Song96] Song, J., Kim, M. Y., Ramalingam, G., Miller, R. and Yi, B. K., “Interactive Authoring of Multimedia Documents,” Proceedings of IEEE Symposium on Visual Languages, 1996, pp. 276-283
[WSML] WSML system, http://english.csie.ncnu.edu.tw
[Yang96] Yang, C. C. and Huang, J. H., “A Multimedia Synchronization Model and its Implementation in Transport protocols”, IEEE Journal on Selected Areas in Communications, Vol. 14, No. 1, 1996, pp. 212-225.
[Yoon98] Yoon, K. and Berra, P. B., “TOCPN: interactive temporal model for interactive multimedia documents,” Proceedings of International Workshop on Multi-Media Database Management Systems, 1998, pp. 136-144.