A Novel Hybrid System Based on Fractal Coding for Soccer Retrieval from Video Database

Majlesi Journal of Electrical Engineering

مقاله 5، دوره 6، شماره 1، خرداد 2012   

نوع مقاله: Review Article

نویسنده

Ehsan Lotfi^*

Young Researchers Club, Mashhad Branch, Islamic Azad University, Mashhad, Iran

چکیده

Most information retrieval systems make indirect use of human knowledge in their retrieval process. The novel systems presented here uses the human knowledge directly to retrieve the soccer events. The proposed system is an extended method in three aspects as follows: in the query model, the query by example and query by keywords are applied to retrieve the semantics. In feature extraction, we propose novel methods for extracting the caption as important cinematic feature and for detecting the player gathering. And in the retrieval process, a novel method based on fractal coding is proposed here. The first phase consists of extracting suitable features and key frames from video shots. Then, using a fractal coding, soccer shots are retrieved, and using a fuzzy rule base system, shots that do not include significant soccer events are removed. Experimental results show high accuracy of proposed caption extraction and player gathering detection algorithm and satisfying retrieval process.

کلیدواژه‌ها

Semantic Retrieval؛ Concept Retrieval؛ Islamic Azad University؛ en؛ Fuzzy system؛ Young Researchers Club؛ SVM؛ Mashhad Branch؛ Fractal Coding؛ Soccer Video

مراجع

[1] Maheshkumar H. Kolekar, Kannappan Palaniappan, “Semantic concept mining based on hierarchical event detection for soccer video indexing,” Journal of multimedia, Vol. 4, No. 5, October 2009.

[2] Ahmet Ekin, A. Murat Tekalp and Rajiv Mehrotra, “Automatic soccer video analysis and summarization,” IEEE Transactions on image processing, Vol. 12, No. 7, July 2003.

[3] Kiani, V., Pourreza, H.R., “Robust GME in encoded mpeg video,” Proceeding of the 9th International Conference on Advances in Mobile Computing and Multimedia (MoMM 2011), ACM, pp. 147-154.

[4] Sun Xing-hua, Yang Jing-yu, “Inference and retrieval of soccer event,” Mar. 2007, Volume 4, No.3 (Serial No.28) Journal of Communication and Computer.

[5] Changsheng Xu ,Jinjun Wang, Hanqing Lu, and Yifan Zhang, “A novel framework for semantic annotation and personalized retrieval of sports video”, IEEE transactions on multimedia, Vol. 10, No. 3, April 2008.

[6] T. D’Orazio , M. Leo, P. Spagnolo, M. Nitti, N. Mosca, A. Distante, “A visual system for real time detection of goal events during soccer matches,” Computer Vision and Image Understanding 113 (2009) 622–632.

[7] T. D’Orazio, M. Leo, P. Spagnolo, P. L. Mazzeo, N. Mosca, M. Nitti, A. Distante, “An investigation into the feasibility of real-time soccer offside detection from a multiple camera system” in Proc, 2009.

[8] Yu-Lin Kang, “Soccer video event detection with visual keywords”, ICICS-CM 200315-18 December 2003, Singapore.

[9] Z. Q. Liu, L. T. Bruton, J. C. Bezdek, J. M. Keller, S. Dance, N. R. Bartley, and C. Zhang, “Dynamic image sequence analysis using fuzzy measures,” IEEE Trans. Syst., Man, Cybern., Vol. 31, No. 4, pp. 557–571, Aug. 2001.

[10] Weiming Hu, Dan Xie, Zhouyu Fu, Wenrong Zeng, and Steve Maybank, “Semantic-based surveillance video retrieval”, IEEE Transactions on image processing, Vol. 16, No. 4, April 2007.

[11] Liang Bai, Songyang Lao, Weiming Zhang, “A semantic event detection approach for soccer video based on perception concepts and finite state machines,” Eight International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS'07.

[12] Ahmet Ekin, A. Murat Tekalp and Rajiv Mehrotra, “Automatic soccer video analysis and summarization”, IEEE Transactions on image processing, Vol. 12, No. 7, July 2003.

[13] T.D’Orazio, M. Leo, “A review of vision-based systems for soccer vide analysis,” PatternRecognition, doi:10.1016/j.patcog. February2, 2010

[14] Shu-Ching Chen, Mei-Ling Shyu, Chengcui Zhang, Lin Luo, Min Chen “Detection of soccer goal shots using joint multimedia features and classification rules,” MDM/KDD’03, August 27, 2003, Washington, DC, USA.

[15] R. Leonardi, P. Migliorati and M. Parandini, “Semantic indexing of sports program sequences by audio-visual analysis,” in ICIP Conf., 2003.

[16] Geetha, Vasumathi Narayanan, “A survey of content-based video retrieval,” Journal of Computer Science 4 (6): 474-486, 2008, 1549-3636.

[17] David Liu , Tsuhan Chen, “Video retrieval based on object discovery,” Computer Vision and Image Understanding 113 (2009) 397–404.

[18] Jinhui Tang a, Guo-JunQi, MengWang , Xian-ShengHua, “Video semantic analysis based on structure-sensitive anisotropic manifold ranking ,” Signal Processing 89 (2009) 2313–2323.

[19] Rong Yan Æ Alexander G. Hauptmann, “A review of text and image retrieval approaches for broadcast news video,” Inf Retrieval (2007) 10:445–484.

[20] A. D. Doulamis, N. D. Doulamis and S. D. Kollias, “A fuzzy video content representation for video summarization and content-based retrieval,” Signal Process. 80 (2000) 1049–1067.

[21] L. Zhang, L. Xi and B. Zhou, “Image retrieval method based on entropy and fractal coding,” WSEAS Trans. Syst. 4(7) (2008) 232–241.

[22] E. Lotfi, Yaghoobi, M., “Concept retrieval based on a combination of fractal coding, fuzzy rule based system and SVM, ” FRACTALS , Complex Geometry, Patterns, and Scaling in Nature and Society, Volume: 19, Issue: 2(2011) pp. 185-194 DOI: 10.1142/S0218348X11005300

[23] G. Piriou, P. Bouthemy and J.-F. Yao, “Recognition of dynamic video contents with global probabilistic models of visual motion,” IEEE Trans. Image Process. 15(11) (2006) 3418–3431.

[24] H. Pan, P. van Beek, and M. I. Sezan, “Detection of slow-motion replay segments in sports video for highlights generation,” in Proc. IEEE Int’l. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2001.

[25] E. Lotfi and H. R. Poureza, “Summarizing soccer videos without detecting the events,” Inernational Journal of Computer and Netork Security 6(10) (2006) 130–135.

[26] Ehsan Lotfi, Hamid Reza Pourreza, “Event detection and automatic summarization in soccer video,” MVIP2007.

[27] Ehsan Lotfi, M.R. Akbarzadeh-T. and H.R. Pourreza, “A hybrid method for soccer video events retrieval using fuzzy systems,” International Fuzzy Systems Association Conference (IFSA2009), Lisbon, July 2009.