AN IMPROVED ACTION KEY FRAMES EXTRACTION ALGORITHM FOR COMPLEX COLOUR VIDEO SHOT SUMMARIZATION

Authors

  • Manar Abduljabbar Ahmad Mizher Institute of Visual Informatics, Universiti Kebangsaan Malaysia, Malaysia
  • Ang Mei Choo Institute of Visual Informatics, Universiti Kebangsaan Malaysia, Malaysia
  • Siti Norul Huda Sheikh Abdullah Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, Malaysia
  • Kok Weng Ng Faculty of Engineering, University of Nottingham Malaysia Campus

DOI:

https://doi.org/10.32890/jict2019.18.2.8285

Keywords:

Basic action, blocks differential, L1-norm, motion estimation, optical flow

Abstract

Key frame extraction is one of the critical techniques in computer vision fields such as video search, video identification and video forgeries detection. The extracted key frames should be sufficient key frames that preserve main actions in a video with compact representation. The objective of this work is to improve our previous action key frames extraction algorithm (AKF) by adapting a threshold which selects action key frames as final key frames. The threshold adaptation was achieved by using the mean value, the standard deviation, and the L1-norm instead of the comparison of user summaries evaluation method to obtain a fully automatic video summarisation algorithm, and by eliminating the conditions in selecting the final key frames to reduce the complexity of the algorithm. We have validated our proposed Improved AKF on complex colour video shots instead of the simple grey level video shots. The Improved AKF algorithm was able to extract a compact number of action key frames by preventing redundant key frames, reduce processing complexity, and preserve sufficient information about the main actions in a video shot. We then evaluated the Improved AKF algorithm with the-state-of-the-art algorithms in terms of compression ratio using Paul videos and Shih-Tang dataset. The evaluation results showed that the Improved AKF algorithm achieved better compression ratio and retained sufficient information in the extracted action key frames under different testing video shots. Therefore, the improved AKF algorithm is a suitable technique for applications in computer vision fields such as passive object-based video authentication systems

 

Metrics

Metrics Loading ...

Additional Files

Published

31-03-2019

How to Cite

Mizher, M. A. A., Choo, A. M., Sheikh Abdullah, S. N. H., & Ng, K. W. (2019). AN IMPROVED ACTION KEY FRAMES EXTRACTION ALGORITHM FOR COMPLEX COLOUR VIDEO SHOT SUMMARIZATION. Journal of Information and Communication Technology, 18(2), 143–166. https://doi.org/10.32890/jict2019.18.2.8285