Restoration and Segmentation of Old Jawi Manuscripts using Variational Image Inpainting and Active Contour Models

Authors

  • Akmal Shafiq Badarul Azam School of Mathematical Sciences, College of Computing, Informatics and Mathematics, Universiti Teknologi MARA, Mukah, Malaysia
  • Abdul Kadir Jumaat School of Mathematical Sciences, College of Computing, Informatics and Mathematics, Universiti Teknologi MARA, Shah Alam, Malaysia and Institute for Big Data Analytics and Artificial Intelligence Universiti Teknologi MARA, Shah Alam, Malaysia
  • Amisha Balkis Badarul Azam School of Mathematical Sciences, College of Computing, Informatics and Mathematics, Universiti Teknologi MARA, Shah Alam, Malaysia
  • Nur Afiqah Sabirah Mohammad Sabri School of Mathematical Sciences, College of Computing, Informatics and Mathematics, Universiti Teknologi MARA, Shah Alam, Malaysia
  • Amiratul Munirah Yahaya Academy of Contemporary Islamic Studies, Universiti Teknologi MARA, Shah Alam, Malaysia
  • Ahmad Thaqif Ismail Academy of Contemporary Islamic Studies, Universiti Teknologi MARA, Shah Alam, Malaysia
  • Muhammad Anas Abdul Razak Arabic Language Department, Academy of Language Studies, Universiti Teknologi MARA, Mukah, Malaysia
  • Mohd Azdi Maasar Mathematical Sciences Studies, College of Computing, Informatics and Mathematics, Seremban Campus, Universiti Teknologi MARA, Negeri Sembilan Malaysia, Malaysia
  • Mohamed Faris Laham Institute for Mathematical Research, Universiti Putra Malaysia, Malaysia

DOI:

https://doi.org/10.32890/jict2024.23.4.1

Keywords:

Active contour, historical document, image segmentation, image inpainting, old Jawi manuscript

Abstract

Old Jawi Manuscripts (OJM) are crucial to historical studies, offering insights into past societies. However, degradation from mishandling and environmental factors can impair their legibility. To preserve OJM, image inpainting and segmentation are essential for restoring corrupted areas and identifying text. Recently, the Gaussian Regularization Segmentation (GRS) model has shown effectiveness in intensity inhomogeneity grayscale image segmentation, though it was not designed for corrupted OJM images. Therefore, this study aimed to reformulate the GRS model to restore and segment text from real corrupted OJM images. The methodology begins with the incorporation of the Mumford-Shah and Bertalmio inpainting models into the GRS model as new fitting terms, resulting in the Modified Gaussian Regularization Segmentation Mumford-Shah (MGRSM) model and the Modified Gaussian Regularization Segmentation Bertalmio (MGRSB) model, respectively. MATLAB was used to implement these models, and their performance was assessed on 30 corrupted OJM samples from Malay Ethnomathematics Research Group, with expert evaluations and efficiency measured by average elapsed time. The MGRSM model achieved 38.4 percent and 12.4 percent higher overall total scores from experts in terms of segmentation accuracy compared to the GRS and MGRSB models, respectively. While the GRS model is the fastest, the MGRSM model provides superior accuracy, with an average processing time of 9.35 seconds, making it the most optimal for restoring and segmenting OJM images. This approach not only enhances the preservation of historical manuscripts but also provides a practical tool for researchers and historians in safeguarding our cultural heritage. 

References

Ali, H., Rada, L., & Badshah, N. (2018). Image segmentation for intensity inhomogeneity in presence of high noise. IEEE Transactions on Image Processing, 27(8), 3729-3738. https://doi.org/10.1109/TIP.2018.2825101

Ashikhmin, M. (2001). Synthesizing natural textures. In Proceedings of the 2001 Symposium on Interactive 3D graphics (I3D ‘01) (pp. 217–226). Association for Computing Machinery. https://doi.org/10.1145/364338.364405

Azam, A. S. B., Jumaat, A. K., Maasar, M. A., Laham, M. F., & Rahman, N. N. A. (2023). Local image fitting-based active contour for vector-valued images. Indonesian Journal of Electrical Engineering and Computer Science, 32(1), 227-235. https://doi.org/10.11591/ijeecs.v32.i1.pp227-235 Journal of ICT, 23, No. 4 (October) 2024, pp: 561-

Badshah, N., Atta, H., Ali Shah, S. I., Attaullah, S., Minallah, N., & Ullah, M. (2020). New local region based model for the segmentation of medical images. IEEE Access, 8, 175035–175053. https://doi.org/10.1109/ACCESS.2020.3017805

Baihaqi, Yanti, Y., & Malahayati. (2024). Ancient manuscript image enhancement method using local and global histogram equalization. Jurnal Serambi Engineering, 9(3), 102-10263. https://jse.serambimekkah.id/index.php/jse/article/view/449

Barbu, T. (2018). Second-order anisotropic diffusion-based framework for structural inpainting. Proceedings of the Romanian Academy, Series A: Mathematics, Physics, Technical Sciences, Information Science, 19(2), 329-336. https://acad.ro/ sectii2002/proceedings/doc2018-2/Art03Barbu.pdf

Biswas, S., & Hazra, R. (2021). A level set model by regularizing local fitting energy and penalty energy term for image segmentation. Signal Processing, 183, 108043. https://doi.org/10.1016/j. sigpro.2021.108043

Bertalmio, M. (2001). Processing of flat and non-flat image information on arbitrary manifolds using partial differential equations. University of Minnesota. https://www.maths.univ-evry.fr/pages_perso/vtorri/files/UV/unpaint/thesis-bertalmio. pdf

Burrows, L., Patel, J., Islim, A. I., Jenkinson, M. D., Mills, S. J., & Chen, K. (2024). A semi-automatic segmentation method for meningioma developed using a variational approach model. The Neuroradiology Journal, 37(2), 199-205. https://doi.org/10.1177/19714009231224442

Chan, T. F., & Vese, L. A. (2001). Active contours without edges. IEEE Transactions on Image Processing, 10(2), 266-277. https://doi.org/10.1109/83.902291

Devadass, V., Bakar, J. A., Harun, N. H., & Zamri, M. F. (2021). Image enhancement system for the restoration of Old Jawi Malay manuscripts using binarization method. Journal of Physics: Conference Series, 1997(1), 012037. https://doi.org/10.1088/1742-6596/1997/1/012037

Esedoglu, S., & Shen, J. (2002). Digital inpainting based on the Mumford–Shah–Euler image model. European Journal of Applied Mathematics, 13(4), 353-370. https://doi.org/10.1017/ S0956792502004904

Fang, J., Liu, H., Liu, J., Zhou, H., Zhang, L., & Liu, H. (2021). Fuzzy region-based active contour driven by global and local fitting energy for image segmentation. Applied Soft Computing, 100, 106982. https://doi.org/10.1016/j.asoc.2020.106982 Journal of ICT, 23, No. 4 (October) 2024, pp: 561-

Gui, L., Ma, J., & Yang, X. (2023). Variational models and their combinations with deep learning in medical image segmentation: A survey. In K. Chen, C.-B. Schönlieb, X.-C. Tai, & L. Younes (Eds.), Handbook of mathematical models and algorithms in computer vision and imaging: Mathematical imaging and vision (pp. 1001-1022). Springer International Publishing. https://doi.org/10.1007/978-3-030-98661-2_109

Hays, J., & Efros, A. A. (2023). Scene completion using millions of photographs. In Seminal Graphics Papers: Pushing the Boundaries, Volume 2 (1st ed., pp. 679–685). Association for Computing Machinery. https://doi.org/10.1145/3596711.3596783

Huang, J. B., Kopf, J., Ahuja, N., & Kang, S. B. (2013). Transformation guided image completion. In IEEE International Conference on Computational Photography (ICCP) (pp. 1-9). IEEE. https://doi.org/10.1109/ICCPhot.2013.6528313

Iqbal, E., Niaz, A., Memon, A. A., Asim, U., & Choi, K. N. (2020). Saliency-driven active contour model for image segmentation. IEEE Access, 8, 208978-208991. https://doi.org/10.1109/ ACCESS.2020.3038945

Ismail, S. M., & Abdullah, S. N. H. S. (2014). Novel binarization method for enhancing ancient and historical manuscript images. In Human-inspired computing and its applications (pp. 394-403). Springer. https://doi.org/10.1007/978-3-319-13647-9_36

Jaidilert, S., & Farooque, G. (2018). Crack detection and images inpainting method for Thai mural painting images. In 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC) (pp. 143-148). IEEE. https://doi.org/10.1109/ICIVC.2018.8492735

Kaur, A., Raj, A., Jayanthi, N., & Indu, S. (2020). Inpainting of irregular holes in a manuscript using U-Net and partial convolution. In 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA) (pp. 526-531). IEEE. https://doi.org/10.1109/ICIRCA48905.2020.9182917

Kumpulan Penyelidikan Etnomatematik Melayu. (2021). Manuskrip Melayu. Universiti Putra Malaysia. https://inspem.upm.edu.my/ laboratori/laboratori_etnomatematik_dan_didaktik/kumpulan_ penyelidikan_etnomatematik_melayu_kupelema-54857

Mahmor, N. B., Azmi, M. S. B., & Abdullah, M. B. (2018). Image thresholding for Malay ancient manuscript (Terengganu Inscribed Stone). International Journal of Advances in Computer Science and Technology, 7(10). https://doi.org/10.30534/ijacst/2018/017102018 Journal of ICT, 23, No. 4 (October) 2024, pp: 561-

Mohd Sharif, N. A., Harun, N. H., & Yusof, Y. (2024). Colour image enhancement model of retinal fundus image for diabetic retinopathy recognition. Journal of Information and Communication Technology, 23(2), 293-334. https://doi.org/10.32890/jict2024.23.2.5

Mumford, D., & Shah, J. (1989). Optimal approximations by piecewise smooth functions and associated variational problems. Communications on Pure and Applied Mathematics, 42, 577-685. https://doi.org/10.1002/cpa.3160420503

Othman, M., Abdullah, S. L. S., Ahmad, K. A., Bakar, M. N. A., & Mansor, A. R. (2016). The fusion of edge detection and mathematical morphology algorithm for shape boundary recognition. Journal of Information and Communication Technology, 15(1), 133-144. http://e-journal.uum.edu.my/ index.php/jict/article/view/8175

Razak, Z. (2016). Old Jawi manuscript: Digital recognition [Doctoral thesis, University of Malaya]. University of Malaya Students’ Repository. http://studentsrepo.um.edu.my/id/eprint/

Saddami, K., Munadi, K., Muchallil, S., & Arnia, F. (2017). Improved thresholding method for enhancing Jawi binarization performance. In 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR). https://doi.org/10.1109/ICDAR.2017.183

Saibin, T. C., & Jumaat, A. K. (2023). Variational selective segmentation model for intensity inhomogeneous image. Indonesian Journal of Electrical Engineering and Computer Science, 29(1), 277-285. https://doi.org/10.11591/ijeecs.v29.i1.pp277-285

Schönlieb, C. B. (2015a). The Mumford-Shah image model for inpainting. In Partial differential equation methods for image inpainting. Cambridge University Press. https://doi.org/10.1017/CBO9780511734304

Schönlieb, C. B. (2015b). Transport inpainting. In Partial differential equation methods for image inpainting. Cambridge University Press. https://doi.org/10.1017/CBO9780511734304

Shen, J., & Chan, T. F. (2002). Mathematical models for local nontexture inpaintings. SIAM Journal on Applied Mathematics, 62(3), 1019-1043. https://doi.org/10.1137/S0036139900368844

Som, H. M., Zain, J. M., & Ghazali, A. J. (2011). Application of threshold techniques for readability improvement of Jawi historical manuscript images. Advanced Computing: An International Journal, 2, 60-69. https://doi.org/10.5121/ acij.2011.2206 Journal of ICT, 23, No. 4 (October) 2024, pp: 561-

Soomro, S., Munir, A., & Choi, K. N. (2019). Fuzzy C-means clustering based active contour model driven by edge scaled region information. Expert Systems with Applications, 120, 387–396. https://doi.org/10.1016/j.eswa.2018.10.052

Tsai, A., Yezzi, A., & Willsky, A. S. (2001). Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification. IEEE Transactions on Image Processing, 10(8), 1169-1186. https://doi.org/10.1109/83.935033

Ventzas, D., Ntogas, N., & Ventza, M. M. (2012). Digital restoration by denoising and binarization of historical manuscript images. In D. Ventzas (Ed.), Advanced image acquisition, processing techniques and applications (pp. 73–108). InTech. https://doi.org/10.5772/36734

Vese, L. A., & Chan, T. F. (2002). A multiphase level set framework for image segmentation using the Mumford and Shah model. International Journal of Computer Vision, 50(3), 271–293. https://doi.org/10.1023/A:1020874308076

Weng, G., Dong, B., & Lei, Y. (2021). A level set method based on additive bias correction for image segmentation. Expert Systems with Applications, 185, 115633. https://doi.org/10.1016/j. eswa.2021.115633

Yahya, S. R., Omar, K., Abdullah, S., & Sophian, A. (2018). Image enhancement background for high damage Malay manuscripts using adaptive threshold binarization. International Journal on Advanced Science, Engineering and Information Technology, 8(4-2), 1552-1564. https://core.ac.uk/download/ pdf/296919122.pdf

Yang, Y., Jia, W., & Wu, B. (2020). Simultaneous segmentation and correction model for color medical and natural images with intensity inhomogeneity. The Visual Computer, 36, 717-731. https://doi.org/10.1007/s00371-019-01651-4

Yousef, R., Khan, S., Gupta, G., Siddiqui, T., Albahlal, B. M., Alajlan, S. A., & Haq, M. A. (2023). U-Net-based models towards optimal MR brain image segmentation. Diagnostics, 13(9). https://doi.org/10.3390/diagnostics13091624

Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2019). Free-form image inpainting with gated convolution. In Proceedings of The IEEE/CVF International Conference on Computer Vision (pp. 4471-4480). https://doi.org/10.48550/arXiv.1806.03589

Zainal, N. N., Yuri, N. F. M., & Jumaat, A. K. (2022). Restoration of old Malay Jawi manuscripts using Mumford-Shah and Journal of ICT, 23, No. 4 (October) 2024, pp: 561-Bertalmio inpainting models. Malaysian Journal of Computing, 7(1), 1047-1055. https://myjms.mohe.gov.my/index.php/mjoc/ article/view/14882

Zhang, L., Chen, Q., Hu, B., & Jiang, S. (2020). Text-guided neural image inpainting. In Proceedings of the 28th ACM International Conference on Multimedia (MM ‘20) (pp. 1302–1310). Association for Computing Machinery. https://doi.org/10.1145/3394171.3414017

Zhao, Y., Price, B., Cohen, S., & Gurari, D. (2019). Guided image inpainting: Replacing an image region by pulling content from another image. In 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) (pp. 1514-1523). IEEE. https://doi.org/10.1109/WACV.2019.00166

Zulcaffle, T. M. A., Othman, A. K., Abidin, W. A. W. Z., Mohammaddan, S., & Marzuki, A. S. W. (2010). A thresholding algorithm for text/background segmentation in degraded handwritten Jawi documents. In 2010 Second International Conference on Advances in Computing, Control, and Telecommunication Technologies (pp. 80-84). https://doi.org/10.1109/ACT.2010.43

Downloads

Published

28-10-2024

How to Cite

Badarul Azam, A. S., Jumaat, A. K., Badarul Azam, A. B., Mohammad Sabri, N. A. S., Yahaya, A. M., Ismail, A. T., Abdul Razak, M. A., Maasar, M. A., & Laham, M. F. (2024). Restoration and Segmentation of Old Jawi Manuscripts using Variational Image Inpainting and Active Contour Models. Journal of Information and Communication Technology, 23(4), 561-592. https://doi.org/10.32890/jict2024.23.4.1

Research impact

Harvested 2026-09-06
0 citations recorded so far

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2024.23.4.1 OpenAlex W4403820610 Scopus 85208043570

Most read articles by the same author(s)