Restoration and Segmentation of Old Jawi Manuscripts using Variational Image Inpainting and Active Contour Models
DOI:
https://doi.org/10.32890/jict2024.23.4.1Keywords:
Active contour, historical document, image segmentation, image inpainting, old Jawi manuscriptAbstract
Old Jawi Manuscripts (OJM) are crucial to historical studies, offering insights into past societies. However, degradation from mishandling and environmental factors can impair their legibility. To preserve OJM, image inpainting and segmentation are essential for restoring corrupted areas and identifying text. Recently, the Gaussian Regularization Segmentation (GRS) model has shown effectiveness in intensity inhomogeneity grayscale image segmentation, though it was not designed for corrupted OJM images. Therefore, this study aimed to reformulate the GRS model to restore and segment text from real corrupted OJM images. The methodology begins with the incorporation of the Mumford-Shah and Bertalmio inpainting models into the GRS model as new fitting terms, resulting in the Modified Gaussian Regularization Segmentation Mumford-Shah (MGRSM) model and the Modified Gaussian Regularization Segmentation Bertalmio (MGRSB) model, respectively. MATLAB was used to implement these models, and their performance was assessed on 30 corrupted OJM samples from Malay Ethnomathematics Research Group, with expert evaluations and efficiency measured by average elapsed time. The MGRSM model achieved 38.4 percent and 12.4 percent higher overall total scores from experts in terms of segmentation accuracy compared to the GRS and MGRSB models, respectively. While the GRS model is the fastest, the MGRSM model provides superior accuracy, with an average processing time of 9.35 seconds, making it the most optimal for restoring and segmenting OJM images. This approach not only enhances the preservation of historical manuscripts but also provides a practical tool for researchers and historians in safeguarding our cultural heritage.
References
Ali, H., Rada, L., & Badshah, N. (2018). Image segmentation for intensity inhomogeneity in presence of high noise. IEEE Transactions on Image Processing, 27(8), 3729-3738. https://doi.org/10.1109/TIP.2018.2825101
Ashikhmin, M. (2001). Synthesizing natural textures. In Proceedings of the 2001 Symposium on Interactive 3D graphics (I3D ‘01) (pp. 217–226). Association for Computing Machinery. https://doi.org/10.1145/364338.364405
Azam, A. S. B., Jumaat, A. K., Maasar, M. A., Laham, M. F., & Rahman, N. N. A. (2023). Local image fitting-based active contour for vector-valued images. Indonesian Journal of Electrical Engineering and Computer Science, 32(1), 227-235. https://doi.org/10.11591/ijeecs.v32.i1.pp227-235 Journal of ICT, 23, No. 4 (October) 2024, pp: 561-
Badshah, N., Atta, H., Ali Shah, S. I., Attaullah, S., Minallah, N., & Ullah, M. (2020). New local region based model for the segmentation of medical images. IEEE Access, 8, 175035–175053. https://doi.org/10.1109/ACCESS.2020.3017805
Baihaqi, Yanti, Y., & Malahayati. (2024). Ancient manuscript image enhancement method using local and global histogram equalization. Jurnal Serambi Engineering, 9(3), 102-10263. https://jse.serambimekkah.id/index.php/jse/article/view/449
Barbu, T. (2018). Second-order anisotropic diffusion-based framework for structural inpainting. Proceedings of the Romanian Academy, Series A: Mathematics, Physics, Technical Sciences, Information Science, 19(2), 329-336. https://acad.ro/ sectii2002/proceedings/doc2018-2/Art03Barbu.pdf
Biswas, S., & Hazra, R. (2021). A level set model by regularizing local fitting energy and penalty energy term for image segmentation. Signal Processing, 183, 108043. https://doi.org/10.1016/j. sigpro.2021.108043
Bertalmio, M. (2001). Processing of flat and non-flat image information on arbitrary manifolds using partial differential equations. University of Minnesota. https://www.maths.univ-evry.fr/pages_perso/vtorri/files/UV/unpaint/thesis-bertalmio. pdf
Burrows, L., Patel, J., Islim, A. I., Jenkinson, M. D., Mills, S. J., & Chen, K. (2024). A semi-automatic segmentation method for meningioma developed using a variational approach model. The Neuroradiology Journal, 37(2), 199-205. https://doi.org/10.1177/19714009231224442
Chan, T. F., & Vese, L. A. (2001). Active contours without edges. IEEE Transactions on Image Processing, 10(2), 266-277. https://doi.org/10.1109/83.902291
Devadass, V., Bakar, J. A., Harun, N. H., & Zamri, M. F. (2021). Image enhancement system for the restoration of Old Jawi Malay manuscripts using binarization method. Journal of Physics: Conference Series, 1997(1), 012037. https://doi.org/10.1088/1742-6596/1997/1/012037
Esedoglu, S., & Shen, J. (2002). Digital inpainting based on the Mumford–Shah–Euler image model. European Journal of Applied Mathematics, 13(4), 353-370. https://doi.org/10.1017/ S0956792502004904
Fang, J., Liu, H., Liu, J., Zhou, H., Zhang, L., & Liu, H. (2021). Fuzzy region-based active contour driven by global and local fitting energy for image segmentation. Applied Soft Computing, 100, 106982. https://doi.org/10.1016/j.asoc.2020.106982 Journal of ICT, 23, No. 4 (October) 2024, pp: 561-
Gui, L., Ma, J., & Yang, X. (2023). Variational models and their combinations with deep learning in medical image segmentation: A survey. In K. Chen, C.-B. Schönlieb, X.-C. Tai, & L. Younes (Eds.), Handbook of mathematical models and algorithms in computer vision and imaging: Mathematical imaging and vision (pp. 1001-1022). Springer International Publishing. https://doi.org/10.1007/978-3-030-98661-2_109
Hays, J., & Efros, A. A. (2023). Scene completion using millions of photographs. In Seminal Graphics Papers: Pushing the Boundaries, Volume 2 (1st ed., pp. 679–685). Association for Computing Machinery. https://doi.org/10.1145/3596711.3596783
Huang, J. B., Kopf, J., Ahuja, N., & Kang, S. B. (2013). Transformation guided image completion. In IEEE International Conference on Computational Photography (ICCP) (pp. 1-9). IEEE. https://doi.org/10.1109/ICCPhot.2013.6528313
Iqbal, E., Niaz, A., Memon, A. A., Asim, U., & Choi, K. N. (2020). Saliency-driven active contour model for image segmentation. IEEE Access, 8, 208978-208991. https://doi.org/10.1109/ ACCESS.2020.3038945
Ismail, S. M., & Abdullah, S. N. H. S. (2014). Novel binarization method for enhancing ancient and historical manuscript images. In Human-inspired computing and its applications (pp. 394-403). Springer. https://doi.org/10.1007/978-3-319-13647-9_36
Jaidilert, S., & Farooque, G. (2018). Crack detection and images inpainting method for Thai mural painting images. In 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC) (pp. 143-148). IEEE. https://doi.org/10.1109/ICIVC.2018.8492735
Kaur, A., Raj, A., Jayanthi, N., & Indu, S. (2020). Inpainting of irregular holes in a manuscript using U-Net and partial convolution. In 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA) (pp. 526-531). IEEE. https://doi.org/10.1109/ICIRCA48905.2020.9182917
Kumpulan Penyelidikan Etnomatematik Melayu. (2021). Manuskrip Melayu. Universiti Putra Malaysia. https://inspem.upm.edu.my/ laboratori/laboratori_etnomatematik_dan_didaktik/kumpulan_ penyelidikan_etnomatematik_melayu_kupelema-54857
Mahmor, N. B., Azmi, M. S. B., & Abdullah, M. B. (2018). Image thresholding for Malay ancient manuscript (Terengganu Inscribed Stone). International Journal of Advances in Computer Science and Technology, 7(10). https://doi.org/10.30534/ijacst/2018/017102018 Journal of ICT, 23, No. 4 (October) 2024, pp: 561-
Mohd Sharif, N. A., Harun, N. H., & Yusof, Y. (2024). Colour image enhancement model of retinal fundus image for diabetic retinopathy recognition. Journal of Information and Communication Technology, 23(2), 293-334. https://doi.org/10.32890/jict2024.23.2.5
Mumford, D., & Shah, J. (1989). Optimal approximations by piecewise smooth functions and associated variational problems. Communications on Pure and Applied Mathematics, 42, 577-685. https://doi.org/10.1002/cpa.3160420503
Othman, M., Abdullah, S. L. S., Ahmad, K. A., Bakar, M. N. A., & Mansor, A. R. (2016). The fusion of edge detection and mathematical morphology algorithm for shape boundary recognition. Journal of Information and Communication Technology, 15(1), 133-144. http://e-journal.uum.edu.my/ index.php/jict/article/view/8175
Razak, Z. (2016). Old Jawi manuscript: Digital recognition [Doctoral thesis, University of Malaya]. University of Malaya Students’ Repository. http://studentsrepo.um.edu.my/id/eprint/
Saddami, K., Munadi, K., Muchallil, S., & Arnia, F. (2017). Improved thresholding method for enhancing Jawi binarization performance. In 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR). https://doi.org/10.1109/ICDAR.2017.183
Saibin, T. C., & Jumaat, A. K. (2023). Variational selective segmentation model for intensity inhomogeneous image. Indonesian Journal of Electrical Engineering and Computer Science, 29(1), 277-285. https://doi.org/10.11591/ijeecs.v29.i1.pp277-285
Schönlieb, C. B. (2015a). The Mumford-Shah image model for inpainting. In Partial differential equation methods for image inpainting. Cambridge University Press. https://doi.org/10.1017/CBO9780511734304
Schönlieb, C. B. (2015b). Transport inpainting. In Partial differential equation methods for image inpainting. Cambridge University Press. https://doi.org/10.1017/CBO9780511734304
Shen, J., & Chan, T. F. (2002). Mathematical models for local nontexture inpaintings. SIAM Journal on Applied Mathematics, 62(3), 1019-1043. https://doi.org/10.1137/S0036139900368844
Som, H. M., Zain, J. M., & Ghazali, A. J. (2011). Application of threshold techniques for readability improvement of Jawi historical manuscript images. Advanced Computing: An International Journal, 2, 60-69. https://doi.org/10.5121/ acij.2011.2206 Journal of ICT, 23, No. 4 (October) 2024, pp: 561-
Soomro, S., Munir, A., & Choi, K. N. (2019). Fuzzy C-means clustering based active contour model driven by edge scaled region information. Expert Systems with Applications, 120, 387–396. https://doi.org/10.1016/j.eswa.2018.10.052
Tsai, A., Yezzi, A., & Willsky, A. S. (2001). Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification. IEEE Transactions on Image Processing, 10(8), 1169-1186. https://doi.org/10.1109/83.935033
Ventzas, D., Ntogas, N., & Ventza, M. M. (2012). Digital restoration by denoising and binarization of historical manuscript images. In D. Ventzas (Ed.), Advanced image acquisition, processing techniques and applications (pp. 73–108). InTech. https://doi.org/10.5772/36734
Vese, L. A., & Chan, T. F. (2002). A multiphase level set framework for image segmentation using the Mumford and Shah model. International Journal of Computer Vision, 50(3), 271–293. https://doi.org/10.1023/A:1020874308076
Weng, G., Dong, B., & Lei, Y. (2021). A level set method based on additive bias correction for image segmentation. Expert Systems with Applications, 185, 115633. https://doi.org/10.1016/j. eswa.2021.115633
Yahya, S. R., Omar, K., Abdullah, S., & Sophian, A. (2018). Image enhancement background for high damage Malay manuscripts using adaptive threshold binarization. International Journal on Advanced Science, Engineering and Information Technology, 8(4-2), 1552-1564. https://core.ac.uk/download/ pdf/296919122.pdf
Yang, Y., Jia, W., & Wu, B. (2020). Simultaneous segmentation and correction model for color medical and natural images with intensity inhomogeneity. The Visual Computer, 36, 717-731. https://doi.org/10.1007/s00371-019-01651-4
Yousef, R., Khan, S., Gupta, G., Siddiqui, T., Albahlal, B. M., Alajlan, S. A., & Haq, M. A. (2023). U-Net-based models towards optimal MR brain image segmentation. Diagnostics, 13(9). https://doi.org/10.3390/diagnostics13091624
Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S. (2019). Free-form image inpainting with gated convolution. In Proceedings of The IEEE/CVF International Conference on Computer Vision (pp. 4471-4480). https://doi.org/10.48550/arXiv.1806.03589
Zainal, N. N., Yuri, N. F. M., & Jumaat, A. K. (2022). Restoration of old Malay Jawi manuscripts using Mumford-Shah and Journal of ICT, 23, No. 4 (October) 2024, pp: 561-Bertalmio inpainting models. Malaysian Journal of Computing, 7(1), 1047-1055. https://myjms.mohe.gov.my/index.php/mjoc/ article/view/14882
Zhang, L., Chen, Q., Hu, B., & Jiang, S. (2020). Text-guided neural image inpainting. In Proceedings of the 28th ACM International Conference on Multimedia (MM ‘20) (pp. 1302–1310). Association for Computing Machinery. https://doi.org/10.1145/3394171.3414017
Zhao, Y., Price, B., Cohen, S., & Gurari, D. (2019). Guided image inpainting: Replacing an image region by pulling content from another image. In 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) (pp. 1514-1523). IEEE. https://doi.org/10.1109/WACV.2019.00166
Zulcaffle, T. M. A., Othman, A. K., Abidin, W. A. W. Z., Mohammaddan, S., & Marzuki, A. S. W. (2010). A thresholding algorithm for text/background segmentation in degraded handwritten Jawi documents. In 2010 Second International Conference on Advances in Computing, Control, and Telecommunication Technologies (pp. 80-84). https://doi.org/10.1109/ACT.2010.43
Published
Issue
Section
License
Copyright (c) 2024 Journal of Information and Communication Technology

This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-06Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020






















