Reinforcement Learning Algorithm for Optimising Durian Irrigation Systems: Maximising Growth and Water Efficiency

Authors

  • Muhammad Shahrul Azwan Ramli Division of Control and Mechatronics Engineering, Faculty of Electrical Engineering, Universiti Teknologi Malaysia, Malaysia
  • Mohamad Shukri Zainal Abidin Division of Control and Mechatronics Engineering, Faculty of Electrical Engineering, Universiti Teknologi Malaysia, Malaysia and Petronas Research Sdn. Bhd., Malaysia
  • Nor Shahida Hasan Petronas Research Sdn. Bhd., Malaysia and Faculty of Built Environment and Surveying, Universiti Teknologi Malaysia, Malaysia
  • Mohd Nadzri Md Reba Faculty of Built Environment and Surveying, Universiti Teknologi Malaysia, Malaysia
  • Keshinro Kazeem Kolawole Division of Control and Mechatronics Engineering, Faculty of Electrical Engineering, Universiti Teknologi Malaysia, Malaysia
  • Rizqi Andry Ardiansyah Division of Control and Mechatronics Engineering, Faculty of Electrical Engineering, Universiti Teknologi Malaysia, Malaysia
  • Sikudhan Lucas Mpuhus Division of Control and Mechatronics Engineering, Faculty of Electrical Engineering, Universiti Teknologi Malaysia, Malaysia

DOI:

https://doi.org/10.32890/jict2024.23.4.4

Keywords:

Durian Farming, Durio Zibethinus, Machine Learning, Reinforcement Learning, Smart Irrigation

Abstract

This study presents a Reinforcement Learning-based algorithm designed to optimise irrigation for Durio Zibethinus (i.e., durian) trees, aiming to maximise tree growth and reduce water usage. Traditional irrigation methods, as well as current machine learning models, often focus only on soil moisture and weather data, neglecting critical factors like actual tree growth. This study proposed a reinforcement learning irrigation (RL-Irr) algorithm incorporating tree growth stages, soil moisture, and weather conditions to determine precise irrigation needs. The algorithm was developed by calibrating the AQUACROP model using data from actual durian plantations where rain-fed irrigation (rain-fed) was practised. Daily irrigation volumes were calculated based on real-time soil moisture, weather forecasts, and weekly tree growth measurements. The reinforcement learning method was used to optimise irrigation schedules, with rewards based on soil moisture, tree growth, rainfall, and weather conditions. The algorithm was tested using AQUACROP simulations and compared against soil moisture balance irrigation (SMB-Irr) and rain-fed. The results showed that the RL-Irr reduced water use by up to 75 percent while maintaining tree growth. These findings suggest the algorithm could significantly improve water efficiency in durian farming, though real-world applications should consider potential model limitations. 

References

Abioye, E. A., Hensel, O., Esau, T. J., Elijah, O., Abidin, M. S. Z., Ayobami, A. S., Yerima, O., & Nasirahmadi, A. (2022). Precision irrigation management using machine learning and digital farming solutions. AgriEngineering, 4(1), 70–103. https://doi.org/10.3390/agriengineering4010006

Agyeman, B. T., Decard-Nelson, B., Liu, J., & Shah, S. L. (2024). A semi-centralised multi-agent RL framework for efficient irrigation scheduling.

Aradi, S. (2022). Survey of deep reinforcement learning for motion planning of autonomous vehicles. IEEE Transactions on Intelligent Transportation Systems, 23(2), 740–759. https://doi.org/10.1109/TITS.2020.3024655

Ashraf, M. A., Othman, R., & Ishak, C. F. (Eds.) (2017). Soils of Malaysia CRC Press. https://doi.org/10.1201/b21934

Awais, M., Naqvi, S. M. Z. A., Zhang, H., Li, L., Zhang, W., Awwad, F. A., Ismail, E. A. A., Khan, M. I., Raghavan, V., & Hu, J. (2023). AI and machine learning for soil analysis: An assessment of sustainable agricultural practices. Bioresources and Bioprocessing, 10(1), 90. https://doi.org/10.1186/s40643-023-00710-y

Behzadipour, F., Ghasemi Nezhad Raeini, M., Abdanan Mehdizadeh, S., Taki, M., Khalil Moghadam, B., Zare Bavani, M. R., & Lloret, J. (2023). A smart IoT-based irrigation system design using AI and prediction model. Neural Computing and Journal of ICT, 23, No. 4 (October) 2024, pp: 667-Applications, 35(35), 24843–24857. https://doi.org/10.1007/ s00521-023-08987-y

Bwambale, E., Abagale, F. K., & Anornu, G. K. (2022). Smart irrigation monitoring and control strategies for improving water use efficiency in precision agriculture: A review. Agricultural Water Management, 260, 107324. https://doi.org/10.1016/j. agwat.2021.107324

Chen, M., Cui, Y., Wang, X., Xie, H., Liu, F., Luo, T., Zheng, S., & Luo, Y. (2021). A reinforcement learning approach to irrigation decision-making for rice using weather forecasts. Agricultural Water Management, 250, 106838. https://doi.org/10.1016/j. agwat.2021.106838

Chung, F. (2020, June 20). Durian Information - A Durian Blog Devoted to “The King of Fruits.” The Durian Blog. http://durianinfo.blogspot.com/p/durian-crop-production-cycle.html

Cocozza, C., Traversi, M. L., & Giovannelli, A. (2021). Tree growth conditions are demanded when optimal, are unwanted when limited, but when are they suboptimal? Plants, 10(9), 1943. https://doi.org/10.3390/plants10091943

Devraj, A. M., Bušić, A., & Meyn, S. (2021). Fundamental design principles for reinforcement learning algorithms. In Handbook of Reinforcement Learning and Control (pp. 75-137). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-60990-0_4

Ding, X., & Du, W. (2024). Optimising irrigation efficiency using deep reinforcement learning in the field. ACM Transactions on Sensor Networks, 20(4), 1–34. https://doi.org/10.1145/3662182

Ismail, S. M., Zin El-Abedin, T. K., El-Ansary, D. O., & Abd El-Al, A. (2015). Modification of FAO crop model to simulate yield response to water for peach trees. Misr Journal of Agricultural Engineering, 32(1), 145–172. https://doi.org/10.21608/ mjae.2015.98696

Ghareeb, A. Y., Gharghan, S. K., Mutlag, A. H., & Nordin, R. (2023). Wireless sensor network-based artificial intelligent irrigation system: Challenges and limitations. Journal of Techniques, 5(3), 26-41. https://doi.org/10.51173/jt.v5i3.1420

Jabro, J. D., Stevens, W. B., Iversen, W. M., Allen, B. L., & Sainju, U. M. (2020). Irrigation scheduling based on wireless sensors output and soil-water characteristic curve in two soils. Sensors, 20(5), 1336. https://doi.org/10.3390/s20051336

Jabro, J. D., Evans, R. G., Kim, Y., & Iversen, W. M. (2008). In-situ soil-water retention and field water capacity measurements in two contrasting soil textures. In 2008 Providence, Rhode Island, Journal of ICT, 23, No. 4 (October) 2024, pp: 667-June 29–July 2, 2008 (p. 1). American Society of Agricultural and Biological Engineers.

Jayaramireddy, C. S., Naraharisetti, S. V. V. S. S., Nassar, M., & Mekni, M. (2022, October). A survey of reinforcement learning toolkits for gaming: Applications, challenges and trends. In Proceedings of the Future Technologies Conference (pp. 165-184). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-031-18461-1_11

Ketsa, S., Wisutiamonkul, A., Palapol, Y., & Paull, R. E. (2020). The durian: Botany, horticulture, and utilisation. Horticultural reviews, 47, 125-211. https://doi.org/10.1002/9781119625407. ch4

Kumar, J., Patel, N., & Rajput, T. B. S. (2016). Development and integration of soil moisture sensor with drip system for precise irrigation scheduling through mobile phone. Journal of Applied and Natural Science, 8(4), 1959–1965. https://doi.org/10.31018/jans.v8i4.1070

Ladosz, P., Weng, L., Kim, M., & Oh, H. (2022). Exploration in deep reinforcement learning: A survey. Information Fusion, 85, 1–22. https://doi.org/10.1016/j.inffus.2022.03.003

Mohan, S. S., Venkat, R., Rahaman, S., Vinayak, M., & Babu, B. H. (2023). Role of AI in agriculture: Applications, limitations and challenges: A review. Agricultural Reviews, 44(2), 231-237. https://doi.org/10.18805/ag.R-2215

Obaideen, K., Yousef, B. A. A., AlMallahi, M. N., Tan, Y. C., Mahmoud, M., Jaber, H., & Ramadan, M. (2022). An overview of smart irrigation systems using IoT. Energy Nexus, 7, 100124. https://doi.org/10.1016/j.nexus.2022.100124

Othman, M., & Azahari, S. N. F. (2016). Deseasonalised forecasting model of rainfall distribution using fuzzy time series. Journal of Information and Communication Technology, 15(2), 153-169. https://doi.org/10.32890/jict.15.2.2016.6701

Pereira, L. S., Paredes, P., & Jovanovic, N. (2020). Soil water balance models for determining crop water and irrigation requirements and irrigation scheduling focusing on the FAO56 method and the dual Kc approach. Agricultural Water Management, 241, 106357. https://doi.org/10.1016/j.agwat.2020.106357

Polydoros, A. S., & Nalpantidis, L. (2017). Survey of model-based reinforcement learning: Applications on robotics. Journal of Intelligent & Robotic Systems, 86(2), 153–173. https://doi.org/10.1007/s10846-017-0468-y Journal of ICT, 23, No. 4 (October) 2024, pp: 667-

RainMachine. (2018). Soil Types. RainMachine-Green Electronics. https://support.rainmachine.com/hc/en-us/articles/228001248-Soil-Types

Ritchie, J. T. (1998). Soil water balance and plant water stress. In Understanding Options for Agricultural Production (pp. 41–54). https://doi.org/10.1007/978-94-017-3624-4_3

Saikai, Y., Peake, A., & Chenu, K. (2023). Deep reinforcement learning for irrigation scheduling using high-dimensional sensor feedback. PLOS Water, 2(9), e0000169. https://doi.org/10.1371/journal.pwat.0000169

Shakya, A. K., Ramola, A., Kandwal, A., & Vidyarthi, A. (2021). Soil moisture sensor for agricultural applications inspired from state of art study of surfaces scattering models & semi-empirical soil moisture models. Journal of the Saudi Society of Agricultural Sciences, 20(8), 559–572. https://doi.org/10.1016/j.jssas.2021.06.006

Soothar, R. K., Singha, A., Soomro, S. A., Chachar, A., Kalhoro, F., & Rahaman, M. A. (2021). Effect of different soil moisture regimes on plant growth and water use efficiency of Sunflower: Experimental study and modeling. Bulletin of the National Research Centre, 45(1), 121. https://doi.org/10.1186/s42269-021-00580-4

Sutton, R. S., & Barto, A. G. (1999). Reinforcement learning: An introduction. Robotica, 17(2), 229-235.

Syafiqah, N. F., Shariff, A. R., Che’Ya, N. N., & Ya, C. (2019). GIS and UAV Aerial Imaging Applications for Durian Plantation Management. In The 40th Asian Conference on Remote Sensing.

Talaviya, T., Shah, D., Patel, N., Yagnik, H., & Shah, M. (2020). Implementation of artificial intelligence in agriculture for optimisation of irrigation and application of pesticides and herbicides. Artificial Intelligence in Agriculture, 4, 58–73. https://doi.org/10.1016/j.aiia.2020.04.002

Tomar, P. K., Sobti, R., Prasad, R., Prasanna, K. L., Jain, A., & Sharma, S. (2023). Implementation of artificial intelligence technology for better irrigation system. 2023 3rd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), 2766–2770. https://doi.org/10.1109/ ICACITE57410.2023.10182791

Tzachor, A., Devare, M., King, B., Avin, S., & Ó hÉigeartaigh, S. (2022). Responsible artificial intelligence in agriculture requires systemic understanding of risks and externalities. Nature Journal of ICT, 23, No. 4 (October) 2024, pp: 667-Machine Intelligence, 4(2), 104–109. https://doi.org/10.1038/ s42256-022-00440-4

Vallejo-Gómez, D., Osorio, M., & Hincapié, C. A. (2023). Smart irrigation systems in agriculture: A systematic review. Agronomy, 13(2), 342. https://doi.org/10.3390/agronomy13020342 Van de Zande, G. D., Sheline, C., Amrose, S., Costello, J., Ghodgaonkar, A., Grant, F., & Winter, A. G. (2023, August 20). Design and evaluation of an automatic scheduling-manual operation tool to bring precision irrigation to resource-constrained farmers. Volume 3B: 49th Design Automation Conference (DAC). https://doi.org/10.1115/DETC2023-112470

Yousaf, A., Kayvanfar, V., Mazzoni, A., & Elomri, A. (2023). Artificial intelligence-based decision support systems in smart agriculture: Bibliometric analysis for operational insights and future directions. Frontiers in Sustainable Food Systems, 6, 1053921. https://doi.org/10.3389/fsufs.2022.1053921

Yu, L., Qin, S., Zhang, M., Shen, C., Jiang, T., & Guan, X. (2021). A review of deep reinforcement learning for smart building energy management. IEEE Internet of Things Journal, 8(15), 12046–12063. https://doi.org/10.1109/JIOT.2021.3078462

Yu Polenov, D. (2020). Artificial intelligence of the water supply system of plant growing objects. IOP Conference Series: Materials Science and Engineering, 739(1), 012047. https://doi.org/10.1088/1757-899X/739/1/012047

Zakaria, A. A. (2020). Irrigation for Durian. In Managing Durian Orchards in Malaysia (Vol. 1, pp. 119–125). UPM Press.

Zhang, J., Guan, K., Peng, B., Pan, M., Zhou, W., Jiang, C., Kimm, H., Franz, T. E., Grant, R. F., Yang, Y., Rudnick, D. R., Heeren, D. M., Suyker, A. E., Bauerle, W. L., & Miner, G. L. (2021). Sustainable irrigation based on co-regulation of soil water supply and atmospheric evaporative demand. Nature Communications, 12(1), 5549. https://doi.org/10.1038/s41467-021-25254-7

Downloads

Published

28-10-2024

How to Cite

Ramli, M. S. A., Zainal Abidin, M. S., Hasan, N. S., Md Reba, M. N., Kolawole, K. K., Ardiansyah, R. A., & Mpuhus, S. L. (2024). Reinforcement Learning Algorithm for Optimising Durian Irrigation Systems: Maximising Growth and Water Efficiency. Journal of Information and Communication Technology, 23(4), 667-707. https://doi.org/10.32890/jict2024.23.4.4

Research impact

Harvested 2026-09-05
1 citations, from OpenAlex — the highest of the sources checked

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2024.23.4.4 OpenAlex W4403820074 Scopus 85208046287