Hybrid Neighbourhood Component Analysis with Gradient Tree Boosting for Feature Selection in Forecasting Crime Rate
DOI:
https://doi.org/10.32890/jict2023.22.2.3Keywords:
Feature Selection, Artificial Intelligence, Neighbourhood Component Analysis, Gradient Tree Boosting, Crime ForecastingAbstract
Crime forecasting is beneficial as it provides valuable information to the government and authorities in planning an efficient crime
prevention measure. Most criminology studies found that influence from several factors, such as social, demographic, and economic
factors, significantly affects crime occurrence. Therefore, most criminology experts and researchers study and observe the effect
of factors on criminal activities as it provides relevant insight into possible future crime trends. Based on the literature review, the
applications of proper analysis in identifying significant factors that influence crime are scarce and limited. Therefore, this study proposed a hybrid model that integrates Neighbourhood Component Analysis (NCA) with Gradient Tree Boosting (GTB) in modelling the United States (US) crime rate data. NCA is a feature selection technique used in this study to identify the significant factors influencing crime rate. Once the significant factors were identified, an artificial intelligence technique, i.e., GTB, was implemented in modelling the crime data, where the crime rate value was predicted. The performance of the proposed model was compared with other existing models using quantitative measurement error analysis. Based on the result, the proposed NCA-GTB model outperformed other crime models in predicting the crime rate. As proven by the experimental result, the proposed model produced the smallest quantitative measurement error in the case study.
References
Aldehim, G., & Wang, W. (2017). Determining appropriate approaches for using data in feature selection. International Journal of Machine Learning and Cybernetics, 8, 915–928.
Alwee, R. (2014). Swarm optimized support vector regression with autoregressive integrated moving average for modeling of crime rate. [Doctoral thesis Universiti Teknologi Malaysia].
Anser, M. K., Yousaf, Z., Nassani, A. A., Alotaibi, S. M., Kabbani, A., & Zaman, K. (2020). Dynamic linkages between poverty, inequality, crime, and social expenditures in a panel of 16 countries: Two-step GMM estimates. Journal of Economic Structures, 9(1), 1–25.
Babakura, A., Sulaiman, M. N., & Yusuf, M. A. (2014, August). Improved method of classification algorithms for crime prediction. In 2014 IEEE International Symposium on Biometrics and Security Technologies (ISBAST) (pp. 250–255). IEEE.
Baliyan, A., Gaurav, K., & Mishra, S. K. (2015). A review of short term load forecasting using artificial neural network models. Procedia Computer Science, 48, 121–125.
Blakeslee, D., Chaurey, R., Fishman, R., Malghan, D., & Malik, S. (2021). In the heat of the moment: Economic and non-economic drivers of the weather-crime relationship. Journal of Economic Behavior & Organization, 192, 832–856.
Bogomolov, A., Lepri, B., Staiano, J., Oliver, N., Pianesi, F., & Pentland, A. (2014, November). Once upon a crime: Towards crime prediction from demographics and mobile data. In Proceedings of 16th International Conference on Multimodal Interaction (pp. 427–434).
Breiman, L. (1997). Arcing the edge. Technical Report 486, Statistics Department, University of California, Berkeley.
Brown, E., & Males, M. (2011). Does age or poverty level best predict criminal arrest and homicide rates? A preliminary investigation. Justice Policy Journal, 8, 1–30.
Castelli, M., Sormani, R., Trujillo, L., & Popovič, A. (2017). Predicting per capita violent crimes in urban areas: An artificial intelligence approach. Journal of Ambient Intelligence and Humanized Computing, 8, 29–36.
Chandrashekar, G., & Sahin, F. (2014). A survey on feature selection methods. Computers and Electrical Engineering, 40, 16–28. Journal of ICT, 22, No. 2 (April) 2023, pp: 207–
Chen, T. (2022, April). Multivariate analysis on determining the main influencing factors of police violence in the United States. In International Conference on Statistics, Applied Mathematics, and Computing Science (CSAMCS) (Vol. 12163, pp. 16–21). SPIE.
Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. Annals of Statistics, 1189–1232.
Ghazvini, A., Nazri, M. Z. B. A., Abdullah, S. N. H. S., Junoh, M. N., & Kasim, Z. A. (2015, November). Biography commercial serial crime analysis using enhanced dynamic neural network. In IEEE 7th International Conference of Soft Computing and Pattern Recognition (SoCPaR) (pp. 334–339). IEEE.
Gorr, W., Olligschlaeger, A., & Thompson, Y. (2003). Short-term forecasting of crime. International Journal of Forecasting, 19, 579–594.
Guo, R., Fu, D., & Sollazzo, G. (2022). An ensemble learning model for asphalt pavement performance prediction based on gradient boosting decision tree. International Journal of Pavement Engineering, 23(10), 3633–3646.
Han, M., & Wang, Y. (2009). Analysis and odelling of multivariate chaotic time series based on neural network. Expert Systems with Applications, 36, 1280–1290.
Hanslmaier, M., Kemme, S., Stoll, K., & Baier, D. (2015). Forecasting crime in Germany in times of demographic change. European Journal on Criminal Policy and Research, 21, 591–610.
Hipp, J. R., & Yates, D. K. (2011). Ghettos, thresholds, and crime: Does concentrated poverty really have an accelerating increasing effect on crime? Criminology, 49, 955–990.
Iqbal, R., Murad, M. A. A., Mustapha, A., Panahy, P. H. S., & Khanahmadliravi, N. (2013). An experimental study of classification algorithms for crime prediction. Indian Journal of Science and Technology, 6, 4219–4225.
Kim, Y. A. (2018). Examining the relationship between the structural characteristics of place and crime by imputing census block data in street segments: Is the pain worth the gain? Journal of Quantitative Criminology, 34(1), 67–110.
Li, Q., Qiao, F., Mao, A., & McCreight, C. (2019). Characterizing the importance of criminal factors affecting bus ridership using random forest ensemble algorithm. Transportation Research Record, 2673(4), 864–876. Journal of ICT, 22, No. 2 (April) 2023, pp: 207–
Li, S.-T., Kuo, S.-C., & Tsai, F.-C. (2010). An intelligent decision-support model using FSOM and rule extraction for crime prevention. Expert Systems with Applications, 37, 7108–7119.
Liu, X., Shen, C., Wang, W., & Guan, X. (2019). CoEvil: A coevolutionary model for crime inference based on fuzzy rough feature selection. IEEE Transactions on Fuzzy Systems, 28, 806–817.
Liu, Y., Gu, Y., Nguyen, J. C., Li, H., Zhang, J., Gao, Y., & Huang, Y. (2017). Symptom severity classification with gradient tree boosting. Journal of Biomedical Informatics, 75, S105–S111.
Malan, N. S., & Sharma, S. (2022). Motor imagery EEG spectral-spatial feature optimization using dual-tree complex wavelet and neighbourhood component analysis. IRBM, 43(3), 198–209.
McClendon, L., & Meghanathan, N. (2015). Using machine learning algorithms to analyze crime data. Machine Learning and Applications: An International Journal (MLAIJ), 2(1), 1–12.
Mills, C. E., Freilich, J. D., & Chermak, S. M. (2017). Extreme hatred: Revisiting the hate crime and terrorism relationship to determine whether they are “close cousins” or “distant relatives”. Crime & Delinquency, 63(10), 1191–1223.
Nguyen, T. T., Hatua, A., & Sung, A. H. (2017). Building a learning machine classifier with inadequate data for crime prediction. Journal of Advances in Information Technology, 8(2).
Osborn, D. (2018). An investigation into quarterly crime and its relationship to the economy. In Illicit activity (pp. 75–101). Routledge.
Pedregosa, F., Gaël, V., Alexandre, G., Vincent, M., Bertrand, T., Olivier, G., Mathieu, B., Peter, P., Ron, W., Vincent, D., Jake, V., Alexandre, P., David, C., Matthieu, B., Matthieu, P., & Édouard, D. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
Quick, M., Li, G., & Brunton-Smith, I. (2018). Crime-general and crime-specific spatial patterns: A multivariate spatial analysis of four crime types at the small-area scale. Journal of Criminal Justice, 58, 22–32.
Ranson, M. (2014). Crime, weather, and climate change. Journal of Environmental Economics and Management, 67, 274–302.
Rather, A. M., Sastry, V., & Agarwal, A. (2017). Stock market prediction and portfolio selection models: A survey. OPSEARCH, 54, 558–579. Journal of ICT, 22, No. 2 (April) 2023, pp: 207–
Sainin, M. S., Alfred, R., & Ahmad, F. (2021). Ensemble meta classifier with sampling and feature selection for data with imbalance multiclass problem. Journal of Information and Communication Technology, 20(2), 103–133.
Shah Habibullah, M., & Baharom, A. H. (2009). Crime and economic conditions in Malaysia. International Journal of Social Economics, 36, 1071–1081.
Shi, T. (2020, July). A method of predicting crime of theft based on bagging ensemble feature selection. In 2020 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS) (pp. 140–143). IEEE.
Shrivastav, A. K., & Ekata, D. (2012). Applicability of soft computing technique for crime forecasting: A preliminary investigation. International Journal of Computer Science and Engineering Technology, 9(9), 415–421.
Soundarya, V., Kanimozhi, U., & Manjula, D. (2017). Recommendation system for criminal behavioral analysis on social network using genetic weighted K-means clustering. Journal of Computers, 12, 212–220.
Stansfield, R., Williams, K. R., & Parker, K. F. (2017). Economic disadvantage and homicide: Estimating temporal trends in adolescence and adulthood. Homicide Studies, 21, 59–81.
Sun, R., Wang, G., Zhang, W., Hsu, L. T., & Ochieng, W. Y. (2020). A gradient boosting decision tree based GPS signal reception classification algorithm. Applied Soft Computing, 86, 105942.
Tonkal, Ö., Polat, H., Başaran, E., Cömert, Z., & Kocaoğlu, R. (2021). Machine learning approach equipped with neighbourhood component analysis for DDoS attack detection in software-defined networking. Electronics, 10(11), 1227.
Vineeth, K. S., Pandey, A., & Pradhan, T. (2016, May). A novel approach for intelligent crime pattern discovery and prediction. In 2016 IEEE International Conference on Advanced Communication Control and Computing Technologies (ICACCCT) (pp. 531–538).
Wang, X., & Hu, S. (2022, January). Analysis of the relationship between unemployment and crime rate in China. In 2021 International Conference on Social Development and Media Communication (SDMC) (pp. 665–670). Atlantis Press.
Yang, W., Wang, K., & Zuo, W. (2012). Neighborhood component feature selection for high-dimensional data. Journal of Computers, 7(1), 161–168. Journal of ICT, 22, No. 2 (April) 2023, pp: 207–
Yearwood, D. L., & Koinis, G. (2011). Revisiting property crime and economic conditions: An exploratory study to identify predictive indicators beyond unemployment rates. The Social Science Journal, 48, 145–158.
Zhang, Y., Ren, X., & Zhang, J. (2019, July). Intrusion detection method based on information gain and ReliefF feature selection. In IEEE International Joint Conference on Neural Networks (IJCNN) (pp. 1–5). IEEE.
Zheng, Y., Liu, Q., Chen, E., Zhao, J. L., He, L., & Lv, G. (2015, May). Convolutional nonlinear neighbourhood components analysis for time series classification. In Pacific-Asia Conference on Knowledge Discovery and Data Mining (pp. 534–546).
Published
Issue
Section
License
Copyright (c) 2023 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-05Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
