Committer Assessment Practice in Blockchain Project: A Systematic Literature Review
DOI:
https://doi.org/10.32890/jict2023.22.4.6Keywords:
Social factors, Committer, Off-chain governance, Technical factors, Open-Source SoftwareAbstract
As Blockchain projects gain popularity among developers, the number of patched codes rapidly increases. With such growth, it is difficult for the few committers to maintain it in a timely manner. Subsequently, the community is always in search of new committers. This highlights the imperative importance of committer assessment decisions towards the success of Blockchain. However, the practices come with risks whereby new committers may harm the project. For example, a new committer may initiate a hard fork that splits a project. Numerous systematic literature reviews have investigated developer turnover’s impact on open-source software (OSS) projects. These studies mainly focused on aspects such as community participation, engagement, and motivation. However, previous reviews often overlooked committer assessment practices, particularly in the context of Blockchain projects. Although Blockchain operates as OSS, its distinct attributes, such as decentralisation and cryptography, justify the need for a dedicated review. Therefore, the objectives of this review are to 1) identify committer assessment practices, 2) identify problems in committer assessment, 3) identify existing factors in committer assessment, and 4) suggest some possible research topics. These goals were achieved through a systematic review of literature published between 2010 and 2022. The findings suggest that previous assessment models are useful
but mainly focus on technical factors. The results also indicate that studies focusing on behavioural tendencies, which influence human activities, have so far been neglected. Finally, the paper concludes by charting potential open research opportunities.
References
Aksoy-Yurdagul, D., Rullani, F., & Lamastra, C. R. (2021). Designing shared spaces for firm-community collaborations for innovation: Formal policies and coordination in open source projects. Creativity and Innovation Management, 30(1), 164–181. https://doi.org/https://doi.org/10.1111/caim.12426
Al-Amri, R., Zakaria, N. H., Habbal, A., & Hassan, S. (2019). Cryptocurrency adoption: current stage, opportunities, and open challenges. International Journal of Advanced Computer Research, 9(44), 293–307. https://doi.org/10.19101/ijacr.pid43 Journal of ICT, 22, No. 4 (Oct) 2023, pp: 675-
Aljemabi, M. A., & Wang, Z. (2018). Empirical study on the evolution of developer social networks. IEEE Access, 6, 51049–51060. https://doi.org/10.1109/ACCESS.2018.2868427
Alzahrani, S., & Daim, T. U. (2019). Analysis of the cryptocurrency adoption decision: Literature review. PICMET 2019 - Portland International Conference on Management of Engineering and Technology: Technology Management in the World of Intelligent Systems, Proceedings, 1–11. https://doi.org/10.23919/ PICMET.2019.8893819
Amit, I., & Feitelson, D. G. (2021). Corrective commit probability: A measure of the effort invested in bug fixing. Software Quality Journal, 29(4), 817–861. https://doi.org/10.1007/s11219-021-09564-z
Anwar, R., Rehman, M., Wang, K. S., Hashmani, M. A., & Shamim, A. (2019). Investigation of knowledge sharing behavior in global software development organizations using social cognitive theory. IEEE Access, 7, 71286–71298. https://doi.org/10.1109/ ACCESS.2019.2912657
Barraood, S. O., Mohd, H., & Baharom, F. (2022). An initial investigation of the effect of quality factors on agile test case quality through experts’ review. Cogent Engineering, 9(1), 1–27. https://doi.org/10.1080/23311916.2022.2082121
Biais, B., Bisière, C., Bouvard, M., & Casamatta, C. (2019). The Blockchain Folk Theorem. Review of Financial Studies, 32(5), 1662–1715. https://doi.org/10.1093/rfs/hhy095
Bosu, A., Iqbal, A., Shahriyar, R., & Chakraborty, P. (2019). Understanding the motivations, challenges and needs of blockchain software developers: A survey. Empirical Software Engineering, 24(4), 2636-2673. https://doi.org/10.1007/ s10664-019-09708-7
Brasil-Silva, R., & Siqueira, F. L. (2022). Metrics to quantify software developer experience: A systematic mapping. In Proceedings of the ACM Symposium on Applied Computing (Vol. 1, Issue 1). Association for Computing Machinery. https://doi.org/10.1145/3477314.3507304
Canfora, G., Di Penta, M., Oliveto, R., & Panichella, S. (2018). Who is going to mentor newcomers in open source projects? In Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering, FSE 2012, 1–11. https://doi.org/10.1145/2393596.2393647 Journal of ICT, 22, No. 4 (Oct) 2023, pp: 675-
Carillo, K., Huff, S., & Chawner, B. (2017). What makes a good contributor? Understanding contributor behavior within large Free/Open Source Software projects – A socialization perspective. Journal of Strategic Information Systems, 26(4), 322–359. https://doi.org/10.1016/j.jsis.2017.03.001
Chakraborty, P., Shahriyar, R., Iqbal, A., & Bosu, A. (2018). Understanding the software development practices of blockchain projects. Proceedings of the 12th ACM/ IEEE International Symposium on Empirical Software Engineering and Measurement 2018 Oct 11, 1–10. https://doi.org/10.1145/3239235.3240298
Chatzipetrou, P., Šmite, D., & van Solingen, R. (2018). When and who leaves matters: emerging results from an empirical study of employee turnover. In Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (pp. 1-4). https://doi.org/10.1145/3239235.3267431
Chen, Y., Pereira, I., & Patel, P. C. (2021). Decentralized governance of digital platforms. Journal of Management, 47(5), 1305–1337. https://doi.org/10.1177/0149206320916755
Cheng, C., Li, B., Li, Z. Y., Zhao, Y. Q., & Liao, F. L. (2017). Developer role evolution in open source software ecosystem: An explanatory study on GNOME. Journal of Computer Science and Technology, 32(2), 396–414. https://doi.org/10.1007/ s11390-017-1728-9
Chua, B. B., & Zhang, Y. (2020). Applying a systematic literature review and content analysis method to analyse open source developers’ forking motivation interpretation, categories and consequences. Australasian Journal of Information Systems, 24(16), 1–19. https://doi.org/10.3127/ajis.v24i0.1714
Coelho, J., & Valente, M. T. (2017). Why modern open source projects fail. In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, 186–196. https://doi.org/10.1145/3106237.3106246
Coelho, J., Valente, M. T., Milen, L., & Silva, L. L. (2020). Is this gitHub project maintained? Measuring the level of maintenance activity of open-source projects. Information and Software Technology, 122, 106274. https://doi.org/10.1016/j. infsof.2020.106274
CoinMarketCap. (2019). Historical data for Bitcoin. https://coinmarketcap.com/currencies/bitcoin/historical-data/ Journal of ICT, 22, No. 4 (Oct) 2023, pp: 675-
Constantino, K., Zhou, S., Souza, M., Figueiredo, E., & Kästner, C. (2020). Understanding collaborative software development: An interview study. In Proceedings of the 2020 ACM/IEEE 15th International Conference on Global Software Engineering, 55–65. https://doi.org/10.1145/3372787.3390442
De Filippi, P., & Loveluck, B. (2016). The invisible politics of bitcoin: Governance crisis of a decentralised infrastructure. Internet Policy Review, 5(3), 1–28. https://doi.org/10.14763/2016.3.427
Dong, J. Q., & Götz, S. J. (2021). Project leaders as boundary spanners in open source software development: A resource dependence perspective. Information Systems Journal, 31(5), 672–694. https://doi.org/10.1111/isj.12313
Dybå, T., & Dingsøyr, T. (2008). Empirical studies of agile software development: A systematic review. Information and Software Technology, 50(9–10), 833–859. https://doi.org/10.1016/j. infsof.2008.01.006
Eichhorn, B. R. (2014). The impact of user involvement on information system projects [Cleveland State University]. In ProQuest Dissertations and Theses. https://search.proquest.com/docvie w/1651232265?accountid=188395
Fujita, S., Ohira, M., Ihara, A., & Matsumoto, K. (2014). An analysis of committers toward improving the patch review process in OSS development. In Supplementary Proceedings of the International Symposium on Software Reliability Engineering, 369–374.
Garagol, D., & Nilsson, O. (2018). Public blockchain communities a study on how governance mechanisms are expressed within blockchain communities (Master’s Dissertation). University of Gothenburg.
García-Peñalvo, F. J. (2016). Technological Ecosystems. IEEE Revista Iberoamericana de Tecnologias Del Aprendizaje, 11(1), 31–32. https://doi.org/10.1109/RITA.2016.2518458
Gousios, G., Storey, M. A., & Bacchelli, A. (2018). Work practices and challenges in pull-based development: The contributor’s perspective. In Proceedings of the International Conference on Software Engineering, 14-22-May-, 285–296. https://doi.org/10.1145/2884781.2884826
Hansun, S., Wicaksana, A., & Khaliq, A. Q. M. (2022). Multivariate cryptocurrency prediction: Comparative analysis of three recurrent neural networks approaches. Journal of Big Data, 9(1), 1–5. https://doi.org/10.1186/s40537-022-00601-7 Journal of ICT, 22, No. 4 (Oct) 2023, pp: 675-
Hom, P. W., Lee, T. W., Shaw, J. D., & Hausknecht, J. P. (2017). One hundred years of employee turnover theory and research. Journal of Applied Psychology, 102(3), 530–545. https://doi.org/530-545, doi: 10.1037/apl0000103
Ihara, A., Kamei, Y., Ohira, M., Hassan, A. E., Ubayashi, N., & Matsumoto, K. I. (2014). Early identification of future committers in open source software projects. In Proceedings of the International Conference on Quality Software, 47–56. https://doi.org/10.1109/QSIC.2014.30
Kaur, R., Kaur Chahal, K., & Saini, M. (2020). Understanding community participation and engagement in open source software projects: A systematic mapping study. Journal of King Saud University - Computer and Information Sciences, 34(7), 4607–4625. https://doi.org/10.1016/j.jksuci.2020.10.020
Kitchenham, B., & Charters, S. M. (2007). Guidelines for performing systematic literature reviews in software engineering.
Lee, A., Carver, J. C., & Bosu, A. (2018). Understanding the impressions, motivations, and barriers of one time code contributors to FLOSS projects: A survey. IEEE/ACM 39th International Conference on Software Engineering (ICSE) 2017, 187–197. https://doi.org/10.1109/ICSE.2017.25
Leewis, S., Smit, K., & van Meerten, J. (2021). An explorative dive into decision rights and governance of blockchain: A literature review and empirical study. Pacific Asia Journal of the Association for Information Systems, 13(3), 25–56. https://doi.org/10.17705/1pais.13302
Li, Z., Yu, Y., Wang, T., Yin, G., Li, S., & Wang, H. (2021). Are you still working on this an empirical study on pull request abandonment. IEEE Transactions on Software Engineering, 48(6), 1–17. https://doi.org/10.1109/TSE.2021.3053403
Lindman, J. (2021). What open source software research can teach us about public blockchain (s)?—Lessons for practitioners and future research. Frontiers in Human Dynamics, 3(October), 1–7. https://doi.org/10.3389/fhumd.2021.642556
Lindman, J., Rossi, M., & Tuunainen, V. K. (2017). Opportunities and risks of blockchain technologies in payments - A research agenda. Proceedings of the Annual Hawaii International Conference on System Sciences, 2017, 1533–1542.
Liu, K., Koyuncu, A., Kim, D., & Bissyande, T. F. (2019). AVATAR: Fixing semantic bugs with fix patterns of static analysis violations. In Proceedings of the 2019 IEEE 26th International Journal of ICT, 22, No. 4 (Oct) 2023, pp: 675-Conference on Software Analysis, Evolution, and Reengineering, 456–467. https://doi.org/10.1109/SANER.2019.8667970
Long, J. (2006). Understanding the role of core developers in open source development. Journal of Information, Information Technology, and Organizations (Years 1-3), 1, 075–085. https://doi.org/10.28945/148
Mäenpää, H., Mäkinen, S., Kilamo, T., Mikkonen, T., Männistö, T., & Ritala, P. (2018). Organizing for openness: Six models for developer involvement in hybrid OSS projects. Journal of Internet Services and Applications, 9(1), 1–14. https://doi.org/10.1186/s13174-018-0088-1
Mahmood, Y., Kama, N., Azmi, A., Khan, A. S., & Ali, M. (2022). Software effort estimation accuracy prediction of machine learning techniques: A systematic performance evaluation. Software - Practice and Experience, 52(1), 39–65. https://doi.org/10.1002/spe.3009
Marcilio, D., Furia, C. A., Bonifácio, R., & Pinto, G. (2020). SpongeBugs: Automatically generating fix suggestions in response to static code analysis warnings. Journal of Systems and Software, 168(2020), 110671. https://doi.org/10.1016/j. jss.2020.110671
Mehar, M., Shier, C., Giambattista, A., Gong, E., Fletcher, G., Sanayhie, R., Kim, H., & Laskowski, M. (2019). Understanding a revolutionary and flawed grand experiment in blockchain: The DAO attack. Journal of Cases on Information Technology, 21(1), 10–13. https://doi.org/https:10.4018/JCIT.2019010102
Mengist, W., Soromessa, T., & Legese, G. (2020). Method for conducting systematic literature review and meta-analysis for environmental science research. MethodsX, 7, 100777. https://doi.org/10.1016/j.mex.2019.100777
Mustafa, A. S., Al-Mashhadani, M. A., Jasim, S. A., Shantaf, A. M., & Hamdi, M. M. (2022). Blockchain in fifth-generation network and beyond: A survey. Bulletin of Electrical Engineering and Informatics, 11(3), 1399–1408. https://doi.org/10.11591/eei. v11i3.3209
O’Neil, M., Muselli, L., Raissi, M., & Zacchiroli, S. (2021). ‘Open source has won and lost the war’: Legitimising commercial–communal hybridisation in a FOSS project. New Media and Society, 23(5), 1157–1180. https://doi.org/10.1177/1461444820907022 Journal of ICT, 22, No. 4 (Oct) 2023, pp: 675-
Porru, S., Pinna, A., Marchesi, M., & Tonelli, R. (2017). Blockchain-oriented software engineering: Challenges and new directions. Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion, ICSE-C 2017, 169–171. https://doi.org/10.1109/ICSE-C.2017.142
Reboucas, M., Santos, R. O., Pinto, G., & Castor, F. (2017). How does contributors’ involvement influence the build status of an open-source software project? IEEE International Working Conference on Mining Software Repositories, 475–478. https://doi.org/10.1109/MSR.2017.32
Reiff, N. (2019). A History of Bitcoin Hard Forks. https://www. investopedia.com/tech/history-bitcoin-hard-forks/
Reijers, W., Wuisman, I., Mannan, M., De Filippi, P., Wray, C., Rae-looi, V., Vélez, A. C., Orgad, L. (2018). Now the code runs itself : On-chain and off-chain governance of blockchain technology. Topoi, 37(17), 821–831. https://doi.org/10.1007/ s11245-018-9626-5
Sarkintudu, S. M., Ibrahim, H. H., & Abd Wahab, A. (2019). Cryptocurrency platform ecosystem: A systematic literature review from information systems perspective. International Journal of Advanced Computer Research, 9(44), 308–315. https://doi.org/10.19101/ijacr.pid97
Shah, S. K. (2006). Motivation, governance, and the viability of hybrid forms in open source software development. Management Science, 52(7), 1000–1014. https://doi.org/10.1287/ mnsc.1060.0553
Sharif, K. Y., English, M., Ali, N., Exton, C., Collins, J. J., & Buckley, J. (2015). An empirically-based characterization and quantification of information seeking through mailing lists during open source developers’ software evolution. Information and Software Technology, 57(1), 77–94. https://doi.org/10.1016/j.infsof.2014.09.003
Sinha, V. S., Mani, S., & Sinha, S. (2015). Entering the circle of trust: Developer initiation as committers in open-source projects. In Proceedings of the 8th Working Conference on Mining Software Repositories, 133–142. https://doi.org/10.1145/1985441.1985462
Song, J., & Kim, C. (2018). What is needed for the sustainable success of OSS projects: Efficiency analysis of commit production process via Git. Sustainability, 10(9). https://doi.org/10.3390/ su10093001 Journal of ICT, 22, No. 4 (Oct) 2023, pp: 675-
Steinmacher, I., Graciotto Silva, M. A., & Gerosa, M. A. (2014). Barriers faced by newcomers to open source projects: A systematic review. In International Conference on Open Source Systems. 153–163. https://doi.org/10.1007/978-3-642-55128-4_21
Trinkenreich, B., Wiese, I., Sarma, A., Gerosa, M., & Steinmacher, I. (2022). Women’s participation in open source software: A survey of the literature. ACM Transactions on Software Engineering and Methodology, 31(4), 81:2-81:37. https://doi.org/10.1145/3510460
Tsay, J., Dabbish, L., & Herbsleb, J. (2014). Influence of social and technical factors for evaluating contribution in GitHub. In Proceedings of the 36th international conference on Software engineering, 356–366. https://doi.org/10.1145/2568225.2568315
Wang, Z., Feng, Y., Wang, Y., Jones, J. A., & Redmiles, D. (2020). Unveiling elite developers’ activities in open source projects. ACM Transactions on Software Engineering and Methodology, 29(3), 1–35. https://doi.org/10.1145/3387111
Wessel, M., Serebrenik, A., Wiese, I., Steinmacher, I., & Gerosa, M. A. (2022). Quality gatekeepers: Investigating the effects of code review bots on pull request activities. Empirical Software Engineering, 27(5), 108. https://doi.org/10.1007/s10664-022-10130-9
Yang, N., Ferreira, I., Serebrenik, A., & Adams, B. (2022). Why do projects join the Apache software foundation? Proceedings - International Conference on Software Engineering, 1(1), 161–171. https://doi.org/10.1109/ICSE-SEIS55304.2022.9794012
Yli-Huumo, J., Ko, D., Choi, S., Park, S., & Smolander, K. (2016). Where is current research on Blockchain technology? - A systematic review. PLoS ONE, 11(10), 1–28. https://doi.org/10.1371/journal.pone.0163477
Zhou, M., & Mockus, A. (2017). Who will stay in the FLOSS community? Modeling participant’s initial behavior. IEEE Transactions on Software Engineering, 41(1), 82–99. https://doi.org/10.1109/TSE.2014.2349496
Published
Issue
Section
License
Copyright (c) 2023 Journal of Information and Communication Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
Research impact
Harvested 2026-09-24Counts differ between services because each indexes a different body of literature. None of them is the whole picture.
2002 - 2020
