The face and content validity of an instrument for measuring financial risk tolerance

Nadia Edmaz Abdul Hadi; Nur Anis Juliana Shafidan; Siti Rauhati Razali; Qusay Mohammed Abdulateef; Mohamad Shukri Abdul Hamid

doi:10.32890/jcia2023.2.1.4

Authors

Nadia Edmaz Abdul Hadi Universiti Utara Malaysia, Malaysia
Nur Anis Juliana Shafidan Universiti Utara Malaysia, Malaysia
Siti Rauhati Razali Universiti Utara Malaysia, Malaysia
Qusay Mohammed Abdulateef Universiti Utara Malaysia, Malaysia
Mohamad Shukri Abdul Hamid Universiti Utara Malaysia, Malaysia

DOI:

https://doi.org/10.32890/jcia2023.2.1.4

Keywords:

content validity, face validity, financial literacy, financial risk tolerance, S-CVI

Abstract

Accurate evaluation of investment risk tolerance is critical in an investment decision-making process because a mismatch between the risk an investor could tolerate and the risk-return expectations could lead to frustration towards the actual financial gains or financial losses. This study aims to develop a valid instrument (or scale) for self-directed Malaysian investors to measure financial risk tolerance based on four main constructs, i.e., risk attitude, risk propensity, risk capacity, and financial literacy. An initial 36-item instrument was developed based on the assessment framework from Cordell (2001), which subsequently was examined by four lay experts for face validity. Consequently, according to Andrian et al. (2018), seven professional experts, comprising theoretical, industry practitioner, and psychometric experts, were involved in reviewing the relevancy of the content of each item towards measuring financial or investment risk tolerance level. As a result, the instrument is deemed to have a good face value, with 94.4% of the items rated highly at 4 or 3 (out of the maximum rating of 4) by lay experts. Out of the 36 items, only 5.56% are rated 1 or 2, and 16.7% of the items require revision in terms of their face value and clarity. The content validity exercise resulted in high scores of more than 0.83 cut scores based on Lynn (1986) for the scale content validity index (S-CVI), with nine items recorded as item content validity index (I-CVI) below 0.83. The S-CVI improved further to 0.90 after the removal of items with low I-CVI. The findings have also successfully produced a valid instrument that can measure the financial risk tolerance level of investors in Malaysia.

References

Akbulaev, N., & Mammadova, M. (2021). Demographic analysis of financial literacy level in Azerbaijan. Universal Journal of Accounting and Finance, 9(3), 316-328. https://ssrn.com/abstract=3857452

Amanah Saham Nasional Berhad. (2022). ASNB. https://www.asnb.com.my/

Andrian, D., Kartowagiran, B., & Hadi, S. (2018). The Instrument development to evaluate local curriculum in Indonesia. International Journal of Instruction, 11(4), 921-934. https://doi.org/10.12973/iji.2018.11458a

Avery, R. B., Elliehausen, G. E., Canner, G. B., & Gustafson, T. A. (1984). Survey of consumer finances, 1983. Federal Reserve Bulletin, 70, 679-692.

Azman, N. H. (2021, 1 November). Investments in cryptocurrencies increasing steadily in Malaysia. The Malaysian Reserve. https://themalaysianreserve.com/2021/11/01/investments-in-cryptocurrencies-increasing-steadily-in-malaysia/

Bayar, Y., Sezgin, H. F., Öztürk, Ö. F., & Şaşmaz, M. Ü. (2020). Financial literacy and financial risk tolerance of individual investors: Multinomial logistic regression approach. SAGE Open, 10(3). https://doi.org/10.1177/2158244020945717

Brayman, S. (2012). Defining and measuring risk capacity. Financial Services Review, 21(2), 131-148.

Brockhaus Sr, R. H. (1980). Risk taking propensity of entrepreneurs. Academy of Management Journal, 23(3), 509-520. https://doi.org/10.2307/255515

Bucciol, A., & Miniaci, R. (2018). Financial risk propensity, business cycles and perceived risk exposure. Oxford Bulletin of Economics and Statistics, 80(1), 160-183. https://doi.org/10.1111/obes.12193

Bujang, M. A., Omar, E. D., & Baharum, N. A. (2018). A review on sample size determination for Cronbach’s Alpha test: A simple guide for researchers. Malaysian Journal of Medical Sciences, 25(6), 85-99. https://doi.org/10.21315/mjms2018.25.6.9

Charles Schwab. (2022). charlesSCHWAB. https://www.schwab.com/

Chong, S. C., Heng, H. K., Lim, S. J., Navaratnam, V., & Neoh, A. Z. (2021). Financial risk tolerance: the case of older Chinese in Klang Valley, Malaysia 2020. International Journal of Financial Research, 12(2), 1-9. https://doi.org/10.5430/ijfr.v12n2p1

Chyung, S. Y., Roberts, K., Swanson, I., & Hankinson, A. (2017). Evidence-based survey design: The use of a midpoint on the Likert scale. Performance Improvement, 56(10), 15-23. https://doi.org/10.1002/pfi.21727

Concina, L. (2014). Risk attitude & economics. Foundation for an industrial safety culture (Foncsi). http://www.foncsi.org/

Cordell, D. M. (2001). RiskPACK: How to evaluate risk tolerance. Journal of Financial Planning, 14(6), 36-40.

Cordell, D. M. (2002). Risk tolerance in two dimensions. Journal of Financial Planning, 15(5), 30-35.

Davis, A. E. (1996). Instrument development: Getting started. Journal of Neuroscience Nursing, 28(3), 204-208. https://doi.org/ 10.1097/01376517-199606000-00009

Deck, C., Lee, J., & Reyes, J. (2008). Risk attitudes in large stake gambles: Evidence from a game show. Applied Economics, 40(1), 41-52. https://doi.org/10.1080/00036840701235704

DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications. SAGE publications.

Duasa, J., & Yusof, S. A. (2013). Determinants of risk tolerance on financial asset ownership: A case of Malaysia. International Journal of Business & Society, 14(1), 1-16.

Fernando, J. (2022, 13 October). What is financial literacy, and why is it so important?. https://www.investopedia.com/terms/f/financial-literacy.asp

Fidelity Asset Management Services. (2022). Fidelity asset management services. https://www.fidelitybankinvestments.com/

Gibson, R. J., Michayluk, D., & Van de Venter, G. (2013). Financial risk tolerance: An analysis of unexplored factors. Financial Services Review, 22(1), 23-50.

Gilliam, J., Chatterjee, S., & Grable, J. (2010). Measuring the perception of financial risk tolerance: A tale of two measures. Journal of Financial Counseling and Planning, 21(2), 30-43. https://ssrn.com/abstract=2061313

Grable, J. E. (2000). Financial risk tolerance and additional factors that affect risk taking in everyday money matters. Journal of Business and Psychology, 14, 625-630. https://doi.org/10.1023/A:1022994314982

Grable, J., & Lytton, R. H. (1999). Financial risk tolerance revisited: The development of a risk assessment instrument. Financial services review, 8(3), 163-181. https://doi.org/10.1016/S1057-0810(99)00041-4

Grable, J., & Lytton, R. H. (2003). The development of a risk assessment instrument: A follow-up study. Financial Services Review, 12(3), 257-274.

Guiso, L., Sapienza, P., & Zingales, L. (2018). Time varying risk aversion. Journal of Financial Economics, 128(3), 403-421. https://doi.org/10.1016/j.jfineco.2018.02.007

Hadi, H. J., Omar, M. A., Osman, W. R., Ibrahim, M. F., & Hussaini, M. (2020). Performing a content validity: Establishing a reliable instrument to measure the intention to adopt cloud computing software as a service in public organization. Journal of Theoretical and Applied Information Technology, 98(22), 3531-3540.

Hanna, S. D., & Chen, P. (1997). Subjective and objective risk tolerance: Implications for optimal portfolios. Financial Counselling and Planning, 8(2), 17-26. doi:10.2139/ssrn.95488

Hendarto, K., Anastasia, N., & Basana, S. R. (2021). The effect of financial literacy, financial risk tolerance, and financial socialization agents on stock investment decision in the millennial generation. Petra International Journal of Business Studies, 4(1), 11-22. https://doi.org/10.9744/ijbs.4.1.11-22

Hermansson, C., & Jonsson, S. (2021). The impact of financial literacy and financial interest on risk tolerance. Journal of Behavioral and Experimental Finance, 29, 100450. https://doi.org/10.1016/j.jbef.2020.100450

Hertzog, M. A. (2008). Considerations in determining sample size for pilot studies. Research in Nursing and Health, 31(2), 180-191. https://doi.org/10.1002/nur.20247

Hillson, D., & Murray-Webster, R. (2004). Understanding and Managing Risk Attitude. Gower Publishing Limited.

Holzhauer, H. M., Lu, X., McLeod, R., & Wang, J. (2016). RiskTRACK: The five-factor model for measuring risk tolerance. The Journal of Risk Finance, 17(4), 428-445. https://doi.org/10.1108/JRF-04-2016-0054

Hung, A. A., Parker, A. M., & Yoong, J. K. (2009). Defining and Measuring Financial Literacy. RAND Corporation.

Karim, B. A., Wenceslas, C. N., & Shukri, M. H. (2016). Risk tolerance level among working adults in Kuala Lumpur Malaysia. UNIMAS Review of Accounting and Finance, 1(1).

Kim, K. T., Hanna, S. D., & Ying, D. (2021). The risk tolerance measure in the 2016 survey of consumer finances: New, but is it improved? Journal of Financial Counseling and Planning, 86-103. http://dx.doi.org/10.1891/JFCP-19-00022

Kogan, N. (1961). Attitudes toward old people: The development of a scale and an examination of correlates. Journal of Abnormal and Social Psychology, 62, 44-54. https://doi.org/10.1037/h0048053.

Kogan, N., & Wallach, M. A. (1964). Risk Taking: A Study in Cognition and Personality. Holt, Reinhart and Winston.

Kundi, B., Hashim, S., & Kanwal, A. (2017). Multinomial logistic analysis of income level of salaried class on financial risk tolerance. Journal of Managerial Sciences, XI(04), 205-212. Lifegro Pty Ltd. (2022). Lifegro Financial Planning. https://lifegro.com.au/

Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382-386.

Magendans, J., Gutteling, J. M., & Zebel, S. (2017). Psychological determinants of financial buffer saving: the influence of financial risk tolerance and regulatory focus. Journal of Risk Research, 20(8), 1076-1093. https://doi.org/10.1080/13669877.2016.1147491

Meertens, R. M., & Lion, R. (2008, May). Measuring an individual’s tendency to take risks: the risk propensity scale. Journal of Applied Social Psychology, 38(6), 1506-1520. https://doi.org/10.1111/j.1559-1816.2008.00357.x

Miller, J. F., & Powers, M. J. (1986). Development of an instrument to measure hope. Nursing Research, 37(1), 6-10.

Morgans Financial Limited. (2022). Morgans. https://www.morgans.com.au/

Noviarini, J., Coleman, A., Roberts, H., & Whiting, R. H. (2021). Financial literacy, debt, risk tolerance and retirement preparedness: Evidence from New Zealand. Pacific-Basin Finance Journal, 68, 101598. https://doi.org/10.1016/j.pacfin.2021.101598

Phillip Mutual Berhad. (2022). Phillip Mutual Berhad. https://www.phillipmutual.com/

Principal Asset Management Berhad. (n.d.). Principal. https://www.principal.com.my/

Rabbani, A., O’Neill, B., Lawrence, F., & Grable, J. (2018). The investment risk tolerance assessment: A resource for extension educators. The Journal of Extension, 56(7), Article 3. https://tigerprints.clemson.edu/joe/vol56/iss7/3

Ramli, N. F., Talib, O., Hassan, S. A., & Manaf, U. K. (2020). Development and validation of an instrument to measure STEM teachers’ instructional preparedness. Asian Journal of University Education, 16(3), 193-206.

Raykov, T., & Marcoulides, G. A. (2010). Introduction to Psychometric Theory (1st ed.). Routledge.

Rohrmann, B. (2008). Risk perception, risk attitude, risk communication, risk management: A conceptual appraisal [Paper presentation]. 15th International Emergency Management Society Annual Conference, 2008.

Roszkowski, M. J., Davey, G., & Grable, J. E. (2005). Insights from psychology and psychometrics on measuring risk tolerance. Journal of Financial Planning, 18(4), 66-77.

Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27(2), 94-104. https://doi.org/10.1093/swr/27.2.94

Securities Commission Malaysia. (2019, 19 July). Guidelines on Sales Practices of Unlisted Capital Market Products. SecuritiesCommission Malaysia.

Sitkin, S. B., & Pablo, A. L. (1992). Reconceptualizing the determinants of risk behavior. The Academy of Management Review, 17(1), 9-38. https://doi.org/10.2307/258646

U.S. Securities and Exchange Commission. (2013, March). Regulation of Investment Advisers. Staff of the Investment Adviser Regulation Office Division.

Vanguard. (2022). Vanguard. https://investor.vanguard.com/corporate-portal/

Whitehead, A. L., Julious, S. A., Cooper, C. L., & Campbell, M. J. (2016). Estimating the sample size for a pilot randomized trial to minimize the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Statistical Methods in Medical Research, 25(3), 1057-1073. https://doi.org/ 10.1177/0962280215588241

Yong, H. N., & Tan, K. L. (2017). The influence of financial literacy towards risk tolerance. International Journal of Business and Society, 18(3), 469-484. https://doi.org/10.33736/ijbs.3139.2017

Zakaria, Z., Nor, S. M., & Ismail, M. R. (2017). Financial literacy and risk tolerance towards saving and investment: A case study in Malaysia. International Journal of Economics and Financial Issues, 7(4), 507-514.