Can we trust ESG Ratings? Some insights based on a bibliometric analysis of ESG data quality and rating reliability

Titolo Rivista MANAGEMENT CONTROL
Autori/Curatori Paola Demartini, Claudia Pagliei
Anno di pubblicazione 2023 Fascicolo 2023/2 Suppl.
Lingua Inglese Numero pagine 27 P. 161-187 Dimensione file 341 KB
DOI 10.3280/MACO2023-002-S1008
Il DOI è il codice a barre della proprietà intellettuale: per saperne di più clicca qui

Anteprima articolo

FrancoAngeli è membro della Publishers International Linking Association, Inc (PILA)associazione indipendente e non profit per facilitare (attraverso i servizi tecnologici implementati da CrossRef.org) l’accesso degli studiosi ai contenuti digitali nelle pubblicazioni professionali e scientifiche

The aim of this research is to investigate the quality and reliability of ESG data provided by companies, as well as the accuracy and objectivity of ESG ratings produced by sustainability rating agencies (SRAs). Since SRAs use companies’ non-financial information as input data when formulating their ESG ratings, these two topics appear to be strictly interconnected. Drawing on the Shanon and Weaver (1949) model of communication, we have addressed these issues by means of a systematic literature review combined with a bibliometric analysis. In our investigation we run: i) the co-citation analysis to de-tect the seminal papers; ii) a keyword co-occurrence analysis to explore how the main features of the academic debate have unfolded in the last five years; iii) a keyword co-occurrence analysis to obtain a network visualisation map to explore how the research broad scope was articulated in different clusters (i.e., themes of research). Among the clusters that emerged from the mapping, we have decided to delve into the streams of research we consider most relevant and deal with: the re-lationships between ESG and Artificial Intelligence (AI). Namely, we deem that AI may allow us to process massive amounts of data that contain crucial information for ESG investing. However, even if computer algorithms are able to analyse all information available efficiently, and in a timely manner, managers and investors should be aware of their opportunities and criticisms, while scholars should list propositions for advancing the research on these topics.

Keywords:ESG ratings, Data quality, Theory of communication, Artificial Intelli-gence, Bibliometric analysis

  1. Al-Fedaghi S. (2012), A conceptual foundation for the Shannon-Weaver model of communication, International Journal of Soft Computing, 7(1), pp. 12-19.
  2. Al-Shaer H., Zaman M. (2018), Credibility of sustainability reports: the contribution of Audit Committees, Business Strategy and the Environment, 27, pp. 73-986.
  3. Alshehhi A., Nobanee H., Khare N. (2018), The impact of sustainability practices on corporate financial performance: Literature trends and future research potential, Sustainability, 10(2), 494.
  4. Amel-Zadeh A., Serafeim G. (2018), Why and how investors use ESG information: Evidence from a global survey, Financial Analysts Journal, 74(3), pp. 87-103.
  5. Aouadi A., Marsat S. (2018), Do ESG controversies matter for firm value? Evidence from international data, Journal of Business Ethics, 151, pp. 1027-1047.
  6. Arribas I., Espinós-Vañó M. D., Garcia, F., Riley, N. (2021), Do irresponsible corporate activities prevent membership in sustainable stock indices? The case of the Dow Jones Sustainability Index world, Journal of Cleaner Production, 298, 126711.
  7. Arvidsson S., Dumay J. (2022), Corporate ESG reporting quantity, quality and performance: Where to now for environmental policy and practice?, Business Strategy and the Environment, 31(3), pp. 1091-1110.
  8. Avramov D., Cheng S., Lioui A., Tarelli A. (2022), Sustainable investing with ESG rating uncertainty, Journal of Financial Economics, 145(2), pp. 642-664.
  9. Bala G., Bartel H., Hawley J. P., Lee Y.J. (2015), Tracking real-time corporate sustainability signals using cognitive computing, Journal of Applied Corporate Finance, pp. 27-95.
  10. Barman E. (2018), Doing Well by doing Good: A comparative Analysis of ESG Standards for Responsible Investment, Sustainability, Stakeholder Governance, and Corporate Social Responsibility, 38, pp. 289-311. DOI: 10.1108/S0742-332220180000038016
  11. Beck R., Müller-Bloch C., King J.L. (2018), Governance in the Blockchain Economy: A Framework and Research Agenda, Journal of the Association for Information Systems, 19, pp. 1020-1034.
  12. Berg F., Fabisik K., Sautner Z. (2020), Rewriting history II: The (un) predictable past of ESG ratings, European Corporate Governance Institute – Finance Working Paper, 708, 10-2139.
  13. Bernardi C., Demartini P. (2019), Building Sustainable Intellectual Capital: insight from a company included in the Dow Jones Sustainability Index, In Chiucchi S. and Demartini P. (Eds), Qualitative research in Intangibles, Intellectual Capital and Integrated Reporting practices, Series Corporate governance e scenari di settore delle imprese, Roma Tre Press p. 97. DOI: 10.13134/978-88-32136-21-0/10
  14. Berthelot S., Coulmont M., Serret V. (2012), Do investors value sustainability reports? A Canadian study, Corporate Social Responsibility and Environmental Management, 19(6), pp. 355-363.
  15. Billio M., Costola M., Hristova I., Latino C., Pelizzon L. (2021), Inside the ESG Ratings:(Dis) agreement and performance, Corporate Social Responsibility and Environmental Management, 28(5), pp. 1426-1445.
  16. Boiral O., Talbot D., Brotherton M. C., Heras-Saizarbitoria I. (2021). Sustainability rating and moral fictionalism: opening the black box of nonfinancial agencies, Accounting Auditing & Accountability Journal, 34, pp.1740-1768. DOI: 10.1108/AAAJ-12-2019-4356
  17. Centorrino G., Naciti V., Rupo D. (2022), From double-entry bookkeeping and ledger to blockchain technology: New frontiers for accounting information systems, Management Control, special issue 2, pp. 15-41. DOI: 10.3280/MACO2022-002-S1002
  18. Cerchiaro D., Leo S., Landriault E., De Vega P. (2021), DLT to boost Efficiency for Financial Intermediaries. An Application in ESG Reporting Activities, Technology Analysis & Strategic Management, pp. 1-14. DOI: 10.1080/09537325.2021.1999921
  19. Chandler D. (1994), The transmission model of communication. -- URL: http://www. aber. ac. uk/media/Documents/short/trans.Htm.
  20. Chatterji A.K., Durand R., Levine D., Touboul S. (2016), Do Ratings of Firms converge? Implications for Managers, Investors, and Strategy Researchers, Strategic Management Journal, 37, pp. 1597-1614.
  21. Cho C.H., Bohr K., Choi T.J., Partridge K., Shah J.M., Swierszcz A. (2020), Advancing Sustainability Reporting in Canada: 2019 Report on Progress, Accounting Perspectives, 19, pp. 181-204. DOI: 10.1111/1911-3838.12232
  22. Clarkson P., Li Y., Richardson G., Tsang A. (2019), Causes and consequences of voluntary assurance of CSR reports: International evidence involving Dow Jones Sustainability Index Inclusion and firm valuation, Accounting, Auditing & Accountability Journal, 32(8), pp. 2451-2474. DOI: 10.1108/AAAJ-03-2018-3424
  23. Cornelius I. (2002), Theorizing information for information science, Annual review of information science and technology, 36(1), pp. 392-425.
  24. Cruz C.A., Matos F. (2023), ESG maturity: A software framework for the challenges of ESG data in investment. Sustainability, 15(3), 2610.
  25. Cucari N., Esposito de Falco S., Orlando B. (2018), Diversity of board of directors and environmental social governance: Evidence from Italian listed companies, Corporate Social Responsibility and Environmental Management, 25(3), pp. 250-266.
  26. De Villiers C. (2017), Stakeholder requirements for sustainability reporting, In Sustainability accounting and integrated reporting, pp. 57-63, Routledge. DOI: 10.4324/9781315108032-6
  27. Demartini P. (2021), Sul contributo dei Big Data al processo decisionale del Board, In Mancini D., D’Onza G., Caserio C., Scritti in onore di Luciano Marchi, vol. 2, Torino, Giappichelli.
  28. Demartini P. (ed.) (2004), Informazione, imprese e mercati finanziari efficienti: spunti di riflessione in una prospettiva multidisciplinare, Milano, FrancoAngeli.
  29. Demartini P., De Mauro A (2020), The impact of Big Data on board level decision making, Proceedings of the IFKAD 2020: Knowledge in Digital Age, pp. 1712-1722.
  30. Dhaliwal D.S., Li O.Z., Tsang A., Yang Y.G. (2011), Voluntary nonfinancial disclosure and the cost of equity capital: The initiation of corporate social responsibility reporting, The accounting review, 86(1), pp. 59-100.
  31. Dimson E., Marsh P., Staunton M. (2020), Divergent ESG ratings, The Journal of Portfolio Management, 47(1), pp.75-87.
  32. Donthu N., Kumar S., Mukherjee D., Pandey N., Lim W. M. (2021), How to conduct a bibliometric analysis: An overview and guidelines, Journal of Business Research, 133, pp. 285-296.
  33. Dorfleitner G., Kreuzer C., Sparrer C. (2020), ESG Controversies and Controversial ESG: About silent Saints and small Sinners, Journal of Asset Management, 21, pp. 393-412.
  34. Dorfleitner G., Utz S., Wimmer M. (2018), Patience pays off - Corporate Social Responsibility and long-term Stock Returns, Journal of Sustainable Finance & Investment, 8, pp. 132-157. DOI: 10.1080/20430795.2017.1403272
  35. Dumay J., Bernardi C., Guthrie J., Demartini P. (2016), Integrated reporting: A structured literature review, Accounting forum, 40(3), pp.166-185).
  36. Durand R., Paugam L., Stolowy H. (2019), Do investors actually value sustainability indices? Replication, development, and new evidence on CSR visibility, Strategic Management Journal, 40(9), pp. 1471-1490.
  37. Eccles R.G., Klimenko S. (2019), The investor revolution, Harvard Business Review, 97(3), pp. 106-116.
  38. El Ghoul S., Guedhami O., Kwok C.C.Y., Mishra D. (2011), Does Corporate Social Responsibility affect the cost of capital?, Journal of Banking & Finance, 35, pp. 2388-2406.
  39. Escrig-Olmedo E., Fernández-Izquierdo M.Á., Ferrero-Ferrero I., Rivera-Lirio J.M., Muñoz-Torres M.J. (2019), Rating the raters: Evaluating how ESG rating agencies integrate sustainability principles, Sustainability, 11(3), 915.
  40. Escrig-Olmedo E., Muñoz-Torres M.J., Fernández-Izquierdo M.A., Rivera-Lirio J. M. (2014), Lights and shadows on sustainability rating scoring, Review of Managerial Science, 8, pp. 559-574.
  41. Fiske J. (2011), Introduction to Communication Studies, Routledge, 3rd Edition. DOI: 10.4324/9780203837382
  42. Friede G. (2019), Why don’t we see more Action? A Metasynthesis of the investor impediments to integrate environmental, social, and governance factors, Business Strategy and the Environment, 28, pp. 1260-82.
  43. Friede G., Busch T., Bassen A. (2015), ESG and financial performance: aggregated evidence from more than 2000 empirical studies, Journal of Sustainable Finance & Investment, 5(4), pp. 210-233. DOI: 10.1080/20430795.2015.1118917
  44. Galeotti M., Lombardi R., Paoloni P., Roberto F. (2022), Big data and sustainability reports: The current approach to non-accounting data management, Management Control, special issue 2, pp. 95-116. DOI: 10.3280/MACO2022-002-S1005
  45. García‐Sánchez I.M., Hussain N., Khan S.A., Martínez‐Ferrero J. (2022), Assurance of corporate social responsibility reports: Examining the role of internal and external corporate governance mechanisms, Corporate Social Responsibility and Environmental Management, 29(1), pp. 89-106.
  46. Glaser F. (2017), Pervasive decentralisation of digital infrastructures: A framework for blockchain enabled system and use case analysis, Paper Presented at the 50th Hawaii International Conference on System Sciences, Waikoloa, Hawaii, USA. DOI: 10.24251/HICSS.2017.186
  47. Haller A., Van Staden C.J., Landis C. (2018), Value added as part of sustainability reporting: Reporting on distributional fairness or obfuscation?, Journal of Business Ethics, 152, pp. 763-781.
  48. Hawn O., Chatterji A.K., Mitchell W. (2018), Do investors actually value sustainability? New evidence from investor reactions to the Dow Jones Sustainability Index (DJSI), Strategic Management Journal, 39(4), pp. 949-976.
  49. Hawn O., Chatterji A., Mitchell W. (2011), Two coins in one purse? How market legitimacy affects the financial impact of changes in social legitimacy: Addition and deletion by the Dow Jones Sustainability Index. Duke University.
  50. Hollnagel E., Woods D.D. (2005), Joint cognitive systems: Foundations of cognitive systems engineering, CRC press. DOI: 10.1201/9781420038194
  51. Hughes A., Urban M.A., Wójcik D. (2021), Alternative ESG ratings: How technological innovation is reshaping sustainable investment, Sustainability, 13.
  52. In S.Y., Rook D., Monk A. (2019), Integrating alternative data (also known as ESG data) in investment decision making, Global Economic Review, 48(3), pp. 237-260. DOI: 10.1080/1226508X.2019.1643059
  53. Ioannou I., Serafeim G. (2015), The impact of corporate social responsibility on investment recommendations: Analysts’ perceptions and shifting institutional logics, Strategic Management Journal, 36(7), pp. 1053-1081.
  54. Ji L., Liu C., Huang L., Huang G. (2018), The evolution of resources conservation and recycling over the past 30 years: A bibliometric overview, Resources, Conservation and Recycling, 134, pp. 34-43.
  55. Kotsantonis S., Pinney C., Serafeim G. (2016), ESG integration in investment management: Myths and realities, Journal of Applied Corporate Finance, 28(2), pp. 10-16.
  56. Krasodomska J., Zarzycka E. (2019),The new Regulatory Framework and Non-Financial Kpis Disclosure: Is there any Room for Improvement in the Corporate Practice?, Vision 2025: Education Excellence and Management of Innovations through Sustainable Economic Competitive Advantage, pp. 9330-37.
  57. Krippendorff K. (2009). Mathematical theory of communication. Departmental Papers (ASC), 169.
  58. Krueger P., Sautner Z., Tang D.Y., Zhong R. (2021), The effects of mandatory ESG disclosure around the world, European Corporate Governance Institute – Finance Working Paper, (754), pp. 21-44.
  59. Landi G., Sciarelli M. (2019), Towards a more ethical Market: The Impact of ESG Rating on Corporate Financial Performance, Social Responsibility Journal, 15, pp. 11-27. DOI: 10.1108/SRJ-11-2017-0254
  60. Lin J.L., Hou T.C.T., Hsiao Y.L. (2019), Introduction to the special issue of Big Data analytics: Using financial and non-financial information, Asia Pacific Management Review, 24.
  61. López M. V., Garcia A., Rodriguez L. (2007), Sustainable development and corporate performance: A study based on the Dow Jones sustainability index, Journal of business ethics, 75, pp. 285-300.
  62. Macmahon S. (2020), The challenge of rating ESG performance, Harvard Business Review, 98, pp. 52-54.
  63. Magness V. (2010), Environmental disclosure in the mining industry: A signaling paradox?, Advances in Environmental Accounting and Management, 4, pp. 55-81. DOI: 10.1108/S1479-3598(2010)0000004006
  64. Massaro M., Dumay J., Guthrie J. (2016), On the shoulders of giants: undertaking a structured literature review in accounting, Accounting, Auditing & Accountability Journal, 29(5), pp. 767-801. DOI: 10.1108/AAAJ-01-2015-1939
  65. Munoz-Torres M.J., Fernandez-Izquierdo M.A., Rivera-Lirio J.M., Escrig-Olmedo E. (2019), Can Environmental, Social, and Governance Rating Agencies favor Business Models that promote a more Sustainable Development?, Corporate Social Responsibility and Environmental Management, 26, pp. 439-452.
  66. Musleh Al-Sartawi M.A.M., Hussainey K., Razzaque A. (2022), The Role of Artificial Intelligence in Sustainable Finance, Journal of Sustainable Finance & Investment, pp. 1-6. DOI: 10.1080/20430795.2022.2057405
  67. Petticrew M., Roberts H. (2008), Systematic reviews in the Social Sciences: A practical guide, John Wiley & Sons. DOI: 10.1002/9780470754887
  68. Pickering C., Byrne J. (2014), The benefits of publishing systematic quantitative literature reviews for PhD candidates and other early-career researchers, Higher Education Research and Development, 33(3), pp. 534-548. DOI: 10.1080/07294360.2013.841651
  69. Popelkova V. (2018), Non-Financial Information according to the Act on Accounting in Czech Republic. European Financial Systems: Proceedings of the 15th International Scientific Conference, pp. 543-549.
  70. Post R., Smit K., Zoet M. (2018), Identifying factors affecting blockchain technology diffusion, Twenty-Fourth Americas Conference on Information Systems, pp. 1-10.
  71. Pozzoli M., Pagani A., Paolone F. (2022), The impact of audit committee characteristics on ESG performance in the European Union member states: Empirical evidence before and during the COVID-19 pandemic, Journal of Cleaner Production, 371, 133411.
  72. Quick R., Inwinkl P. (2020), Assurance on CSR reports: impact on the credibility perceptions of non-financial information by bank directors, Meditari Accountancy Research, 28(5), pp. 833-862. DOI: 10.1108/MEDAR-10-2019-0597
  73. Rezaee Z., Tuo L. (2019), Are the quantity and quality of sustainability disclosures associated with the innate and discretionary earnings quality?, Journal of Business Ethics, 155, pp. 763-786.
  74. Richards I.A. (1955), Speculative Instruments, University of Chicago Press.
  75. Robinson M., Kleffner A., Bertels S. (2011), Signaling sustainability leadership: Empirical evidence of the value of DJSI membership. Journal of business ethics, 101(3), pp. 493-505.
  76. Saad A. I., Strauss D. (2020), A new “Reasonable Investor” and changing frontiers of materiality: Increasing investor reliance on ESG disclosures and implications for securities litigation, Berkeley Bus. LJ, 17, 391.
  77. Sahin Ö., Bax K., Paterlini S., Czado C. (2023), The pitfalls of (non-definitive) Environmental, Social, and Governance scoring methodology, Global Finance Journal, 56, 100780.
  78. Schram W. (ed.) (1954), The process and effects of mass communication, University of Illinois Press.
  79. Schüler T., Arp A.K., Kirschner C., Please D.A. (2018), External assurance and decision usefulness of sustainability reports, 2018 BASIQ International Conference: New Trends in Sustainable Business and Consumption, pp. 131-139.
  80. Searcy C., Elkhawas D. (2012), Corporate sustainability ratings: an investigation into how corporations use the Dow Jones Sustainability Index, Journal of Cleaner Production, 35, pp. 79-92.
  81. Serafeim G., Yoon A. (2022), Stock Price Reactions to ESG News: The Role of ESG Ratings and Disagreement, Review of Accounting Studies, pp. 1-31.
  82. Sharma U., Gupta A., Gupta S.K. (2022), The Pertinence of incorporating ESG ratings to make investment decisions: A quantitative analysis using machine learning, Journal of Sustainable Finance & Investment, pp. 1-15. DOI: 10.1080/20430795.2021.2013151
  83. She C., Michelon G. (2019), Managing stakeholder perceptions: Organized hypocrisy in CSR disclosures on Facebook, Critical Perspectives on Accounting, 61, pp. 54-76.
  84. Skapa S., Bockova N., Doubravsky K., Dohnal M. (2022), Fuzzy confrontations of models of ESG investing versus non-ESG investing based on Artificial Intelligence Algorithms, Journal of Sustainable Finance & Investment, 13(1), pp. 763-775. DOI: 10.1080/20430795.2022.2030666
  85. Snyder H. (2019), Literature review as a research methodology: An overview and guidelines, Journal of Business Research, 104, pp. 333-39.
  86. Stubbs W., Rogers P. (2013), Lifting the veil on Environment-Social-Governance rating methods, Social Responsibility Journal, 9, pp. 622-640. DOI: 10.1108/SRJ-03-2012-0035
  87. Tranfield D., Denyer D., Smart P. (2003), Towards a methodology for developing evidence-informed management knowledge by means of systematic review, British Journal of Management, 14(3), pp. 207-222. DOI: 10.1111/1467-8551.00375
  88. Tsang A., Frost T., Cao H. (2023), Environmental, Social, and Governance (ESG) disclosure: A literature review, The British Accounting Review, 55(1), 101149.
  89. Utz S. (2019), Corporate scandals and the reliability of ESG assessments: Evidence from an international sample, Review of Managerial Science, 13, pp. 483-511.
  90. Van Eck N.J., Waltman L. (2010), Software survey: VOSviewer, a computer program for bibliometric mapping, Scientometrics, 84, pp. 523-538.
  91. Velte P. (2020), Determinants and consequences of corporate social responsibility assurance: A systematic review of archival research, Society and Business Review. DOI: 10.1108/SBR-05-2020-0077
  92. Wallin J.A. (2005), Bibliometric methods: pitfalls and possibilities, Basic & clinical pharmacology & toxicology, 97(5), pp. 261-275.
  93. Wang N., Pan H., Feng Y., Du S. (2023), How do ESG practices create value for businesses? Research review and prospects, Sustainability Accounting, Management and Policy Journal. DOI: 10.1108/SAMPJ-12-2021-0515
  94. Willis A. (2003), The role of the global reporting initiative's sustainability reporting guidelines in the social screening of investments, Journal of Business Ethics, 43(3), pp. 233-237. DOI: 10.1023/A:1022958618391
  95. Windolph S.E. (2011), Assessing Corporate Sustainability through ratings: Challenges and their causes, Journal of Environmental Sustainability, 1, pp. 37-57.

Paola Demartini, Claudia Pagliei, Can we trust ESG Ratings? Some insights based on a bibliometric analysis of ESG data quality and rating reliability in "MANAGEMENT CONTROL" 2 Suppl./2023, pp 161-187, DOI: 10.3280/MACO2023-002-S1008