As AI takes on a bigger share of decision-making, an important question arises: Who answers when the model gets it wrong? The answer, however, remains the same. It is an institution, not an algorithm. Algorithms can support decisions, but responsibility cannot be handed off to them. Banks therefore need governance structures with clear ownership, oversight and escalation for AI-enabled decisions.
As decisions move from AI-assisted to AI-influenced and, in some cases, AI-initiated, governance will need to keep pace. Some questions become important here. Can a critical decision be explained and challenged? Can bias be detected before it harms a customer, not after? Who is accountable when an automated outcome is incorrect? Regulators are likely to ask similar questions.
India has already taken significant steps in this direction. The Reserve Bank of India recently introduced the Framework for Responsible and Ethical Enablement of Artificial Intelligence (FREE-AI) for the financial sector, which is based on seven principles: Trust, People First, Innovation, Fairness, Accountability, Explainability and Safety & Sustainability. The framework helps ensure that innovation and risk management go hand in hand, enabling financial institutions to adopt AI more responsibly and sustainably.
The board also has an important role as AI moves from the experimentation stage to wider deployment. The report titled “AI Governance Principles for Boards”, published by KPMG International and the INSEAD Corporate Governance Centre, argues that boards must look beyond traditional oversight and play a more active role in AI transformation. This includes aligning AI initiatives with long-term value creation, robust data and technology governance, and clear accountability. Boards will need to address immediate AI-related risks while also considering the longer-term transformation AI is likely to bring.