Juanita Smit, Senior Specialist & Supervisory Framework at Financial Section Conduct Authority (FSCA) in South Africa, was invited to share her experience at Cerise+SPTF's 2024 Annual Meeting. The discussions with Juanita explored how to track and utilize outcomes data to strengthen regulations for responsible and inclusive finance.
We've asked 5 questions on the value of outcomes data for regulators. Juanita has shared valuable insights on the role of regulators.
Below you can watch the video and read the summary transcript of the discussion.
Question 1: Why, as a regulator, do you want to collect outcome data on customers, and what's the entry point for you on this journey?
For FSCA, the first point is to meet our mandate in South Africa. Our mandate has different strategic objectives, but the first one is ensuring fair outcomes for customers. Outcome data helps us measure and test whether fair outcomes are being achieved for customers. It also contributes to financial stability in the industry.
You can talk the talk, but data helps us see if companies are truly walking the walk. Everyone claims to be customer-centric, but data does not lie. The data helps us determine if outcomes are fair and, if not, why not. This allows us to engage with entities, identify gaps in understanding, and ensure fair treatment early on.
Outcome data also helps us detect harmful products, identify potential customer education gaps, and determine whether interventions are needed at an industry level or for specific target markets.
In our discussions with entities—including FSPs, banks, and pension funds—the data serves as a concrete foundation. Instead of vague discussions, we can show specific data insights and explain why we reach certain conclusions. This has proven beneficial for entities as well.
For example, we worked with one entity that believed complaints about service were due to third-party providers. After analyzing various data sources, including social media, we found that the complaints were actually about the entity’s internal service department. The company was losing customers without understanding why. This insight allowed them to address the real issue effectively.
So, collecting outcome data is definitely about protecting customers and ensuring fair outcomes. That’s the short answer. We’ll continue the discussion on the next steps, but that’s an important point to highlight.
Question 2: What method do you use to collect information, and where do you stand in the process? Who collects the information, and how do you obtain customer data?
For FSPs, we collect financial statements, irregularity reports, AML (Anti-Money Laundering) reports, and CFT (Counter Financing of Terrorism) reports. In the past, we also collected compliance reports, which required entities to confirm their adherence to regulations. However, we realized this approach was too rule-based and functioned more like a tick-box exercise.
Because of this, we stopped compliance reports and instead developed the Conduct of Business Returns (CBR). Initially, this was rolled out to the insurance industry in 2017. The first phase focused on quantitative questions, allowing for quick analysis on a quarterly basis. This enabled us to track trends and engage with entities more effectively.
Two years ago, we expanded the Conduct of Business Returns across multiple sectors, including insurance, banks, pension funds, asset managers, smaller FSPs, etc. This broader approach allows us to compare trends across industries.
We published the first version of the Conduct of Business Returns last year, received industry feedback, and are now refining the second version. This will undergo further consultation and a pilot phase.
We are also changing the submission process to ensure faster data utilization. Larger entities will submit data via XML, while smaller entities will log into our website to submit their reports. The goal is to have a centralized database.
We originally aimed to start reporting this year, but due to the complexity of the process, we now anticipate implementation by the end of 2025. This shift requires industry collaboration, as it represents a major change—akin to moving the Titanic.
At the same time, we are reviewing other reports we collect to eliminate redundancy and ensure efficiency.
Question 3: What are the main challenges you face in this process?
The first challenge is securing industry buy-in. While entities already have the necessary data, they may not have it in the required format or level of detail. Larger entities typically have the data but need to adapt their systems, while smaller FSPs may lack the necessary technology or awareness of the data’s benefits.
We must clearly communicate why we need the data, how we will use it, and what entities can gain from it. This process can be costly for both regulators and industry players. To address this, we are investing in new systems and collaborating with other regulators to avoid redundant information requests.
The second challenge is data quality. Even after seven years of implementation in the insurance sector, we still face issues with data completeness and accuracy. Initially, we allowed a three-year grace period where entities could submit their best efforts to help them adapt. However, improving data quality remains a long-term effort.
Another challenge is capacity—both on the industry side and within the regulator. On our side, we need skilled analysts who can interpret data effectively and facilitate meaningful discussions with entities. Trust-building is also crucial, as entities need to believe in the fairness and purpose of the process.
Overall, it’s a long journey requiring continuous improvement in risk management and data utilization.
Question 4: What advice would you give to regulators and financial service providers who are starting this journey?
I hope we are inspiring others because there is a lot of value in this process for everyone.
One key lesson from our insurance industry experience is the importance of clear, transparent, and collaborative communication with the industry from the start.
With the Omni CBR, before requesting feedback, we conducted webinars for different sectors, explaining each question and its purpose. This built trust and ensured entities understood our goals. Many entities then proactively engaged with us to clarify questions before submitting formal comments.
Despite this, we still received pushback, which is expected. This is a costly initiative, and regulators must be patient, allowing for multiple rounds of consultation and phased implementation. However, clear deadlines are necessary to maintain progress.
Industry players should avoid outright resistance. Instead of rejecting changes due to cost or complexity, they should actively participate in shaping the process. Regulators and industry are partners—this effort benefits both sides. Industry is always ahead of regulators in innovation, so collaborating helps regulators keep pace.
A key benefit of this process is creating a level playing field and improving consumer trust in financial services. Consumers need to see that real work is being done to ensure fair outcomes.
For regulators:
- Communicate openly and transparently from the start.
- Be open to industry feedback—sometimes we ask for information inefficiently, and industry can suggest better ways.
For industry:
- Engage with regulators proactively rather than resisting change.
- Recognize that regulatory oversight benefits the entire market and contributes to consumer confidence.
This must be a collaborative effort.
Question 5: If you had to choose one key indicator or type of data that you find most useful, what would it be?
That’s a tough question because I like many indicators!
One important aspect is that complaints data alone is not enough. While we collect complaints and customer survey data, we also focus on indicators that reveal corporate culture.
For example, beyond just tracking complaints, we ask:
- How long does it take to resolve a complaint?
- What is the customer experience like for payments, refunds, or fund transfers?
- How quickly does an entity execute customer instructions?
These turnaround time metrics allow for benchmarking across the industry. Entities often ask, “If this isn’t acceptable, what is the industry standard?” With this data, we can provide accurate benchmarking insights.
This is crucial for industry self-assessment and improving customer experience. I could talk about this all day, but I’ll stick with turnaround time indicators as my top choice!
Background:
In 2022, FSCA was developing a consumer advisory panel to ensure that its work formally takes into account consumer views and experiences. The new panel will also alert FSCA to emerging risks and trends facing financial customers. CGAP has supported this effort by facilitating the use of two tools that have been helpful in getting started: mentoring relationships and a stakeholder analysis.
Mentoring relationships: CGAP facilitated a partnership between the FSCA and the UK Financial Conduct Authority (FCA) and their Financial Services Consumer Panel (FSCP). The FCA and FSCP bring a wealth of knowledge and experience to FSCA’s deliberations. It is important to note that this pairing was not for the purpose of transplanting the UK model to South Africa, but rather for FSCP/FCA to be a sounding board to respond to questions and brainstorm options with FSCA counterparts.
Stakeholder analysis: CGAP supported a stakeholder analysis conducted by Cenfri to help FSCA better understand the consumer landscape and relative influence, interest, and capacity of different consumer groups. While formal stakeholder analysis may not be needed in every case (especially for smaller EMDEs), it may be worthwhile in jurisdictions where the landscape is complex or unfamiliar.
More resources:
- FSCA Subscription Page
- CGAP's reading deck summarizing lessons from a pilot exercise that involved the Financial Sector Conduct Authority (FSCA) and five FSPs in South Africa focused on measuring intermediate customer outcomes from a supervisory perspective.
- CGAP 2022 paper on Consumer Advisory Panels: a tool to elevate the collective consumer voice in financial sector regulation and supervision.
Join thousands of users on SPI Online
Powerful evaluation tools to turn intentions into impact.