Reinventing mobile banking with machine learning

Industry

Technology

Data Science Delta Lake ETL Lakehouse Machine Learning SQL

Introduction

Automating processes and increased data processing from 6 hours to 6 seconds for complex analytics.

About the client

As one of the largest international banks is ushering in a new way to manage digital payments across mobile devices. They developed PayMe, a social app that facilitates cashless transactions between consumers and their networks instantly and securely. With over 39 million customers, the organisation struggled to overcome scalability limitations that blocked them from making data-driven decisions. With NashTech, they are able to scale data analytics and machine learning to feed customer-centric use cases including personalisation, recommendations, network science, and fraud detection.

Impact

170+ PBs of data in data centres across 21 countries
6 Seconds to perform complex analytics compared to 6 hours
1 Delta Lake has replaced 14 databases
4.5x Improvement in engagement on the app

Challenges

The organization understands the massive opportunity for them to better serve their 39+ million customers through data and analytics. Seeing an opportunity to reinvent mobile payments, they developed PayMe, a social payments app. Since its launch in its home market of Hong Kong, they have become the #1 app in the region amassing 1.8+ million users.

In an effort to provide their fast-growing customer base with the best possible mobile payments experience, they looked to data and machine learning to enable various desired use cases such as detecting fraudulent activity, customer 360 to inform marketing decisions, personalisation, and more. However, building models that could deliver on these use cases in a secure, fast and scalable manner was easier said than done.

Slow data pipelines resulted in old data: Legacy systems hampered their ability to process and analyse data at scale. They were required to manually export and sample data, which was time-consuming. This resulted in the data being weeks old upon delivery to the data science team which blocked their ability to be predictive.
Manual data exporting and masking: Legacy processes required a manual approval form to be filled out for every error-prone data request. Furthermore, the manual masking process was time-consuming and did not adhere to strict data quality and protection rules.
Inefficient data science: Data scientists worked in silos on their machines and custom environments, limiting their ability to explore raw data and train models at scale. As a result, collaboration was poor, and model iteration was very slow.
Data analysts struggled to leverage data: Needing access to subsets of structured data for business intelligence and reporting.

Solution

Through the use of NLP and machine learning, the organisation is able to quickly understand the intent behind each transaction within their PayMe app. This wide range of information is then used to inform various use cases from recommendations to customers to reducing anomalous activity.

With Azure NashTech, they are able to unify data analytics across data engineering, data science, and analysts.

Improved operational efficiency: features such as auto-scaling clusters and support for Delta Lake has improved operations from data ingestion to managing the entire machine learning lifecycle.
Real-time data masking with delta lake: With NashTech and Delta Lake, the organisation was able to securely provide anonymised production data in real-time to data science and data analyst teams.
Performant and scalable data pipelines with Delta Lake have enabled them to perform real-time data processing for downstream analytics and machine learning.
Collaboration across data science and engineering: Enables faster data discovery, iterative feature engineering, and rapid model development and training.

Results

Richer insights lead to the #1 app

NashTech provides the organisation with a unified data analytics platform that centralises all aspects of their analytics process from data engineering to the productionisation of ML models that deliver richer business insights.

Faster data pipelines: Automating processes and increased data processing from 6 hours to 6 seconds for complex analytics.
Descriptive to predictive: Ability to train models against their entire dataset, has empowered them to deploy predictive models to feed various use cases.
From 14 databases to 1 Delta Lake: Moved from 14 read replica databases to a single unified data store with Delta Lake.
PayMe is #1 app in Hong Kong: 60% market share of the Hong Kong market making PayMe the #1 app.
Improved consumer engagement: Ability to leverage network science to understand customer connections has resulted in a 4.5x improvement in engagement levels with the PayMe app.

“We’ve seen major improvements in the speed we have data available for analysis. We have a number of jobs that used to take 6 hours and now take only 6 seconds.”
Chief Architect