Advanced Business

Intelligence Solution – a Case Study

 

Overview

Working together for over two years, CoreValue and the client developed an advanced, comprehensive Business Intelligence solution with complex architecture.

Status of Engagement 2016 − ongoing
Team involved 6 people
Technologies Amazon Redshift, Talend, AWS Postgre RDS, Tableau, MySQL, S3, Web services, Python

Client Description

The client is the world’s leading on-demand micro-insurance technology company.

Challenge

As a fast-growing start-up, our client needed a reporting solution to help them make faster business decisions, while monitoring growth and sharing pertinent information/stats with appropriate management groups and partners. As the client operates in several countries, all data across focused markets had been separate.

CoreValue’s Role and Solution

The project goal was to gather all data from various sources, including those broken down by country, into one solution. Working together for over two years, CoreValue and the client developed an advanced, comprehensive Business Intelligence solution with complex architecture.

As the first step, we designed and built a data warehouse using the services of Amazon Redshift. The data warehouse was designed by using Kimball’s approach, and consists of data marts for specific business areas such as Executives and Marketing.

The solution included ETL process development using a leading open-source tool, Talend. The ETL process was designed in a way to support Redshift’s micro batch loading architecture. It is hosted on an Amazon EC2 Linux machine and is managed by a custom solution that gives us flexibility in jobs scheduling, execution and maintenance.

All of this established a stable foundation for data pre-processing that resulted in better data use by the reporting tool. The BI solution enriched and pre-processed data from multiple sources including MySQL, CSVs, iTunes, Google Play, Facebook Ads, Google AdWords, and various other web services.

In order to build an effective data visualization solution for the client’s team, we opted for Tableau BI and analytic software. We used both Desktop for creating dashboards, and Server for hosting and viewing dashboards. In order to improve the UX, a separate custom web page on Amazon was built. The page replicates all the dashboards set up in Tableau which improved user experience. A user can now easily go through the all-in-one-place reporting environment with advanced filter and row-level security functionalities, to name a few.

Featured Success Stories
Featured Success Stories
Featured Success Stories
Featured Success Stories
Featured Success Stories
Featured Success Stories

What’s inside

At the moment, there are ten main comprehensive dashboards with multiple metrics, graphs and diagrams, and daily reports that land in a user’s inbox. Product performance, event funneling, marketing and cohort analysis are some of the dashboards from the list. Daily reports send fresh data at specific times for specific user groups; there is a list of metrics for the specific time frames – “yesterday” and “90 days” are included in the daily reports.

For advanced searching and filtering, we built custom JavaScript functionality that enables data filtering for all dashboards simultaneously. A user no longer needs to set up a specific filter for every dashboard in which they are interested. These main filters include Country and Date range, but there is also an abundance of individual filters for every single dashboard.

What’s next

We continue working on additional data sources for analysis. We do expect to extend collaboration with the client that will include machine learning practices and other data science algorithms in order to provide deep insights on customer data for continuing business success.

 

Are you wondering what distinguishes CoreValue from other providers? We are unique because all of our resources are top quality and focused on excellent service delivery. CoreValue will always deliver secure technological infrastructures and processes that will support new technology initiatives, so that clients like M3 can better serve their consumers.