Delivered 20% Cost Savings and better usage analysis for MetaMap by Migrating to AWS

About Customer

MetaMap is a customer identity platform that offers identity verification solutions for businesses, including user onboarding, KYC, and AI/ML capabilities. Serving over 500+ customers across Latin America, Africa, and Asia, MetaMap enables businesses to create customized verification flows tailored to their specific onboarding, compliance, and verification needs.

‍

Business Problem/ Challenge

MetaMap was operating an analytics platform that scanned approximately 1200TB of data monthly, powering over 30 dashboards. This setup faced significant challenges, including escalating costs and difficulty in managing and scaling different workloads independently, leading to unpredictable and spiking expenses. To address these issues, ShellKode proposed migrating MetaMap's analytics platform to Amazon Redshift for greater flexibility and cost optimization. Despite the complexity of the migration, involving 80+ analytics models each with 700-800 lines of SQL containing multiple subqueries, aggregations, and window functions, ShellKode provided a detailed roadmap aimed to control costs while delivering an improved customer experience.

‍

Solution

ShellKode has helped migrate MetaMap’s cloud and data infrastructure to AWS. Leveraging the configuration details shared by the MetaMap team, ShellKode provided equivalent services within AWS ensuring a smooth transition and continued functionality for users. ShellKode has also helped optimize data infrastructure and build a scalable, optimized, and secure data platform in AWS. This migration has resulted in increased scalability and a more robust platform for MetaMap’s applications.

This migration aimed to reduce overall costs while ensuring a secure process with minimal disruption, achieving minimal to zero downtime for all data and cloud application services.

• Conducted POCs to evaluate the right sizing of resources to be deployed in AWS like Amazon Redshift
• Migrated historical data from their current cloud infrastructure to AWS S3 and set incremental pipeline using AWS Glue and MWAA (Managed Workflows for Apache Airflow) with Amazon Redshift as data warehouse
• Modified dashboards in the Preset BI tool to fetch data from Amazon Redshift
• Applications have been migrated to Amazon EKS in both dev and production environments
• Performed incremental migrations and monitored the migration process in real time using AWS monitoring tools to identify and address any issues
• Conducted post-migration validation tests to ensure that all systems and applications were functioning as expected in the AWS environment

‍

Results and Benefits

• Achieved seamless migration of application and data workloads to AWS cloud with up to 20% reduction in costs
• Implemented robust security practices leading to proactive issue identification and resolution.

• Improved usage analysis by enabling powerful monitoring mechanisms.

‍

‍

‍