The Evolution of Enterprise Data Platform Architecture

Client: Comcast
Our client, a multinational $275 billion telecommunications conglomerate, has relied on Valtree Solutions for years as a trusted partner in advancing its cloud adoption. Once again, the client approached us for guidance on their data architecture and cloud migration strategies.

Service Provided

Capabilities Utilized

Cloud Computing & DevOps with AWS

Client challenge

Our client recently unified its major big data teams into a single entity known as DX Architecture. This group had been responsible for managing an aging and costly data platform, heavily reliant on on-premise infrastructure such as Teradata, Kafka, and Hadoop. The platform’s use for enterprise analytics and reporting often felt like a gamble, and achieving widespread adoption across the company’s siloed teams was a significant challenge. In response to these obstacles and to better meet the enterprise’s data needs, the company embarked on a modernization journey, transitioning to an AWS-based, cloud-native platform to transform its data capabilities across the organization.

Our solution

A small, high-powered Valtree team collaborated closely with DX architects and tech leads to gain a deep understanding of their aspirations, perceived use cases, and long-term vision for a feature-rich, consumer-friendly, and future-proof cloud-native enterprise data platform.

The Valtree team then established a validated reference architecture for the platform, comprising a diverse set of tools and solutions for data integration, ingestion, processing, storage, and querying strategies.

Valtree provided comprehensive guidance for each of these components individually and holistically as part of the entire platform. Additionally, we delivered detailed plans for migrating legacy products and their associated data to this next-generation solution and later provided staffed engineering teams to support the ongoing efforts of this group.

Results

The platform has not only been successfully brought to life as originally envisioned but has also evolved positively over time. Hundreds of previously independent, self-managed data teams have seamlessly transitioned onto the platform, benefiting from its powerful and efficient tools for storing, cataloging, and extracting insights from data. This integration has encouraged data-sharing across teams, enhancing the value for both individual units and the organization as a whole. Currently, the platform supports a remarkable 14 PB of data (including 6 million objects), handles 500,000 queries per day, manages nearly 2,500 event streams for system integration, and runs 5,000 data ingestion jobs. The consumer portal, serving as the platform’s front-end, attracts an average of 2,000 users each month. Today, the DX enterprise platform stands as the go-to solution for the company’s data integration and analytics requirements.

Additional Case Studies

Fostering Workforce Diversity with Crew

At Crew, we’re dedicated to helping our clients achieve their goals of building a more diverse

Making the Shift to Virtual in Just 24 Hours

Similar to many businesses, our client had to swiftly transition their workforce to a virtual environment

Comprehensive Salesforce Implementation

Our client, a leading national medical device manufacturer, sought a skilled Salesforce partner to assist in