From the Ground to the Cloud - Crunching Trillions of Events a Day
In the world of advertising one major concern is to deliver a stimulating experience to the customer across all channels online and offline and to quickly gain insights in order to improve campaign outcome.
Using a Cloud Platform promises infinite scalability, efficient ingestion of data of any kind and a common platform for using information overcoming the limitations of data siloes.
We present hands-on experience from a real-world project migrating a data ingestion and analytics solution for audience data processing trillions of events a day. This required moving all components hosted on several on-premise clusters consisting of hundreds of individual servers to the cloud. We discuss design decisions and findings from PoCs touching the approach for mapping on-premise infrastructure and solutions to cloud services, using cloud native services vs. cloud infrastructure, the effect on operational costs and scaling together with some of the pitfalls we came across.”
- scenarios for moving to cloud infrastructure
- considering scaling and costs of cloud vs. on-premise infrastucture
- mapping on-premise to cloud technology
- technical considerations and pitfalls for migrating existing solution