Adform: Transforming Batch-based Data Processing Pipeline
Head of Solutions Architecture, Adform
One part of Adform’s business is serving digital Ads. Lots of them. To do this, we continuously capture lots of different information – at the end of the day, more than 5 billion of different events needs to be ingested, processed and prepared for reporting. This session will share a story of transforming the Processing workflow, which was based on big batches processing by using MS SQL servers, into much faster processing pipeline by utilizing Aerospike as key-value storage for historical profiles and using Aerospike for stream joining.