Customer Stories
The Trade Desk achieves hyperscale for real-time bidding
The results
"Aerospike is by far the best for what we do...It makes a real big difference for our ability to execute when we’re trying to follow a customer along the customer journey and they’re transitioning between states. If you’re an extra 50 milliseconds behind, it can cost you putting the right message in front of them."
Dave Pickles, Founder and CTO, The Trade Desk
"I like Aerospike’s concept of their data storage in it gives us a lot of flexibility in how we approach organizing our data, how we approach using our data in different ways."
Matt Cochran. Director of Engineering, The Trade Desk
"So with the way we configure Aerospike, using a simple configuration file with logical stanzas it’s really easy to create a program that can dynamically create these configuration files. And we don’t have to deal with dynamic databases or complex configurations with using Aerospike."
Albert Autin, Data Operations Engineer, The Trade Desk
About the Company
The Trade Desk is the world's largest independent programmatic advertising DSP
The Trade Desk is an advertising technology company that provides a self-service omni-channel platform through which media buyers can purchase digital advertising. The company was founded in 2009 and has outpaced growth in worldwide programmatic advertising by over 50%, generating $400M in revenue with a market capitalization of $5B.
Challenge
Manage and leverage the firehose of 3rd party data sources for real-time bidding
With around 10 million queries a second, the company has to condense, read, and analyze millions of data points, and store the most relevant data to be quickly accessible.
Improved ad targeting Running more targeted campaigns w/ an increasing amount of data.
High volume of data 100 billion records with tens of thousands of data points.
Storage optimization Needed to create an offline cold store to store unused data and optimize for real-time systems.
Hyperscale, real-time bidding leveraging both hot cache and cold store
Record-level compression
Reduced machines needed to 60.Record-based model
All data put into one record and not nearly as CPU-intensive.Flexible data organization
Use one key to represent many different dimensions and get back only the data needed for a given use case.Reduce in-datacenter footprint
Write 30MM key-value tuples/sec into 1 PB cold cache.Rapid access to cold store
Thaw data in 8ms for RTB.Solution areas
Results of The Trade Desk real-time bidding with Aerospike
Hot caches contain only the data needed for current ad campaigns
Hot caches globally refreshed within hours of new campaign activation
Data delivery impact on bidding site performance eliminated
