🇫🇷
#VictoriaMetrics Meetup at
@CriteoEng offices in Paris!
Raphael Bizos - Site Reliability Engineer at Criteo
presented: "A History of Automatic Aggregations"
At Criteo, we’ve relied on automatic aggregations for years. “Automatic aggregation” is the name we give to a system of recording rules that matches most metrics and removes certain dimensions, such as the instance emitting the metric, to reduce the cardinality (i.e., the number of
#metrics) and thus makes queries faster.
What started as a workaround has become a key part of how we ensure backend stability and
#reliability at scale, with hundreds of millions of active metrics, all without requiring users to write a single recording rule. It also significantly reduces the cost of metrics storage. Internally, we call this approach zero-effort
#Observability, as most teams don’t have to write/maintain recording rules.
In this talk, Raphael will explain how our approach to automatic aggregations has evolved over time and how we’ve adapted it to fit naturally into our Prometheus-based stack. He will share the different implementations we’ve tried, the lessons we’ve learned, and how our latest version takes advantage of recent improvements in Prometheus (new type label).
A big thank you to everyone who joined us to exchange ideas and experiences about time series data and modern observability.
#TimeSeries #Monitoring