Data Streaming Summit@DataStreamingSt

Data Streaming Summit is the conference dedicated to community of all data streaming technologies like @apache_pulsar, @apachekafka

 San Francisco
datastreaming-summit.org/
Joined November 2019
680 Photos and videos
🎥 Watch Shiyan Xu from #Onehouse dive into high-throughput streaming Lakehouses with #ApacheHudi! ✨ Merge-on-Read ✨ Record-level indexing ✨ Async compaction ✨ Non-blocking concurrency ▶️ Full session:
hubs.ly/Q03YJSDf0 #DataStreaming #RealTimeData #DSS

High-throughput streaming Lakehouse with Apache Hudi

Discover how Apache Hudi's NBCC enables high-throughput, conflict-free streaming ingestion in Flink-powered lakehouse pipelines for real-time analytics.

streamnative.io
40
💡Schema evolution at scale isn’t optional. In this session, Jan breaks down: ❇️ Schema evolution strategies ❇️ Data contracts for governance & trust ❇️ Streaming data products in practice 🎥 Watch the recording: hubs.ly/Q03YBj3n0 #RealTimeData #DSS #datastreamingsummit
25
How #Uber safely deploys Flink jobs handling 4T+ messages/day? This session explores Uber's deployment safety framework — from incremental rollouts to automated rollbacks — cutting incidents by 38.5%. ▶️ Watch the full recording: hubs.ly/Q03Yrv3p0 #DataStreaming #DSS

Safe Streams at Scale: Uber’s Deployment Safety Framework for Flink Jobs

Learn how Uber ensures safe, scalable Flink job deployments with its Deployment Safety Framework. Discover best practices for automated rollouts, testing, and rollback strategies that keep mission-...

streamnative.io
39
📊 Low-latency matters! #LazyLog helps event sourcing, activity logging & distributed databases perform faster with deferred ordering. 👉 Full talk by Ram Alagappan: hubs.ly/Q03YkmyX0 #DataStreaming #RealTimeData #DSS #datastreamingsummit

LazyLog: A New Shared Log Abstraction for Low-Latency Applications

Discover LazyLog, a new log abstraction that reduces write latency by deferring ordering until read time. Learn how this SOSP Best Paper Award system delivers low-latency, high-throughput performance...

streamnative.io
45
🤔 Are Your Kafka Guarantees Actually Guaranteed? Watch Lawrie Green & Connor McKee at #DSS2025 on: - Property-Based Testing ✅ - Autonomous Testing ⚡ - Validating “no message loss” & more💥 ▶️ hubs.ly/Q03Y828q0 #DataStreaming #RealTimeData #DSS #datastreamingsummit

Are Your Kafka Guarantees Actually Guaranteed?

Learn how to test and validate Kafka’s consistency and availability guarantees using autonomous testing with Antithesis. Discover how Kafka’s KRaft protocol enables configurable trade-offs between...

streamnative.io
37
In the #DSS, Uber + Onehouse break down how they use #Flink + #Hudi to push Cloudlake freshness to P90 < 15 min at massive scale. ⚡️ Streaming ingestion 🏗 Simpler, cheaper architecture 📈 Autoscaling & DR 📦 Hudi MOR for high-throughput writes 👉
hubs.ly/Q03XZryx0

Flink Streaming Ingestion to Cloud-lake at Scale

Learn how Uber uses Apache Flink and Hudi to power real-time data ingestion into its Cloud Lake for scalable, efficient, and secure machine learning.

streamnative.io
223
🚀 Salesforce streams 300B trace spans/day with Flink! Learn how they build real-time Service Dependency Graphs, handle variable & out-of-order traces, and optimize Flink for speed & memory. ▶️ Watch now!
hubs.ly/Q03XQkR10 #DataStreaming #DSS #datastreamingsummit

Insights from streaming 300B telemetry trace spans per day with Flink

Discover how Salesforce processes 300B telemetry trace spans per day with Apache Flink. Learn real-world strategies for scaling stream processing, managing state, and handling out-of-order events in...

streamnative.io
24
⚡ Real-time matters. In this #DSS25 session, experts from @creditkarma share how session-aware signals power next-best recommendations as users act. ❇️ Sub-second decisions ❇️ Low-cost, always-on engine ❇️ End-to-end pipeline from signals → ranking ▶️
hubs.ly/Q03XQgh30

Real-Time Recommendation Systems: Transforming User Experience Through Session-Aware Data

Learn how to build real-time, session-aware recommendation systems with Kafka and AI. Deliver personalized, sub-second recommendations at 100M+ user scale while preserving privacy.

streamnative.io
25
🚀 Dive into real-time analytics at #DataStreamingSummit 2025! Watch the exclusive session from #StarTree to learn how #ApachePinot handles billions of keys, speeds up restarts, and saves storage. ▶️
Don't miss out: hubs.ly/Q03XCNgd0 #DataStreaming #RealTimeData #DSS

Have Your Real-time OLAP and Upsert It Too

Discover how Apache Pinot enables real-time OLAP with native upserts. Learn how Pinot manages billions of primary keys per node while maintaining second-level freshness and high ingestion throughput...

streamnative.io
24
🚀 Unlock the power of unified streaming storage! 💡Dive into the #DSS2025 session to learn how #Ursa unifies #Pulsar & #Lakehouse for single-copy data, faster pipelines, and scalable storage! ▶️ Watch now!
hubs.ly/Q03XCP0H0 #DataStreaming #RealTimeData #DSS

From Pulsar to Lakehouse: Building a Unified Streaming Storage Engine with Ursa

Discover how Ursa unifies Apache Pulsar and modern lakehouses, enabling seamless real-time streaming, storage, and analytics in one platform.

streamnative.io
23
What does real-time look like at OpenAI scale? Watch the #DSS2025 session to explore how OpenAI built StreamLink, their ingestion platform that delivers fresh, reliable data for both human and AI consumers. ▶️ hubs.ly/Q03XsCvr0 #DataStreaming #RealTimeData #DSS25 ️

StreamLink: Real-Time Data Ingestion at OpenAI Scale

Discover how OpenAI’s StreamLink, powered by Apache Flink, enables real-time ingestion into Delta Lake and Iceberg at massive scale.

streamnative.io
19
🌟 Flink SQL Changelog: Why it matters Upserts, deletes, retracts — they impact state size, compute + latency. Join experts from #Confluent to learn how operators handle change events & how to optimize for performance. ▶️
hubs.ly/Q03XfB0V0 #DataStreaming #DSS25 ️

Flink SQL Changelog: Why should you care about them?

Learn how Flink SQL changelog modes impact performance, state size, and latency. This talk explains changelog fundamentals, operator behavior, and optimization techniques for building efficient...

streamnative.io
36
🚀 Low-latency streaming at scale! Naci Simsek shows how to optimize #ApacheFlink for speed, throughput & efficiency — key configs, checkpoints & async I/O. ▶️ Watch #DSS25: hubs.ly/Q03X0FbL0 #DataStreaming #RealTimeData #DSS2025 ️

The Need for Speed: Optimizing Apache Flink for Low-Latency Stream Processing

Learn advanced techniques to optimize Apache Flink for ultra-low-latency stream processing. This talk covers tuning, resource allocation, state backend choices, and bottleneck elimination for peak...

streamnative.io
24
📺 Netflix reveals how they handle extreme #Kafka loads - 700+ clusters, 13,500 brokers, 65M+ viewers! Learn about automated capacity planning & client-side load shedding. ▶️ Watch the recording now!
hubs.ly/Q03X0z1g0 #DataStreamingSummit #RealTimeData #DSS2025 ️#Netflix

Kafka Under Pressure: Netflix's Blueprint for Unshakeable Kafka Resilience

Learn how Netflix ensures Kafka resilience under extreme traffic. Discover strategies for broker stability, adaptive clients, and high-throughput operations at scale.

streamnative.io
56
🎯 Complex data + strict compliance doesn’t have to mean high cost. Learn how #Ursa, #Flink & #RisingWave enable real-time, cost-efficient architectures. Watch the DSS25 session. ▶️ Watch the #DSS25 session:
hubs.ly/Q03WQX9g0 #DataStreaming #RealTimeData #DSS2025 ️

Complex Business Requirements + Lots of Data = High Cost? Not necessarily, here is why

Learn how StreamNative Ursa, Flink, and RisingWave enable cost-efficient architectures for complex, real-time, and compliance-driven data systems.

streamnative.io
1
40
Simplify schema governance across your streaming data ecosystem! 🚀 Watch this deep-dive session from #DSS 2025, learn how #ApachePulsar now integrates with external schema registries, decoupling schema management & unifying governance. ▶️ 
hubs.ly/Q03WG17M0

Unified Governance: Integrating Apache Pulsar with External Schema Registries

Learn how Apache Pulsar integrates with external schema registries like Confluent Schema Registry. Explore PIP-420, which decouples schema management from the broker to enable unified governance...

streamnative.io
22
🌟Session Highlight from #DSS 2025! Learn how to unify #ApacheDoris + #Iceberg + #Ursa to deliver sub-second query response times on petabyte-scale data lakes. 📉🚀 ▶️ Watch the recording now!
hubs.ly/Q03VNCpf0 #DataStreaming #RealTimeData #DSS2025

Unlocking Real-Time Insights: Apache Doris in Stream and Lakehouse Integration

Learn how Apache Doris integrates with Ursa and AWS S3 Tables to power real-time lakehouse analytics across Iceberg, Hudi, and Delta Lake.

streamnative.io
44
🎥Catch the #DataStreamingSummit recording to see how #FiveOneFour + #StreamNative built real-time AI chat architectures—blending streaming, analytics, and orchestration into a low-latency, production-ready stack. ▶️ hubs.ly/Q03VnJkT0 #DataStreaming #RealTimeData #DSS2025

Building Real-Time Data Architectures for AI Chat With FiveOneFour and StreamNative

Learn how StreamNative and FiveOneFour build real-time, cloud-ready data architectures for conversational AI using MooseStack and streaming analytics.

streamnative.io
27
️🚨 Missed this #DSS25 session? 🎥 Catch the recording to learn how #Ursa + #PuppyGraph bring a graph-based, streaming-first approach that simplifies pipelines, boosts performance, and makes threat investigation way faster. ▶️ hubs.ly/Q03VcfzC0 #DataStreaming #DSS

A Survey of Cybersecurity Data Infra and How to Simplify It with Ursa and PuppyGraph

Explore how Ursa and PuppyGraph simplify cybersecurity data infrastructure by enabling graph-based streaming, real-time threat analysis, and scalable, high-performance pipelines.

streamnative.io
1
26
Solve a crime in 15 minutes with Kafka + AI 🔍⚡️ Watch a live fraud attack unfold and see how AI: 🔥 Detects anomalies 🔥 Samples live Kafka streams 🔥 Correlates clues across topics 🔥 Generates instant mitigations ▶️ Watch now! hubs.ly/Q03Vc44C0 #DataStreaming #DSS2025

Solve a crime in 15 mins live with Kafka and AI

Watch how Kafka and AI team up to stop a live fraud attack in minutes. Learn real-time detection, investigation, and response techniques using AI-driven stream processing — no Kafka expertise...

streamnative.io
44
Load more