cnfl.io/kafka-internals-101-m... | Jun Rao (Apache Kafka® Committer, PMC Member, VP of Kafka, and Co-Founder, Confluent) explains that topics are often used to store state, such as ksqlDB tables or Kafka Streams state stores. Compaction minimizes storage cost (server side) for such data and allows you to store table data in Apache Kafka as the permanent system of record without the data growing out of bounds. Topic compaction also minimizes application failover and recovery times (client side) and forms the basis for clients to efficiently store "state" data in Kafka. Compaction is a background operation that is decoupled from the read/write path of Kafka so that it does not impact the performance of client reads/writes. Compaction has advanced configurations that let you tune the impact it has on disk usage and the timeliness of the compaction process. Gain an understanding of time-based vs. key-based data retention as well as the use cases and benefits of topic compaction.
Use the promo code INTERNALS101 to get $25 of free Confluent Cloud usage: www.confluent.io/confluent-cl...
Promo code details: www.confluent.io/confluent-cl...
LEARN MORE
► Kafka: The Definitive Guide: www.confluent.io/resources/ka...
ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion - designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.
#confluent #apachekafka #kafka
Негізгі бет Ғылым және технология Apache Kafka® Topic Compaction
Пікірлер: 9