Overview

K.S.I. (Kafka Service for Iceberg) is a Kafka proxy that serves Iceberg data to Kafka clients. K.S.I. combines a real-time dataset stored in Apache Kafka with a long retention, hig volume set stroed in Apache Iceberg.

K.S.I.. enables:

  • Cost savings in Kafka - Storage costs can be saved in Kafka by reducing retention of Kafka topics and offloading the data that would be retained into Iceberg. K.S.I. means that Kafka clients have the same experience regardless of the underlying storage platform.

  • Unified governance across Kafka and Iceberg - Extend schemas, acls and other governance parameters from Kafka into Iceberg to provide a unified, seamlessly evolvable experience.

Last updated