Kafka API

Producer

  • publish (write) a stream of events to one or more topics

Consumer

  • subscribe to (read) one or more topics and consume events

Streams

  • perform stream processing operations on data in Kafka consuming, transforming and publish in real-time

Connect

  • build and run reusable data import/export connectors that consume (read) or produce (write) streams of events from and to external systems and applications that integrate with Kafka
  • Kafka community provides hundreds of ready-to-use connectors
  • example:
    • a connector to a relational database like PostgreSQL might capture every change to a set of tables

Admin

  • create, delete, describe, and modify Kafka resources such as topics, brokers, and ACLs (Access Control Lists)