Kafka
The goal of this document is to provide information about how we use Kafka in Airy Core.
#
Topic naming conventionsInspired by this article, our naming conventions follow these rules:
- A topic has a three-part name:
<kind>.<domain>.<dataset>
- Each part uses lisp-case (down-case words separated by
-
. Example:answer-is-42
)
Each part defines a more granular scope:
kind
is the type of data the topic contains at the highest level possible. Valid examples are:etl
,logging
,tracking
domain
is what you would call a database name in a traditional RDMSdataset
is what you would call a database table in a traditional RDMS
Given these rules, here are a few examples: