Write Kafka Topic (Kafka Connector)
Synopsis
This operator sends all examples of an ExampleSet as messages to a Kafka topic.Description
It can either send all examples directly after each other, or can wait a specified amount of time between each message. The examples can be either written as a plain string or as a JSON formatted message.
Input
- connection (Connection)
The connection to the Kafka server, to where the messages are send.
- example set (Data table)
The input ExampleSet which should be pushed to the Kafka topic
Output
- out (Data table)
The unchanged ExampleSet is passed through.
Parameters
- kafka topic
The name of the Kafka topic to which should be send.
- update topics
Try to retrieve a list of available topics from server.
- bulk sending
Should all messages be send directly? If true, each example will still be send as an individual message, but directly after each other. If false there will be a delay specified by the message interval parameter.
- message interval
Delay between the sending of each example in milliseconds.
- message format
The format of the message send. It will be either a JSON format string with the attribute names and values or a simple string that only contains the attribute values.
- attribute separator
If the message format is a single string, this is the separator between the attributes.
Tutorial Processes
Simple Write Kafka Topic
In this tutorial process the usage of the Write Kafka Topic operator is demonstrated.