Categories

Versions

Write Kafka Topic (Kafka Connector)

Synopsis

This operator sends all examples of an ExampleSet as messages to a Kafka topic.

Description

It can either send all examples directly after each other, or can wait a specified amount of time between each message. The examples can be either written as a plain string or as a JSON formatted message.

Input

  • connection (Connection)

    The connection to the Kafka server, to where the messages are send.

  • example set (Data table)

    The input ExampleSet which should be pushed to the Kafka topic

Output

  • out (Data table)

    The unchanged ExampleSet is passed through.

Parameters

  • kafka topic

    The name of the Kafka topic to which should be send.

  • update topics

    Try to retrieve a list of available topics from server.

  • bulk sending

    Should all messages be send directly? If true, each example will still be send as an individual message, but directly after each other. If false there will be a delay specified by the message interval parameter.

  • message interval

    Delay between the sending of each example in milliseconds.

  • message format

    The format of the message send. It will be either a JSON format string with the attribute names and values or a simple string that only contains the attribute values.

  • attribute separator

    If the message format is a single string, this is the separator between the attributes.

Tutorial Processes

Simple Write Kafka Topic

In this tutorial process the usage of the Write Kafka Topic operator is demonstrated.