Categories

Versions

Write Kafka Topic (Kafka Connector)

Synopsis

This operator sends all examples of an ExampleSet as messages to a Kafka topic.

Description

It can either send all examples directly after each other, or can wait a specified amount of time between each message. The examples can be either written as a plain string or as a JSON formatted message.

Input

  • connection (Connection)

    The connection to the Kafka server, to where the messages are send.

  • example set (Data Table)

    The input ExampleSet which should be pushed to the Kafka topic

Output

  • out (Data Table)

    The unchanged ExampleSet is passed through.

Parameters

  • kafka_topic

    The name of the Kafka topic to which should be send.

    Range:
  • update_topics

    Try to retrieve a list of available topics from server.

    Range:
  • bulk_sending

    Should all messages be send directly? If true, each example will still be send as an individual message, but directly after each other. If false there will be a delay specified by the "message interval" parameter.

    Range:
  • message_interval

    Delay between the sending of each example in milliseconds.

    Range:
  • message_format

    The format of the message send. It will be either a JSON format string with the attribute names and values or a simple string that only contains the attribute values.

    Range:
  • attribute_separator

    If the message format is a single string, this is the separator between the attributes.

    Range:

Tutorial Processes

Simple Write Kafka Topic

In this tutorial process the usage of the Write Kafka Topic operator is demonstrated.