1. Documentation
2. 2024.1 (Latest) 2024.0 10.3 10.2 10.1 10.0 9.10 9.9 9.8 9.7 9.6 9.5 9.4 9.3 9.2 9.1 9.0 8.2 8.1 8.0 7.6
3. Server
4. Installation
5. Job Agents

Job Agents

RapidMiner Job Agent is the consumer endpoint application for the scaled execution of jobs. It starts and manages execution environments, handles their logs and distributes information across these execution instances. Being a CLI application, you can simply download, unpack and start the agent from the command line of your operating system.

Installation

Obtain an Agent

Job Agents are tied to one execution queue (See Administration > Process execution queues) and can be downloaded from the queue configuration page on server by clicking Install. Each agent is pre-configured based on the queue it was downloaded for. For example, if you download an agent from the link provided under DEFAULT queue, that agent will connect to server and fetch jobs from that queue.

Configuration

The RapidMiner Server preconfigures the agent with some of the properties it can guess before you download the distribution. You can edit these properties after downloading and unpacking the agent.

Agent Properties

You can alter this configuration by changing config/config.properties. Each property has a comment before which explains what effect the configuration has on the agent.

Container Properties

The content inside config/container/ is going to be copied into each job directory before container start:

• .RapidMiner: Place your own configuration files into this directory if you need it for your extensions.
• container.properties: the properties in this file are going to be set as system properties for the Job Container. The agent will also add RapidMiner Server's address properties to this file automatically before the container starts. Use this file to provide your custom properties (e.g. extension properties) for the container.
• jdbc_properties.xml: the connection properties will be copied into each job's directory.

Extensions

Extensions are provided from extensions/ directory, they aren't copied because of their size, but provided as a reference to each Job Container. Place your extensions into this directory if you want to be available for execution.

Licenses and Concurrency

The Job Agent distribution's licenses/ directory already contains your licenses installed in RapidMiner Server. It can happen however that some of your extensions need extra licenses to execute properly and those licenses can't be found in the Job Agent's directory. Place your licenses into this directory to make it available to your containers.

Run

To run the agent, execute the bin/rapidminer-jobagent. This will start the agent by setting:

• the base directory (baseDir) of the agent to the current root of the distribution package
• the configuration directory to {baseDir}/config/
• the agent's persistent storage's directory to {baseDir}/data/
• the extensions directory to {baseDir}/extensions/
• the used Job Container engine to the jar file located in {baseDir}/engine/

Stop Agent

To stop the agent, you can use the stop script bin/stop-job-agent. This script will forcibly shut down all your running jobs and the agent itself.