You are viewing the RapidMiner Radoop documentation for version 9.4 - Check here for latest version
RapidMiner Radoop Compatibility
Supported Hadoop distributions
RapidMiner Radoop works with most popular Hadoop distributions. Refer to the provider's documentation for information on configuring the Hadoop cluster. The supported distributions are:
- Amazon Elastic MapReduce (EMR) 5.x
- Azure HDInsight 3.6
- Cloudera's Distribution of Hadoop (CDH) 5.x, 6.x
- Hortonworks Data Platform (HDP) 2.x, 3.x
For CDH and HDP distributions, we only support the minor versions that are also supported by Cloudera.
Deprecated Hadoop distributions
Although RapidMiner Radoop works with the Hadoop distributions and versions listed below, we have marked them as deprecated. Support for these will be discontinued in a future version of RapidMiner Radoop.
- Amazon Elastic MapReduce (EMR) 4.x
- Apache Hadoop 2.2+
- IBM Open Platform 4.1+
- Mapr 5.x, 6.x
- Open Data Platform 0.9+
For Amazon Elastic MapReduce, we will now distinguish between 4.x (deprecated) and 5.x versions inside Radoop connections. If you already have a Radoop connection set up to an Amazon Elastic MapReduce cluster, please update the connection with the corresponding version (after updating Radoop to the latest version).
Supported data warehouse systems (DWS)
RapidMiner Radoop supports the following data warehouse infrastructures:
- Apache HiveServer2 0.13+
- Cloudera Impala 1.2.3 and later (see Impala limitations on the Installing Radoop on Studio page)
Supported Spark versions
RapidMiner Radoop supports the following Spark versions:
- Apache Spark 1.6.x
- Apache Spark 2.0.x (except 2.0.1), 2.1.x, 2.2.x, 2.3.x
Spark 2.0.1 minor version is not supported.
Deprecated Spark versions
Although RapidMiner Radoop works with the Spark versions listed below, we have marked them as deprecated. Support for these will be discontinued in a future version of RapidMiner Radoop.
- Apache Spark 1.5.x
Please contact support if you rely on this specific Spark version.
Supported Java versions
RapidMiner Radoop requires Java 8 installed on the Hadoop cluster to operate. The nodes should have at least 8 GB of RAM.
RapidMiner extension compatibility
RapidMiner Radoop is not compatible with the Parallel Processing Extension. This extension must be disabled when using Radoop. Please select the Extensions > Manage Extensions... menu item and uncheck the box for Parallel Processing Extension.