Using the Twitter Connector

The Twitter Connector allows you to easily access Twitter data directly from RapidMiner Studio. The connector can search for phrases, tweets, or user profile information. This document will walk you through how to:

The Twitter Connector uses an authentication mechanism called OAuth 2.0. Instead of giving RapidMiner your username and password, you generate an access token that can be used by RapidMiner Studio to connect to your Twitter account. This token cannot be used by any other applications and helps keep your Twitter credentials secure.

Connect to your Twitter account

  1. Create a new process New Process Icon in RapidMiner Studio, drag the Search Twitter operator into the Process view, and click on the operator. Click the Twitter iconTwitter icon in the Parameters view to open the Manage Connections dialog. You can also open the Manage Connections window through Tools > Manage Connections.

  2. Click on Add connection Add Connection Icon in the lower left of the window, give a name to the new connection, and set Connection type to Twitter icon Twitter Connection:

  3. Click on Create IconCreate and select your new Twitter connection.

  4. To the right of the access token field, click the Id Icon button to request an access token.

  5. Click on Request access token Website Icon to open the Twitter website in your browser. If you are not already logged into your Twitter account, you will have to do so now. You can manually copy the URL by clicking on Show URL instead.

  6. Allow RapidMiner to access your Twitter account by clicking on Authorize app:

  7. Copy the access token shown on the next page:

  8. Return to RapidMiner Studio, enter the access token, and click Complete IconComplete:

  9. While not required, we recommend testing your new Twitter connection by clicking the Connection Test IconTest button at the bottom of the Manage Connections window:

    If the test fails, check whether you copied the complete access token.

  10. Close the Manage Connections dialog by clicking on Save IconSave all changes.

You have successfully connected RapidMiner Studio to your Twitter account! The next sections will show you how to use this Connector to search for different types of information from Twitter.

Search for tweets containing a phrase

With the Search Twitter operator you can find all tweets containing a specified phrase, along with those tweets` metadata.

  1. Click on the Search Twitter operator in the Process view.

  2. Select your Twitter connection from the connection drop down menu in the operator parameters and fill in the query field. The query is the phrase you will search Twitter for.

  3. Run Run Process the process and view the results:

    As you can see, the results include the user who posted the tweet, the full text of the tweet, and much more!

Get tweets from a user

With the Get Twitter User Statuses operator you can view all tweets from a specified user.

  1. Click on the Get Twitter User Statuses operator, select your Twitter connection in the operator parameters, and specify the username you are interested in. Note you do not need to include the "@"" symbol that usually prefixes Twitter usernames. Alternatively, change the query type to id and input the user ID number.

  2. Run Run Process the process and view the results:

Get account details of a Twitter user

The Get Twitter User Details operator can be used to find profile information for a specified username.

  1. Click on the Get Twitter User Details operator, select your Twitter connection in the operator parameters, and specify the user by username or ID number:

  2. Run Run Process the process and view the results:

    The table contains information such as account creation data and number of followers. To find out more about the user's followers, see the next section.

Get a list of friends or followers

The Get Twitter Relations operator can be used to obtain a list of all friends or followers of a user.

  1. Click on the Get Twitter Relations operator, select your Twitter connection in the operator parameters and specify the user by username or ID number:

  2. Run Run Process the process and view the results:

The first column contains the user you specified and the second column shows the ID numbers of their followers. With your knowledge of the Get Twitter User Details operator from earlier, you could use these ID numbers to get account details for the list of followers, too!