Announcing: The Pulsar PMC Published The 2020 Apache Pulsar User Survey Report!

Overview
Get started
Install and upgrade
Configure
Secure
Manage and monitor
Connect
Process
Overview
Pulsar Flink Connector
Pulsar Spark Connector
Overview
Link
Read data from Pulsar (source)
Write data to Pulsar (sink)
Configure
Secure
Tutorial
Pulsar Functions
Release notes

Link

Follow the steps below to link the Pulsar Spark Connector.

Prerequisite

Check the following requirements before linking the Pulsar Spark Connector.

Pulsar Spark Connector version Pulsar version Spark version Java version
2.4.5 - 2.4.0 Pulsar 2.4.0 or later Spark 2.4.0 or later Java 8 or later

Tip

For what’s new in each Pulsar Spark Connector version, see release notes.

Step

You can use one of the following methods to link the Pulsar Spark Connector.

Currently, the artifact is available in Bintray Maven repository of StreamNative.

Maven

For Maven project, you can add the repository as well as the artifact dependency to your pom.xml as follows:

....
    <repository>
      <id>bintray-streamnative-maven</id>
      <name>bintray</name>
      <url>https://dl.bintray.com/streamnative/maven</url>
    </repository>

<dependency>
	<groupId>io.streamnative.connectors</groupId>
	<artifactId>pulsar-spark-connector_2.11</artifactId>
	<version>2.4.5</version>
</dependency>

Gradle

For a Gradle project, you can add the repository as well as the artifact dependency to your build.gradle.

repositories {
	maven {
		url  "https://streamnative.bintray.com/maven"
	}
}

implementation 'io.streamnative.connectors:pulsar-spark-connector_2.11:2.4.5'