2.0.0

This major release is functionally equivalent to the previous 1.11.0 release, but has the following changes in terms of system requirements:

1. Requires Kafka 4.0 or higher. Confluent users must use Confluent 8.0 or higher.
2. Requires Java 17 or 23, per the Java system requirements of Kafka 4.0.
3. Depends on marklogic-data-hub version 6.2.1 instead of 6.1.1.

This release is a drop-in replacement for customers already using Kafka 4. Customers using Kafka 3 can continue using our latest 1.x release until they are able to upgrade to Kafka 4.

1.11.0

Highlights of this new minor release:

• Updated to be compatible with Kafka 3.9.1.
• Updated the default TLS version for custom SSL connections to "TLS", allowing the JVM to choose the highest possible version.
• Updated other dependencies to resolve security vulnerabilities.

1.10.0

Highlights of this new minor release:

• Updated to be compatible with Kafka 3.8.0.
• Updated other dependencies to resolve security vulnerabilities.

1.9.0

Highlights of this new minor release:

• Can now include Kafka headers in the document metadata.
• Updated dependencies.

1.8.1

This patch release addresses one issue:

• The CVE in the okio dependency has been addressed by upgrading to version 6.3.0 of the MarkLogic Java Client library, which depends on okio.

No other changes are present in this release.

1.8.0

Highlights of this new minor release:

• The connector is now also a source connector, accepting MarkLogic Optic queries for retrieving data as rows and sending them to Kafka topics.
• The sink connector now supports Kafka's dead letter queue.

The connector archive can be obtained from Confluent Hub . The self-contained jar required for use with Kafka can be downloaded from below.

1.7.0

Highlights of items addressed by this release:

• #70 Updated README provides documentation on all configuration options
• #4 Bulk Data Services can now be used for complete control over how data is ingested in case the configuration options do not suffice
• #50 Documents can now be inserted into temporal collections
• Connector is compiled against Kafka 2.8.1 and has been tested successfully on Kafka 3.2.0

To use the connector with Confluent Platform, please see the connector's page at Confluent Hub.

1.6.1

Updated the CloudFormation templates to use the latest MarkLogic AMI (10.0-8.2).

1.6.0

Fix optional parameters and running under Java 11

• Ensuring optional parameters are actually optional and do not cause a crash when they are not included.
• Fixing some Boolean and Integer casts now that the initial configuration object is a Hashmap of <String, Object> instead of <String, String>. Also fixed some tests that used that configuration object.
• Updating the build to use the ML client api v5.3.0 and the ML data hub v5.2.4. This should solve problems with running the connector with Java 11.

1.5.0

• Added options for logging incoming record keys and headers after write failures
• Updated the AWS CloudFormation Quick Start document
• Added documentation for using the connector with the AWS MSK (Kafka as a Service)