V4.0.0.5

StreamNative Weekly Release Notes v4.0.0.5

Download

Distributions

• https://github.com/streamnative/pulsar/releases/tag/v4.0.0.5

Packages

• Maven Central

Images

• sn-platform

• sn-platform-slim

• private-cloud

General Changes

Apache Pulsar

[feat][misc] Upgrade oxia version to 0.4.9

[fix][broker] Fix failed TokenAuthenticatedProducerConsumerTest

[improve][offload] Use filesystemURI as the storage path

[fix][misc] Unable to connect an etcd metastore with recent releases due to jetc-core sharding problem

[improve][test] Clarify method signatures in Bookkeeper mock client

Enabling DNS retryOnTimeout with TCP in DnsNameResolver

[improve] [broker] replace HashMap with inner implementation ConcurrentLongLongPairHashMap in Negative Ack Tracker.

[fix][client] The partitionedProducer maxPendingMessages always is 0

[improve][broker] Support cleanup replication cluster and allowed cluster when cluster metadata teardown

[fix][broker] Broker is failing to create non-durable sub if topic is fenced

[fix][client] fix the beforeConsume() method earlier hit with message listener

[fix][test] Fix DeadLetterTopicTest.testDeadLetterTopicWithInitialSubscriptionAndMultiConsumers

[fix][test]Flaky-test: SchemaServiceTest.testSchemaRegistryMetrics

[fix][broker] Fix currently client retries until operation timeout if the topic does not exist

[fix][test] Fix SimpleProducerConsumerTest.testMultiTopicsConsumerImplPauseForManualSubscription

[fix][broker] fix logging with correct error message while loading the topic

[fix][test] Fix ManagedCursorTest.testForceCursorRecovery

[improve][test] Disable OTel autoconfigured exporters in tests

[fix][test] Fix memory leak via OTel shutdown hooks in tests

[fix][broker] Fix print cluster migration state response

[fix][broker] Fix Broker migration NPE while broker tls url not configured

[fix][client] Fix the javadoc for startMessageIdInclusive

[fix] [broker] Fix race-condition causing repeated delete topic

[fix][standalone] correctly delete bookie registration znode

[fix][client] Fix Reader.hasMessageAvailable return wrong value after seeking by timestamp with startMessageIdInclusive

[improve][broker] Exclude system topics from namespace level publish and dispatch rate limiting

[improve][admin] Print error log if handle http response fails

KoP

Disable bundle ownership transferring for bundles in shadow namespaces

Cloud Storage Connector

Upgrade netty to fix CVE-2024-47535

Cloud Pulsar Plugins

Upgrade netty to fix CVE-2024-47535

StreamNative Tiered storage

Configure ksn entryformat in test

StreamNative Ursa storage

Support creating the managedLedger in different brokers

[fix][ml] fixed npe in getLastIndividualDeletedRange

Fix trivy downloading db rate limitation

Introduce task manager to avoid acquire lock between threads (Re-Commit)

Make mockito test scope

[fix][tests] Enable ursa-storage-test tests

[improve][tests] cover Pulsar messaging tests

(#401))) Revert “Introduce compaction task provider to avoid acquire lock between multiple threads

LakehouseKafkaReader add prefetch cache support

Fix the integer key leak issue

Improve the WAL catch up read throughput by prefetching cache

Introduce compaction task provider to avoid acquire lock between multiple threads

Add GCS FileStorage implementation

Security Fixes

Apache Pulsar

[fix][sec] Upgrade to Netty 4.1.115.Final to address CVE-2024-47535

[fix][sec] Upgrade Zookeeper to 3.9.3 to address CVE-2024-51504

[fix][sec] Replace bcprov-jdk15on dependency with bcprov-jdk18-on