Inkless 0.38

Inkless version 0.38

Docker Images

docker pull ghcr.io/aiven/inkless:0.38
docker pull ghcr.io/aiven/inkless:latest

Kafka Versions

• Kafka 4.1.2: inkless-4.1.2-0.38

What's Changed

• feat(inkless:config): Enforce diskless.allow.from.classic.enable by @giuseppelillo in #546
• feat(inkless): Parse request and response of InitDisklessLog by @giuseppelillo in #545
• feat(inkless): Orchestrate classic-to-diskless migration by @giuseppelillo in #536
• feat(inkless:metadata): Remove topic already diskless from InitDisklessLog Controller API by @giuseppelillo in #547
• MINOR: update Kafka version variables to 4.2.0-inkless-SNAPSHOT by @giuseppelillo in #548
• refactor(inkless): Refactor InitDisklessLog flow and add integration tests by @giuseppelillo in #549
• fix(inkless:metrics): Fix double-counting of diskless topic and partition metrics by @jeqo in #552
• fix(inkless:consume): handle error path in lastOffsetForLeaderEpoch by @jeqo in #554
• fix(inkless:migration): bypass diskless/remote-storage mutual exclusion for classic-to-diskless migration by @jeqo in #555
• feat(inkless): allow reading from UnifiedLog for diskless topics by @giuseppelillo in #553
• fix(inkless:migration): fix classic-to-diskless migration validation by @jeqo in #558
• feat(inkless:docker): add diskless tiered storage unification demo by @jeqo in #559
• feat(inkless:config): enforce diskless feature flag dependency chain by @jeqo in #560
• feat(inkless): POD-2386 Allow remote.storage.enabled when diskless is enabled by @viktorsomogyi in #556
• refactor(inkless): Split InitDisklessLogManager logic into separate components by @giuseppelillo in #561
• MINOR: Fix potential leak when closing resources by @jlprat in #565
• fix(inkless:migration): Fix InitDisklessLogManager gaps during partition registration by @giuseppelillo in #566
• fix(inkless): Add InitDisklessLog JSON conversion to RequestConvertToson by @giuseppelillo in #570
• feat(inkless): Init diskless log on Control Plane by @giuseppelillo in #563
• refactor(inkless): Rename disklessStartOffset to classicToDisklessStartOffset by @giuseppelillo in #572
• feat(inkless:consume): Add time-to-first-byte (TTFB) metric for storage reads by @jeqo in #575
• feat(inkless): POD-2392 Implement consolidating partition tracking by @viktorsomogyi in #567
• feat(inkless): Abort transactions on partition sealing by @giuseppelillo in #573
• fix(inkless:migration): Avoid deadlock in InitDisklessLogBatchQueue by @giuseppelillo in #578
• fix(inkless): Create Partition object even when diskless is enabled by @giuseppelillo in #574
• feat(inkless): Set migrating partitions in KRaft metadata by @giuseppelillo in #580
• fix(cache): respect max-idle=-1 (disable idle eviction) by @AnatolyPopov in #470
• feat(inkless): POD-2393 Add DisklessLeaderEndPoint to handle fetch requests by @viktorsomogyi in #568
• feat(inkless): POD-2398 Integration test for consolidation produce path by @viktorsomogyi in #569
• feat(inkless): Support basic ListOffset for hybrid topics by @giuseppelillo in #577
• fix(inkless): Stop replicating after migration to diskless is completed by @giuseppelillo in #585
• feat(inkless): POD-2394 Implement read path for consolidated logs by @viktorsomogyi in #583
• feat(inkless): Support ListOffsets for all cases of diskless partitions by @giuseppelillo in #584

New Contributors

• @viktorsomogyi made their first contribution in #556

Full Changelog: inkless-release-0.37...inkless-release-0.38