baserev update by copy to link target

• Files Changed
• Browse Source

- update to 2.1.0:
  * Allow fetchers to detect and handle log truncation (#4122).
  * Fix a reference count issue blocking the consumer from
    closing (#4187).
  * Fix a protocol issue with ListGroups API, where an extra
  * field was appended for API Versions greater than or equal to
    3 (#4207).
  * Fix an issue with `max.poll.interval.ms`, where polling any
    queue would cause the timeout to be reset (#4176).
  * Fix seek partition timeout, was one thousand times lower than
    the passed value (#4230).
  * Fix multiple inconsistent behaviour in batch APIs during
    **pause** or **resume** operations (#4208).
  * Update lz4.c from upstream. Fixes CVE-2021-3520
  * Upgrade OpenSSL to v3.0.8 with various security fixes
  * Added `rd_kafka_topic_partition_get_leader_epoch()` (and
    `set..()`).
  * A reference count issue was blocking the consumer from
    closing.
  * Fixed known issues related to Batch Consume APIs mentioned in
    v2.0.0 release notes.
  * Fixed `rd_kafka_consume_batch()` and `rd_kafka_consume_batch_queue()`
    intermittently updating `app_offset` and `store_offset`
    incorrectly when **pause** or **resume** was being used for a partition.
  * Fixed `rd_kafka_consume_batch()` and `rd_kafka_consume_batch_queue()`
    intermittently skipping offsets when **pause** or **resume**
    was being used for a partition.

• Files Changed
• Browse Source

baserev update by copy to link target

• Files Changed
• Browse Source

- update to 2.0.2:
  * OffsetFetch Protocol Update (#3995).
  * Add Consumer Group operations to Admin API (started by @lesterfan, #3995).
  * Allow listing consumer groups per state (#3995).
  * Partially implemented: support for AlterConsumerGroupOffsets
  * OpenSSL 3.0.x support - the maximum bundled OpenSSL version is now 3.0.7 (previously 1.1.1q).
  * Fixes to the transactional and idempotent producer.
  * The introduction of OpenSSL 3.0.x in the self-contained librdkafka
    bundles changes the default set of available ciphers, in particular all obsolete
    or insecure ciphers and algorithms as listed in the OpenSSL legacy
    manual page are now disabled by default.
    Should you need to use any of these old ciphers you'll need to
    explicitly enable the `legacy` provider by configuring
    `ssl.providers=default,legacy` on the librdkafka client.
    OpenSSL 3.0.x deprecates the use of engines, which is being replaced by
    providers. As such librdkafka will emit a deprecation warning if
    `ssl.engine.location` is configured. OpenSSL providers may be
    configured with the new `ssl.providers` configuration property.
    The default value for `ssl.endpoint.identification.algorithm` has been
    changed from `none` (no hostname verification) to `https`, which enables
    broker hostname verification (to counter man-in-the-middle
    impersonation attacks) by default.  To restore the previous behaviour, set
    `ssl.endpoint.identification.algorithm` to `none`.
  * The Consumer Batch APIs `rd_kafka_consume_batch()` and
    `rd_kafka_consume_batch_queue()` are not thread safe if 
    `rkmessages_size` is greater than 1 and any of the **seek**,
    **pause**, **resume** or **rebalancing** operation is performed in
    parallel with any of the above APIs. Some of the messages might be
    lost, or erroneously returned to the application, in the above scenario.
  * It is strongly recommended to use the Consumer Batch APIs and the

• Files Changed
• Browse Source

baserev update by copy to link target

• Files Changed
• Browse Source

- enable RapidJSON integration

• Files Changed
• Browse Source

- update to 1.9.2:
  * Added KIP-768 OUATHBEARER OIDC support (by @jliunyu, #3560)
  * Added KIP-140 Admin API ACL support (by @emasab, #2676)
  * Consumer:
    `rd_kafka_offsets_store()` (et.al) will now return an error for any
    partition that is not currently assigned (through `rd_kafka_*assign()`).
    This prevents a race condition where an application would store offsets
    after the assigned partitions had been revoked (which resets the stored
    offset), that could cause these old stored offsets to be committed later
    when the same partitions were assigned to this consumer again - effectively
    overwriting any committed offsets by any consumers that were assigned the
    same partitions previously. This would typically result in the offsets
    rewinding and messages to be reprocessed.
    As an extra effort to avoid this situation the stored offset is now
    also reset when partitions are assigned (through `rd_kafka_*assign()`).
    Applications that explicitly call `..offset*_store()` will now need
    to handle the case where `RD_KAFKA_RESP_ERR__STATE` is returned
    in the per-partition `.err` field - meaning the partition is no longer
    assigned to this consumer and the offset could not be stored for commit.
  * Improved producer queue scheduling. Fixes the performance regression
    introduced in v1.7.0 for some produce patterns. (#3538, #2912)
  * Windows: Added native Win32 IO/Queue scheduling. This removes the
    internal TCP loopback connections that were previously used for timely
    queue wakeups.
  * Added `socket.connection.setup.timeout.ms` (default 30s).
    The maximum time allowed for broker connection setups (TCP connection as
    well as SSL and SASL handshakes) is now limited to this value.
    This fixes the issue with stalled broker connections in the case of network
    or load balancer problems.
    The Java clients has an exponential backoff to this timeout which is

• Files Changed
• Browse Source

baserev update by copy to link target

• Files Changed
• Browse Source

- update to 1.8.2:
  * Added ssl.ca.pem to add CA certificate by PEM string
  * Upon quick repeated leader changes the transactional producer could receive
    an OUT_OF_ORDER_SEQUENCE error from the broker 
  * The transactional producer could stall during a transaction if the transaction
    coordinator changed

• Files Changed
• Browse Source

baserev update by copy to link target

• Files Changed
• Browse Source

- build against system libraries rather than bundled ones
- enable all features

• Files Changed
• Browse Source

• Files Changed
• Browse Source

- update to 1.8.0:
 * Upgrade bundled zlib version from 1.2.8 to 1.2.11 in the `librdkafka.redist`
   NuGet package. The updated zlib version fixes CVEs:
   CVE-2016-9840, CVE-2016-9841, CVE-2016-9842, CVE-2016-9843
   See https://github.com/edenhill/librdkafka/issues/2934 for more information.
 * librdkafka now uses [vcpkg](https://vcpkg.io/) for up-to-date Windows
   dependencies in the `librdkafka.redist` NuGet package:
   OpenSSL 1.1.1l, zlib 1.2.11, zstd 1.5.0.
 * The upstream dependency (OpenSSL, zstd, zlib) source archive checksums are
   now verified when building with `./configure --install-deps`.
   These builds are used by the librdkafka builds bundled with
   confluent-kafka-go, confluent-kafka-python and confluent-kafka-dotnet.
 * Producer `flush()` now overrides the `linger.ms` setting for the duration
   of the `flush()` call, effectively triggering immediate transmission of
   queued messages. (#3489)
 * Lots of bugfixes, see included CHANGELOG.md for details

• Files Changed
• Browse Source

baserev update by copy to link target

• Files Changed
• Browse Source

- update to 1.7.0:
 * [KIP-360](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=89068820) - Improve reliability of transactional producer.
   Requires Apache Kafka 2.5 or later.
 * OpenSSL Engine support (`ssl.engine.location`) by @adinigam and @ajbarb.
 * Added `connections.max.idle.ms` to automatically close idle broker
   connections.
   This feature is disabled by default unless `bootstrap.servers` contains
   the string `azure` in which case the default is set to <4 minutes to improve
   connection reliability and circumvent limitations with the Azure load
   balancers (see #3109 for more information).
 * Bumped to OpenSSL 1.1.1k in binary librdkafka artifacts.
 * The binary librdkafka artifacts for Alpine are now using Alpine 3.12.
   OpenSSL 1.1.1k.
 * Improved static librdkafka Windows builds using MinGW (@neptoess, #3130).
 * The C++ `oauthbearer_token_refresh_cb()` was missing a `Handle *`
   argument that has now been added. This is a breaking change but the original
   function signature is considered a bug.
   This change only affects C++ OAuth developers.
 * [KIP-735](https://cwiki.apache.org/confluence/display/KAFKA/KIP-735%3A+Increase+default+consumer+session+timeout) The consumer `session.timeout.ms`
   default was changed from 10 to 45 seconds to make consumer groups more
   robust and less sensitive to temporary network and cluster issues.
 * Statistics: `consumer_lag` is now using the `committed_offset`,
   while the new `consumer_lag_stored` is using `stored_offset`
   (offset to be committed).
   This is more correct than the previous `consumer_lag` which was using
   either `committed_offset` or `app_offset` (last message passed
   to application).
  * Bugfixes

• Files Changed
• Browse Source

• Browse Source