Confluent-kafka-helpers

Decrease consumer queue sizes to avoid large memory usage in all services using this lib

Reduce the default fetch request interval for kafka consumers. The purpose is to reduce network traffic and GCP costs.
In time critical services (Inventory, Accounting) we must override the configuration for fetch.wait.max.ms. 10 ms is a good value to start with for time critical services.

- Improved transient error handling https://github.com/fyndiq/confluent_kafka_helpers/pull/30
- Fix PEP-479 https://github.com/fyndiq/confluent_kafka_helpers/pull/30
- Don't pin requirements https://github.com/fyndiq/confluent_kafka_helpers/pull/30

* Use confluent-python-kafka 011.4.
* Set `max.in.flight` to 1 to ensure safer produce operations.

AvroLazyConsumer implementation.

Load messages from repository 10x faster

Fixed a problem uploading metrics to datadog in some cases. See for example https://sentry.io/fyndiq-global/article-handler-service/issues/457988805/.