Elastic-apm

Features

* Add Python 3.12 support (See Known Issues)
* Collect the `configured_hostname` and `detected_hostname` separately, and switch to FQDN for the `detected_hostname`. [1891]
* Improve postgres dollar-quote detection to be much faster [1905]

Bug fixes

* Fix url argument fetching in aiohttp_client instrumentation [1890]
* Fix a bug in the AWS Lambda instrumentation when `event["headers"] is None` [1907]
* Fix a bug in AWS Lambda where metadata could be incomplete, causing validation errors with the APM Server [1914]
* Fix a bug in AWS Lambda where sending the partial transaction would be recorded as an extra span [1914]

Pending Deprecations

* The log shipping feature in the Flask instrumentation will be removed in version 7.0.0 of the agent.

Known Issues

* Python 3.12.0 has a bug that may cause a segfault with short-lived Client objects. Track the progress of this bug here: https://github.com/python/cpython/issues/111049

New Contributors

* fritzdj made their first contribution in https://github.com/elastic/apm-agent-python/pull/1897
* nbarbey made their first contribution in https://github.com/elastic/apm-agent-python/pull/1890
* alexmojaki made their first contribution in https://github.com/elastic/apm-agent-python/pull/1905
* orsinium made their first contribution in https://github.com/elastic/apm-agent-python/pull/1915

**Full Changelog**: https://github.com/elastic/apm-agent-python/compare/v6.18.0...v6.19.0

<details>
<summary>Elastic APM Python agent layer ARNs</summary>

|Region|ARN|
|------|---|
|af-south-1|arn:aws:lambda:af-south-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ap-east-1|arn:aws:lambda:ap-east-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ap-northeast-1|arn:aws:lambda:ap-northeast-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ap-northeast-2|arn:aws:lambda:ap-northeast-2:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ap-northeast-3|arn:aws:lambda:ap-northeast-3:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ap-south-1|arn:aws:lambda:ap-south-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ap-southeast-1|arn:aws:lambda:ap-southeast-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ap-southeast-2|arn:aws:lambda:ap-southeast-2:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ap-southeast-3|arn:aws:lambda:ap-southeast-3:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|ca-central-1|arn:aws:lambda:ca-central-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|eu-central-1|arn:aws:lambda:eu-central-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|eu-north-1|arn:aws:lambda:eu-north-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|eu-south-1|arn:aws:lambda:eu-south-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|eu-west-1|arn:aws:lambda:eu-west-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|eu-west-2|arn:aws:lambda:eu-west-2:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|eu-west-3|arn:aws:lambda:eu-west-3:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|me-south-1|arn:aws:lambda:me-south-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|sa-east-1|arn:aws:lambda:sa-east-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|us-east-1|arn:aws:lambda:us-east-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|us-east-2|arn:aws:lambda:us-east-2:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|us-west-1|arn:aws:lambda:us-west-1:267093732750:layer:elastic-apm-python-ver-6-19-0:1|
|us-west-2|arn:aws:lambda:us-west-2:267093732750:layer:elastic-apm-python-ver-6-19-0:1|

</details>

Features

* Add support for grpc aio server interceptor [1870]

Bug fixes

* Fix a bug in the Elasticsearch client instrumentation which was causing loss of database context (including statement) when interacting with Elastic Cloud [1878]

New Contributors
* felipou made their first contribution in https://github.com/elastic/apm-agent-python/pull/1870

**Full Changelog**: https://github.com/elastic/apm-agent-python/compare/v6.17.0...v6.18.0

<details>
<summary>Elastic APM Python agent layer ARNs</summary>

|Region|ARN|
|------|---|
|af-south-1|arn:aws:lambda:af-south-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ap-east-1|arn:aws:lambda:ap-east-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ap-northeast-1|arn:aws:lambda:ap-northeast-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ap-northeast-2|arn:aws:lambda:ap-northeast-2:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ap-northeast-3|arn:aws:lambda:ap-northeast-3:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ap-south-1|arn:aws:lambda:ap-south-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ap-southeast-1|arn:aws:lambda:ap-southeast-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ap-southeast-2|arn:aws:lambda:ap-southeast-2:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ap-southeast-3|arn:aws:lambda:ap-southeast-3:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|ca-central-1|arn:aws:lambda:ca-central-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|eu-central-1|arn:aws:lambda:eu-central-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|eu-north-1|arn:aws:lambda:eu-north-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|eu-south-1|arn:aws:lambda:eu-south-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|eu-west-1|arn:aws:lambda:eu-west-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|eu-west-2|arn:aws:lambda:eu-west-2:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|eu-west-3|arn:aws:lambda:eu-west-3:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|me-south-1|arn:aws:lambda:me-south-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|sa-east-1|arn:aws:lambda:sa-east-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|us-east-1|arn:aws:lambda:us-east-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|us-east-2|arn:aws:lambda:us-east-2:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|us-west-1|arn:aws:lambda:us-west-1:267093732750:layer:elastic-apm-python-ver-6-18-0:1|
|us-west-2|arn:aws:lambda:us-west-2:267093732750:layer:elastic-apm-python-ver-6-18-0:1|

</details>

Features
* Add `server_ca_cert_file` option to provide custom CA certificate (1852)
* Add `include_process_args` option to allow users to opt-in to collecting process args (1867)

Bug fixes
* Fix a bug in the GRPC instrumentation when reaching the maximum amount of spans per transaction (1861)

<details>
<summary>Elastic APM Python agent layer ARNs</summary>

|Region|ARN|
|------|---|
|af-south-1|arn:aws:lambda:af-south-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ap-east-1|arn:aws:lambda:ap-east-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ap-northeast-1|arn:aws:lambda:ap-northeast-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ap-northeast-2|arn:aws:lambda:ap-northeast-2:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ap-northeast-3|arn:aws:lambda:ap-northeast-3:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ap-south-1|arn:aws:lambda:ap-south-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ap-southeast-1|arn:aws:lambda:ap-southeast-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ap-southeast-2|arn:aws:lambda:ap-southeast-2:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ap-southeast-3|arn:aws:lambda:ap-southeast-3:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|ca-central-1|arn:aws:lambda:ca-central-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|eu-central-1|arn:aws:lambda:eu-central-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|eu-north-1|arn:aws:lambda:eu-north-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|eu-south-1|arn:aws:lambda:eu-south-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|eu-west-1|arn:aws:lambda:eu-west-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|eu-west-2|arn:aws:lambda:eu-west-2:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|eu-west-3|arn:aws:lambda:eu-west-3:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|me-south-1|arn:aws:lambda:me-south-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|sa-east-1|arn:aws:lambda:sa-east-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|us-east-1|arn:aws:lambda:us-east-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|us-east-2|arn:aws:lambda:us-east-2:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|us-west-1|arn:aws:lambda:us-west-1:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
|us-west-2|arn:aws:lambda:us-west-2:267093732750:layer:elastic-apm-python-ver-6-17-0:1|
</details>


**Full Changelog**: https://github.com/elastic/apm-agent-python/compare/v6.16.2...v6.17.0

Bug Fixes

* Fix compatibility issue with older versions of OpenSSL in lambda runtimes [1847]
* Add `latest` tag to docker images [1848]
* Fix issue with redacting `user:pass` in URLs in Python 3.11.4 [1850]

<details>
<summary>Elastic APM Python agent layer ARNs</summary>

|Region|ARN|
|------|---|
|af-south-1|arn:aws:lambda:af-south-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ap-east-1|arn:aws:lambda:ap-east-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ap-northeast-1|arn:aws:lambda:ap-northeast-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ap-northeast-2|arn:aws:lambda:ap-northeast-2:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ap-northeast-3|arn:aws:lambda:ap-northeast-3:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ap-south-1|arn:aws:lambda:ap-south-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ap-southeast-1|arn:aws:lambda:ap-southeast-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ap-southeast-2|arn:aws:lambda:ap-southeast-2:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ap-southeast-3|arn:aws:lambda:ap-southeast-3:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|ca-central-1|arn:aws:lambda:ca-central-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|eu-central-1|arn:aws:lambda:eu-central-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|eu-north-1|arn:aws:lambda:eu-north-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|eu-south-1|arn:aws:lambda:eu-south-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|eu-west-1|arn:aws:lambda:eu-west-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|eu-west-2|arn:aws:lambda:eu-west-2:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|eu-west-3|arn:aws:lambda:eu-west-3:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|me-south-1|arn:aws:lambda:me-south-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|sa-east-1|arn:aws:lambda:sa-east-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|us-east-1|arn:aws:lambda:us-east-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|us-east-2|arn:aws:lambda:us-east-2:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|us-west-1|arn:aws:lambda:us-west-1:267093732750:layer:elastic-apm-python-ver-6-16-2:1|
|us-west-2|arn:aws:lambda:us-west-2:267093732750:layer:elastic-apm-python-ver-6-16-2:1|

</details>

**Full Changelog**: https://github.com/elastic/apm-agent-python/compare/v6.16.1...v6.16.2

Bugfixes

* Fix release process for docker and the lambda layer [1845]

<details>
<summary>Elastic APM Python agent layer ARNs</summary>

|Region|ARN|
|------|---|
|af-south-1|arn:aws:lambda:af-south-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ap-east-1|arn:aws:lambda:ap-east-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ap-northeast-1|arn:aws:lambda:ap-northeast-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ap-northeast-2|arn:aws:lambda:ap-northeast-2:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ap-northeast-3|arn:aws:lambda:ap-northeast-3:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ap-south-1|arn:aws:lambda:ap-south-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ap-southeast-1|arn:aws:lambda:ap-southeast-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ap-southeast-2|arn:aws:lambda:ap-southeast-2:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ap-southeast-3|arn:aws:lambda:ap-southeast-3:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|ca-central-1|arn:aws:lambda:ca-central-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|eu-central-1|arn:aws:lambda:eu-central-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|eu-north-1|arn:aws:lambda:eu-north-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|eu-south-1|arn:aws:lambda:eu-south-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|eu-west-1|arn:aws:lambda:eu-west-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|eu-west-2|arn:aws:lambda:eu-west-2:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|eu-west-3|arn:aws:lambda:eu-west-3:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|me-south-1|arn:aws:lambda:me-south-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|sa-east-1|arn:aws:lambda:sa-east-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|us-east-1|arn:aws:lambda:us-east-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|us-east-2|arn:aws:lambda:us-east-2:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|us-west-1|arn:aws:lambda:us-west-1:267093732750:layer:elastic-apm-python-ver-6-16-1:1|
|us-west-2|arn:aws:lambda:us-west-2:267093732750:layer:elastic-apm-python-ver-6-16-1:1|

</details>

**Full Changelog**: https://github.com/elastic/apm-agent-python/compare/v6.16.0...v6.16.1

Features

* Add lambda layer for instrumenting AWS Lambda functions [1826]
* Implement instrumentation of Azure Functions [1766]
* Add support for Django to wrapper script [1780]
* Add support for Starlette to wrapper script [1830]
* Add `transport_json_serializer` configuration option [1777]
* Add S3 bucket and key name to OTel attributes [1790]
* Implement partial transaction support in AWS lambda [1784]
* Add instrumentation for redis.asyncio [1807]
* Add support for urllib3 v2.0.1+ [1822]
* Add `service.environment` to log correlation [1833]
* Add `ecs_logging` as a dependency [1840]
* Add support for synchronous psycopg3 [1841]

Bug fixes

* Fix spans being dropped if they don't have a name [1770]
* Fix AWS Lambda support when `event` is not a dict [1775]
* Fix deprecation warning with urllib3 2.0.0 pre-release versions [1778]
* Fix `activation_method` to only send to APM server 8.7.1+ [1787]
* Fix span.context.destination.service.resource for S3 spans to have an "s3/" prefix. [1783]
> *Note*: While this is considered a bugfix, it can potentially be a breaking
change in the Kibana APM app: It can break the history of the S3-Spans / metrics
for users relying on `context.destination.service.resource`. If users happen to
run agents both with and without this fix (for same or different languages), the
same S3-buckets can appear twice in the service map (with and without
s3-prefix).
* Fix instrumentation to not bubble up exceptions during instrumentation [1791]
* Fix HTTP transport to not print useless and confusing stack trace [1809]

New Contributors
* lioman made their first contribution in https://github.com/elastic/apm-agent-python/pull/1778
* gianfrancodemarco made their first contribution in https://github.com/elastic/apm-agent-python/pull/1805
* SylvainJuge made their first contribution in https://github.com/elastic/apm-agent-python/pull/1842
* minhtule made their first contribution in https://github.com/elastic/apm-agent-python/pull/1841

**Full Changelog**: https://github.com/elastic/apm-agent-python/compare/v6.15.1...v6.16.0