Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lambda Layer appears to have been made unavailable #462

Closed
alexander-chi opened this issue Apr 25, 2024 · 6 comments
Closed

Lambda Layer appears to have been made unavailable #462

alexander-chi opened this issue Apr 25, 2024 · 6 comments
Labels
aws-λ-extension AWS Lambda Extension bug Something isn't working community Issues and PRs created by the community triage Issues and PRs that need to be triaged

Comments

@alexander-chi
Copy link

APM AWS Lambda extensiom version (apm-aws-lambda version):
arn:aws:lambda:eu-west-2:267093732750:layer:elastic-apm-extension-ver-1-5-3-x86_64:1

Describe the bug
When deploying functions using the above layer, we now receive the following error:

Resource handler returned message: "Layer version arn:aws:lambda:eu-west-2:267093732750:layer:elastic-apm-extension-ver-1-5-3-x86_64:1 does not exist. (Service: Lambda, Status Code: 400

To Reproduce
Steps to reproduce the behavior:

  1. Deploy a function using the above lambda layer using CDK

Expected behavior
The layer in the release notes should exists

Provide logs (if relevant):

@alexander-chi alexander-chi added the bug Something isn't working label Apr 25, 2024
@github-actions github-actions bot added aws-λ-extension AWS Lambda Extension community Issues and PRs created by the community triage Issues and PRs that need to be triaged labels Apr 25, 2024
@Gawne
Copy link

Gawne commented Apr 25, 2024

We've noticed this and it's causing issues with production workloads. Version number still being recommended in docs - https://www.elastic.co/guide/en/apm/agent/python/current/lambda-support.html

@andrewbwhittle
Copy link

Same here.

@alexander-chi
Copy link
Author

The quick fix for us has been to just drop the layers all together and revert to calling APM start

@alexander-chi
Copy link
Author

It also appears that the 1.5.2 layers are still available, so reverting to those also works

@dmathieu
Copy link
Member

Thank you for reporting this.
It appears we had some workflow issues, where the release process ran again on newer commits, which deleted the layer and broke your versions.

Unfortunately, due to how lambda's releases work, we cannot fix the 1.5.3 layer, as any new layer would be tagged version 2.
We are contacting AWS's support to try undeleting the layer, but there's no guarantee they can do that.

So we have decided to release 1.5.4 on 1980cea, the same commit as 1.5.3.
So upgrading should be a noop and allow a fix of the layers.

Please let us know if that does fix your issue.

@Gawne
Copy link

Gawne commented Apr 26, 2024

Thanks for the update @dmathieu. We'll upgrade and let you know how it goes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
aws-λ-extension AWS Lambda Extension bug Something isn't working community Issues and PRs created by the community triage Issues and PRs that need to be triaged
Projects
None yet
Development

No branches or pull requests

4 participants