[Feature]: Log Amazon Bedrock response headers

[Manouchehri]

The Feature

Similar to how OpenAI, Azure OpenAI, and Anthropic have their response headers logged in Langfuse, it would be great if Amazon Bedrock calls also had their response headers logged.

Motivation, pitch

This would be useful in troubleshooting failed requests.

Twitter / LinkedIn details

https://www.linkedin.com/in/davidmanouchehri/

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[ishaan-jaff]

not stale

For this ticket the following should be done:

• Translate bedrock headers to OpenAI spec
• Return rate limit headers in response
• Log the headers on langfuse, like we do for OpenAI, Anthropic

[madhukar01]

I'll take this up

[madhukar01]

I implemented the changes according to API spec mentioned here: https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html (an converse APIs)

I dont see any headers in response except x-amzn-requestID
Even when the requests are being rate limited

Can you please help me with some scenarios or setup suggestions to test? @ishaan-jaff

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[rachitchauhan43]

@ishaan-jaff : What about GCP Vertex ?