Skip to content

[Bug]: no billing reported using rerank endpoint and amazon bedrock  #7258

@ladrians

Description

@ladrians

What happened?

I am testing the liteLLM rerank endpoint against bedrock; for us-west-2 region I got access to cohere.rerank-v3-5:0 and amazon.rerank-v1:0. Noticed that no billing is reported; both models the meta section details

Relevant log output

"meta": {
        "billed_units": {},
        "tokens": {}
    }

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

main-v1.55.2

Twitter / LinkedIn details

No response

Metadata

Metadata

Labels

bugSomething isn't workingfeb 2025

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions