fix bedrock inference region

[wbrijesh]

The Claude 3.5 Sonnet v2 model doesn't work unless I SSH into the container and update this line to the US inference profile ID

If I don't change this then I get error saying:

Error code: 400 - {'message': 'Invocation of model ID anthropic.claude-3-5-sonnet-20241022-v2:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.'}

[baryhuang]

It's a blocker for me to use bedrock as well.

[wbrijesh]

@buryhuang try manually editing the loop.py file until a change is made in the docker image