Configuration

Amazon Bedrock

Crush currently supports running Anthropic models through Bedrock, with caching disabled.

Here's how:

A Bedrock provider will appear once you have AWS configured, i.e. aws configure
Crush also expects the AWS_REGION or AWS_DEFAULT_REGION to be set
To use a specific AWS profile set AWS_PROFILE in your environment, i.e. AWS_PROFILE=myprofile crush

How is this guide?

Custom Providers

Crush supports custom provider configurations for both OpenAI-compatible and Anthropic-compatible APIs.

Vertex AI

Crush supports running vertex AI platform models.