Skip to content

馃 feat: AWS Bedrock embeddings support - #75

Merged
danny-avila merged 6 commits into
mainfrom
feat/bedrock
Sep 27, 2024
Merged

danny-avila merged 6 commits into
mainfrom
feat/bedrock

Conversation

@FinnConnor

Copy link
Copy Markdown
Contributor

Added bedrock embeddings support. Need to set env variables 1) AWS_ACCESS_KEY 2) AWS_SECRET_ACCESS_KEY 3) EMBEDDINGS_PROVIDER=bedrock and optionally 3) AWS_DEFAULT_REGION 4)EMBEDDINGS_MODEL (default: amazon.titan-embed-text-v1)

Tested using pgvector vector storage with bedrock embedding provider with model amazon.titan-embed-text-v1 through rag docker image.

  1. Successfully uploaded and embedded a small text file
  2. Successfully performed query search returning relevant documents.

@FinnConnor FinnConnor self-assigned this Sep 24, 2024
@FinnConnor FinnConnor linked an issue Sep 25, 2024 that may be closed by this pull request
@FinnConnor

Copy link
Copy Markdown
Contributor Author

Tested amazon.titan-embed-text-v2:0 text embedding model through bedrock using pgvector as vector store. Used docker

  1. Upload text document and embed into vector storage.
  2. Verify able to query relevant documents.

@FinnConnor

FinnConnor commented Sep 27, 2024 •

Copy link
Copy Markdown
Contributor Author

For AWS credentials named env variables:

AWS_DEFAULT_REGION
AWS_ACCESS_KEY_ID
AWS_SECRET_ACCESS_KEY

Two possible changes to consider , adding AWS_SESSION_TOKEN as needed (optional), also prefixing 'BEDROCK' to all env variables.

@danny-avila danny-avila changed the title AWS Bedrock embeddings support 馃 feat: AWS Bedrock embeddings support Sep 27, 2024
@danny-avila
danny-avila merged commit f21b6e7 into main Sep 27, 2024
dirkpetersen pushed a commit to dirkpetersen/rag_api that referenced this pull request Aug 23, 2025
* "WIP: adding bedrock embeddings"

* WIP: feat bedrock embeddings support

* feat: aws bedrock embeddings support

* refactor: update aws region var name

* docs: update env variables documentation for bedrock

* docs: add bedrock embeddings provider in list
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Adding bedrock embedding model support

2 participants