-
-
Notifications
You must be signed in to change notification settings - Fork 11
feat: OpenSearch RAG demo #354
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
6f40f70 to
8c1beee
Compare
razvan
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Very nice. I didn't run the script to generate embeddings to the end but it ran fine. The demo also works.
Technically we could have a custom image with ollama, the models and our embeddings already prepared. This would reduce the amount of additional artifacts that need to be downloaded when running the demo and also simplify things.
|
Should this have release notes? |
I've added a release notes snippet to the PR description. |
Adds a new demo that shows Retrieval Augmented Generation with OpenSearch
Stack:
Data
The data file should be regenerated after each Stackable release to ensure no outdated documentation is used in the demo. This process can take more than 1 hour and is also the reason why the data is commited to git and not generated during demo installation.
Note for reviewers: You need to change the
branchparameter tofeat/opensearch-rag-demoin the stacks and demos files to deploy the demo. Depending on the hardware the demo should run on your local machine, but a kind cluster on Replicated with a singler1.xlargenode works best.Release Notes
Added a new demo that shows Retrieval Augmented Generation (RAG) with OpenSearch as vector store.