-
Notifications
You must be signed in to change notification settings - Fork 649
Add RAG with Milvus, LangChain & Anthropic Claude notebook #1565
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Add RAG with Milvus, LangChain & Anthropic Claude notebook #1565
Conversation
Signed-off-by: Jael Gu <[email protected]>
Signed-off-by: CheneyZhang <[email protected]>
Signed-off-by: ChengZi <[email protected]>
Signed-off-by: ChengZi <[email protected]>
Signed-off-by: ChengZi <[email protected]>
Signed-off-by: ChengZi <[email protected]>
Signed-off-by: ChengZi <[email protected]>
Signed-off-by: ChengZi <[email protected]>
Signed-off-by: ChengZi <[email protected]>
Signed-off-by: ShawnZheng <[email protected]>
Signed-off-by: ChengZi <[email protected]>
Signed-off-by: ChengZi <[email protected]>
- Complete RAG pipeline implementation using Milvus vector database - Integration with LangChain framework for document processing - Anthropic Claude for response generation - Modular design with configurable components - Support for PDF and text document processing - Interactive query sessions and utility functions - Comprehensive setup instructions and examples
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: behroozazarkhalili The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Welcome @behroozazarkhalili! It looks like this is your first PR to milvus-io/bootcamp 🎉 |
@@ -0,0 +1,1168 @@ | |||
{ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Note: If the repository is private, you'll need to make it public for the Colab badge to work, or manually upload the notebook to Colab.
We can remove this line :)
Reply via ReviewNB
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
made it public.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Change repository visibility
For security reasons, you cannot change the visibility of a fork.
I removed the colab badge.
@@ -0,0 +1,1168 @@ | |||
{ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Line #26. connections.connect("default", host=self.host, port=self.port)
This is deprecated API. Recommend to use MilvusClient(). Also it's suggested to use endpoint that composes the host and port for initializing MilvusClient()
Reply via ReviewNB
@@ -0,0 +1,1168 @@ | |||
{ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Line #14. print("📝 Expected files: ai_overview.txt, vector_databases.txt, rag_systems.txt")
Where do they get such expected files?
Reply via ReviewNB
- Replace deprecated connections.connect() with MilvusClient(uri=endpoint) - Implement URI endpoint composition pattern for MilvusClient initialization - Update MilvusVectorStore class to use modern MilvusClient methods - Simplify schema creation using MilvusClient's streamlined approach - Fix vector search by adding anns_field parameter specification - Add proper resource cleanup with client.close() method - Remove deprecated utility imports and Collection-based operations - Ensure compatibility with current Milvus Python SDK
- Enhanced API key configuration with environment variable fallback - Improved error handling and resource management - Added comprehensive setup instructions and prerequisites - Included detailed Milvus installation guide with Docker commands - Enhanced modular architecture with better separation of concerns - Added support for both sample documents and PDF processing workflows - Improved logging and debugging capabilities - Added interactive session functions with better user experience - Enhanced documentation with step-by-step explanations - Optimized vector search and embedding generation processes
bf9869d
to
b043afa
Compare
7fd4303
to
a6d3789
Compare
Summary
This PR adds a comprehensive RAG (Retrieval-Augmented Generation) notebook that demonstrates how to build an end-to-end RAG system using:
Features
File Structure
Testing
This notebook provides a production-ready foundation for developers looking to implement RAG systems with Milvus and Anthropic Claude.