Skip to content

Add Milvus vector database support #6367

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

hemanthrayuduu
Copy link

Description

This PR adds support for Milvus as a document engine option in RAGFlow, alongside the existing Elasticsearch and Infinity options.

Changes

  • Created Milvus connector class in rag/utils/milvus_conn.py
  • Added Milvus mapping configuration in conf/milvus_mapping.json
  • Updated settings to include Milvus in api/settings.py
  • Added Milvus services to Docker Compose configuration
  • Added Milvus environment variables to .env file
  • Updated service configuration template
  • Added PyMilvus as a dependency in pyproject.toml
  • Updated documentation to include Milvus configuration information

Testing

  • Created unit tests for the Milvus implementation
  • Verified all configuration files contain the necessary Milvus settings
  • Tested the basic structure and functionality of the implementation

Related Issue

Closes #6359

@yingfeng
Copy link
Member

Thanks for the contribution, however, Milvus can not satisfy the requirements of RAGFlow due to poor support for full text search. Actually, sparse embedding is not an alternative for full text search, there are many features can not being supported including:
Phrase search
Rank features
...,etc

@KevinHuSh KevinHuSh added 📖 documentation Improvements or additions to documentation 💞 feature Feature request, pull request that fullfill a new feature. 🌈 python Pull requests that update Python code size:L This PR changes 100-499 lines, ignoring generated files. labels Mar 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
📖 documentation Improvements or additions to documentation 💞 feature Feature request, pull request that fullfill a new feature. 🌈 python Pull requests that update Python code size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature Request]: support milvus
4 participants