Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request]: Support sparse vector #1174

Open
1 task done
JinHai-CN opened this issue May 7, 2024 · 0 comments
Open
1 task done

[Feature Request]: Support sparse vector #1174

JinHai-CN opened this issue May 7, 2024 · 0 comments
Assignees
@small-turtle-1
Labels
feature request New feature or request

Comments

@JinHai-CN
Copy link
Contributor

JinHai-CN commented May 7, 2024 •
edited

Is there an existing issue for the same feature request?

  • I have checked the existing issues.

Describe the feature you'd like

At present, our system uses a dense representation for vector storage. I would like to propose a feature request for the implementation of a sparse vector index within infinity. Sparse vector indexing is crucial for efficiently handling high-dimensional data, which is common in our use cases involving natural language processing and machine learning.
@JinHai-CN JinHai-CN added the feature request New feature or request label May 7, 2024
@JinHai-CN JinHai-CN mentioned this issue May 7, 2024
Open
33 tasks
@JinHai-CN JinHai-CN mentioned this issue May 23, 2024
Closed
@small-turtle-1 small-turtle-1 mentioned this issue May 28, 2024
Merged
2 tasks
JinHai-CN pushed a commit that referenced this issue May 28, 2024
@small-turtle-1
Simple Sparse vector support. (#1249)
0171896 
### What problem does this PR solve?

1. Create table with sparse vector column
2. Insert sparse vector
3. Import sparse vector with csv format.

Issue link:#1174

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Test cases
@small-turtle-1 small-turtle-1 mentioned this issue May 28, 2024
Merged
4 tasks
JinHai-CN pushed a commit that referenced this issue May 29, 2024
@small-turtle-1
Add more support to sparse vector. (#1251)
10b01a9 
### What problem does this PR solve?

1. Fix bug: cross chunk sparse vector
2. Add: support import from jsonl & csr file
3. Add: integer data type to sparse vector type.
4. Refactor: embedding value type.

TODO:
1. add bit data type support to sparse vector type.
2. Sparse vector index impl and test.

Issue link:#1174

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] New Feature (non-breaking change which adds functionality)
- [x] Refactoring
- [x] Test cases
@small-turtle-1 small-turtle-1 mentioned this issue May 29, 2024
Merged
2 tasks
JinHai-CN pushed a commit that referenced this issue May 29, 2024
@small-turtle-1
Add more support to sparse vector. (#1254)
35e08f9 
### What problem does this PR solve?

1. Add: bit data type to sparse vector.
2. Add: default value to sparse vector.
3. Add: empty sparse vector
4. Test: more test case.

Issue link:#1174

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Test cases
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@small-turtle-1 small-turtle-1

Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@JinHai-CN @small-turtle-1