New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Call external index function and import created index file on BuildIndex if external=true #298

Open

var77 wants to merge 4 commits into main from varik/direct-external-index

Collaborator

var77 commented Mar 18, 2024 •

edited

Added new option to index bool external
If external is true we will call _create_external_index function from lantern_extras
The multicore index creation will be done in Rust side, index will be saved in file and file path will be returned from the function
We will then use the file path as _experimental_index_path option in our BuildIndex function to import that file

var77 added 2 commits

March 19, 2024 02:23


          Call external index function and import created index file on BuildIn…

d9e0cd0

…dex if external=true


          Add test for CREATE index with external=true

4a5235e

var77 marked this pull request as ready for review

March 19, 2024 11:39


          Use sift10k dataset for extras tests

7f5923d

var77 requested a review from Ngalstyan4

March 19, 2024 18:52


          Rename external to parallel

0eb8936

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment