We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I've use FAISS with Datasets and save to FAISS.
Then load to save FAISS then no error, then ds to None
ds.load_faiss_index('embeddings', 'my_index.faiss')
ds_with_embeddings = ds.map(lambda example: {'embeddings': model(transforms(example['image']).unsqueeze(0)).squeeze()}, batch_size=64) ds_with_embeddings.add_faiss_index(column='embeddings') ds_with_embeddings.save_faiss_index('embeddings', 'index.faiss')
Add column in Datasets.
Google Colab, SageMaker Notebook
The text was updated successfully, but these errors were encountered:
Hello,
I'm not sure I understand. The return value of ds.load_faiss_index is None as expected.
ds.load_faiss_index
I see that loading an Index on a dataset that doesn't have an embedding column doesn't raise an Issue. Is that the issue?
embedding
So ds doesn't have an embedding column, but we load an index that looks for it. But this will raise an issue only when calling ds.search.
ds
ds.search
Sorry, something went wrong.
No branches or pull requests
Describe the bug
I've use FAISS with Datasets and save to FAISS.
Then load to save FAISS then no error, then ds to None
Steps to reproduce the bug
1.
2.
Expected behavior
Add column in Datasets.
Environment info
Google Colab, SageMaker Notebook
The text was updated successfully, but these errors were encountered: