Timezone: »

Practical Vector Search (Big ANN) Challenge 2023
Harsha Vardhan Simhadri · Martin Aumüller · Dmitry Baranchuk · Matthijs Douze · Edo Liberty · Amir Ingber · Frank Liu · George Williams

Sat Dec 16 07:00 AM -- 10:00 AM (PST) @ Room 356
Event URL: https://big-ann-benchmarks.com/neurips23.html »

We propose a competition to encourage the development of indexing data structures and search algorithms for the Approximate Nearest Neighbor (ANN) or Vector search problem in real-world scenarios. Rather than evaluating the classical uniform indexing of dense vectors, this competition proposes to focus on difficult variants of the task. Optimizing these variants is increasingly relevant as vector search becomes commonplace and the "simple" case is sufficiently well addressed. Specifically, we propose the sparse, filtered, out-of-distribution and streaming variants of ANNS.These variants require adapted search algorithms and strategies with different tradeoffs. This competition aims at being accessible to participants with modest compute resources by limiting the scale of the datasets, normalizing on limited evaluation hardware, and accepting open-source submissions to only a subset of the datasets.This competition will build on the evaluation framework https://github.com/harsha-simhadri/big-ann-benchmarksthat we set up for the billion-scale ANNS challenge https://big-ann-benchmarks.com of NeurIPS 2021.

Author Information

Harsha Vardhan Simhadri (Microsoft Research)
Martin Aumüller (IT University of Copenhagen)
Dmitry Baranchuk (MSU / Yandex)
Matthijs Douze (Facebook AI Research)
Edo Liberty (Pinecone)
Amir Ingber (Pinecone)
Frank Liu (Ziliz)
George Williams (big-ann-benchmarks)

More from the Same Authors