PilotANN: A Hybrid CPU-GPU System For Graph-based ANNS

PilotANN: A Hybrid CPU-GPU System For Graph-based ANNS

Approximate Nearest Neighbor Search (ANNS) is a fundamental vector search technique that efficiently identifies similar items in high-dimensional vector spaces. Traditionally, ANNS has served as the backbone for retrieval engines and recommendation systems, however, it struggles to keep pace with modern Transformer architectures that employ higher-dimensional embeddings and larger datasets. Unlike deep learning systems that can be horizontally s…