FAISS, Up Close: Fast Similarity Search For The Vector Age Every modern AI product has one quiet workhorse: finding the nearest neighbors of a vector fast. FAISS is the library many of us reach for when the dataset gets large and latency matters. Built at Met... ANN cuVS faiss GPU Meta AI vector search
BitNet: 1-bit LLMs Land With Practical Inference on CPUs and GPUs BitNet from Microsoft Research is the official C++ inference stack for native 1-bit large language models, centered on BitNet b1.58. The repo ships fast, lossless ternary kernels for CPUs, a CUDA W2A8... 1-bit LLM BitNet CPU GGUF GPU inference llama.cpp quantization T-MAC