Vearch

Overview: Gamma supports three storage types: RocksDB, MemoryOnly, and Mmap. v3.2.7 mainly modifies and optimizes Mmap. The specific modifications are as follows:

1.Use a unified way to store vectors and scalars;
2.Use cache to improve query performance;
3.Reduce scalar memory usage;
4.Supports dynamic modification of the cache size, and flexible storage and retraction of memory;
5.Fix the occasional inaccurate query of scalar index
6.Support raft snapshot

1、Master API move to router，master can replace by etcd server。 need open config ： master_merge_into_router。
2、Add search current limit function
3、Optimize loading logic
4、Replace faiss hnsw by hnswlib
5、Support the multiple retrieval models

1. The new interfaces of gamma engine retrieval model, ivfpq, ivfflat, ivfbinary and hnsw are all changed to the new interfaces.
2. Router, PS reconstruction: json changed to protobuf; Insert and search performance improved; Router added grpc interfaces.
3. Original vector compression, table string compression.
4. Master and etcd are separated, and the Master service supports automatic service discovery, query data node automatically shielded from accessing the failed node.

1. Support real time HNSW index
2. Support binary index
3. Support IVFFLAT index
4. Fix bugs