vector search

 
Sentence transformers library - ( ) offers pretrained transformers that produce SOTA sentence embeddings use → distilbert-base-nli-stsb-mean-tokens : best performance on Semantic Textual Similarity tasks main things is producing embeddings, so different models are trained to produce embeddings in a way that they see fit
 
Faiss - library of similarity search + clustering of dense vectors
( helps in comparing vectors with high efficiency)