Sentence transformers library -
( )
offers pretrained transformers that produce SOTA sentence embeddings
use → distilbert-base-nli-stsb-mean-tokens : best performance on
Semantic Textual Similarity
tasks
main things is producing embeddings, so different models are trained to produce embeddings in a way that they see fitFaiss -
library of similarity search + clustering of dense vectors
( helps in comparing vectors with high efficiency)