This post is from 2024 but I wrote about using this technique in https://emschwartz.me/binary-vector-embeddings-are-so-cool/
int8s, float16s are all fairly slow. I suppose it’s because BLAS does float32/64 very fast.
emschwartz•24m ago
This post is from 2024 but I wrote about using this technique in https://emschwartz.me/binary-vector-embeddings-are-so-cool/
softwaredoug•17m ago
int8s, float16s are all fairly slow. I suppose it’s because BLAS does float32/64 very fast.