I was playing around doing the same thing today but using Pinecone [1] as a vector store. Some other folks were experimenting with building key-value stores at the Scale AI hackathon this weekend [2]

[1] https://www.pinecone.io/

[2] https://twitter.com/sjwhitmore/status/1617318051455840258