Use Embeddings

[bnonni]

Is your feature request related to a problem? Please describe.
Right now, messages are stored in a .jsonl file on the server which doesn't scale long term.
Need to migrate to a DB solution of some kind.

Describe the solution you'd like
Design decisions for DB

1. local or hosted or combo
2. DB type: sql or nosql or vector

=> Use a hosted pinecone DB storing embeddings for ease and speed

Describe alternatives you've considered
Functional Req:

• Setup hosted pinecone DB
• Connect it to app
• Turn text into embeddings
• Store embeddings in hosted pinecone DB
  Nonfunc Req (stretch):
• Store some amount of embeddings locally and redundantly in hosted DB

Additional context
Figure out how to use embeddings (i.e. vector data embeddings)

• https://platform.openai.com/docs/api-reference/embeddings/object
• https://platform.openai.com/docs/guides/embeddings/use-cases
• https://docs.pinecone.io/docs/overview
• https://docs.pinecone.io/docs/python-client