Vectorstore Asynchronous Tasks

Celery tasks of the vectorstore app.

• load_vectorstore_document(): split, embed and load a document. Queued when a document is added.

• delete_vectorstore_document(): remove a document’s chunks, then the document.

• snapshot_vectorstore(): take a snapshot, or backup, on request.

• reconcile_vectorstores(): Celery Beat, every few minutes. Bring deployed vectorstores to ready, e.g. create a self-hosted server’s collection once it has started, and record their status and statistics.

• maintain_vectorstores(): Celery Beat, hourly. Take snapshots on each manifest’s schedule, prune them to its retention, and queue documents whose task was lost again.