Vector Store with Chroma in Anvil

[ianb]

Someone else was using langchain and had a problem with chromadb a few months ago :

OSError: [Errno 30] Read-only file system " .chroma"

[image] [image] I think this should be chroma = Chroma(persist_directory="/tmp/.chroma") instead of db_path=, but I am unsure if this really needs to be inside a with context block any longer. …or really if this will even work the way that you want, since if more than one user is using your site at the same time they would be sharing the same temporary file, which could cause aberrant behaviour.

…might be useful, but I’m not entirely sure. I wrote some throwaway concepts about using ephemeral random tempfile names so that two users would not be using the same DB if you did not want them to.

And yes, it looks like you already figured out that the directories in data files do not exists unless there is a path with a file in it. It uses a column of paths in a table to make the directories, so if no file exists, no directory exists either.

This clone in this post:

Create Any Arbitrarily Large PDF w/ clone link (paid tier features)

Inspired from this FR by @stefano.menci : I created this example app, it takes any list of forms, and if they can be rendered within the individual time limit of one call to anvil.pdf.PDFRenderer, aggregates them all using the new anvil data_files service and then combines them using PyPDF2 which is already available on the paid plan. You would also need the paid plan to use the data_files service. (**see below) It also takes a list of tuples in the format of ('form_name', args, kwargs) so …

Has some server module code that lets you write new files directly to the data files service, if they still have not built that into the anvil server (it was marked TODO: as of a year ago )