Advice for securely uploading a large dataset

Hi all,

Suppose I have to allow a user to upload a file into a data table as a media object (in this case it is a spreadsheet). What is the best way to do this given that the file is sort of large (2.1MB)?

Once stored in the data table, I will need to process it with Pandas and eventually send some data back to the client to display.

I can use the File Uploader but I was wondering if that means the large data set would then be visible on the client side and need to be passed (potentially slowly) to the server side.

Any help is much appreciated.

I think the FileUploader is the right choice. The file will be available to the client code while it’s in the FileLoader - but that’s OK, because by definition the user who’s uploading the file already has it!

The crucial thing is not to give access to the file to anyone else who shouldn’t have it. If it’s in a Data Table, then you need to make sure no-one can see that table row who shouldn’t have access to it (so make sure the table is set to “no access from client”, and that your server modules either never return it to client code, or only return it to appropriately authorised users).

Does that make sense?

Thanks @meredydd that makes perfect sense.

A post was split to a new topic: Server timeout when uploading file