Convert Google Sheets to Tables

[zielinski.mark]

Hi,

I have a Google Sheet that I am using like a (read-only) database - columns and rows of data that get read in when the app is initialized and then I use that in the app. It is convenient for testing and making quick changes, however this causes slowdowns in the app on slower connections.
What is the easiest way to convert my “Google Sheets” system to use Database Tables instead of loading in the data from Google each time the app loads?

thanks

[ianb]

You could dump the sheets to csv and use this app that I made that you can clone:

CSV to Anvil Data Tables For Beginners with Full Example App

https://anvil.works/build#clone:Z4O2BXJEL6TVJ4QK=2LL4HNW3TZQAG7FICS57W6JN [csvexample] I see many new anvil users struggling to load data sets into the data tables for the first time without having an example of how to avoid abusing the free resources while still loading your use case sample data under the 30 second limit provided by the server modules. So I created this full example app. Feel free to clone it and use it for testing, reference, ideas, or anything else. It is not fast. That’…

It lets you auto-create the columns and select data types. Similar to something like phpmyadmin.
You can create custom parsers as well.

[zielinski.mark]

I tried using it by changing the Separator to pipe (|) however it didn’t separate it properly, just put everything into a single column. Looking at the source code it seems that changing this value doesn’t change anything in the app yet? Unfortunately I wasn’t able to use it for my purposes.

I have a spreadsheet where individual cells have multiple values in them separate by commas, so I’m unable to create a “true” CSV where the columns are separated by commas.
I tried using the method in the Anvil Docs, but I get some kind of C error thrown by pandas:

ParserError: Error tokenizing data.  C error: Expected 24 fields in line 45, saw 53.

[ianb]

Hey @zielinski.mark , sorry I was out of town for a week.

Could you post (or DM me if you can’t) the first 3 lines of your csv file? I will take a look at it if you would like.

[zielinski.mark]

Thanks, I finally managed to get it imported with a bit of trial and error. I am still working on getting more performance out of the app, though. I thought moving away from Google Sheets would make a significant difference, but it was not as great as I assumed it would be. I am thinking it must be related to the server runtime starting up?