Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

picklebase #638

Merged
merged 3 commits into from
May 21, 2020
Merged

picklebase #638

merged 3 commits into from
May 21, 2020

Conversation

jmensch1
Copy link
Contributor

@jmensch1 jmensch1 commented May 21, 2020

The picklecache was a file-based replacement for Redis. Picklebase is essentially a file-based replacement for Postgres.

This code doesn't do anything unless the PICKLEBASE environment variable is set to 1, in which case all queries, except the pin-detail query, get their data from the filesystem instead of from the database. If the env var isn't set, queries go to the database as usual.

There are definitely some details to be ironed out here, but I'm just curious to see if it works first.

update: it looks like we have 273 gigs of storage in the /tmp filesystem:

tmp

So I moved all the files in there.

  • Up to date with dev branch
  • Branch name follows guidelines
  • All PR Status checks are successful
  • Peer reviewed and approved

Any questions? See the getting started guide

@jmensch1 jmensch1 requested a review from adamkendis May 21, 2020 04:02
@jmensch1 jmensch1 added this to the 311-Data - Beta milestone May 21, 2020
Copy link
Member

@adamkendis adamkendis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, interested to see how this turns out vs postgres.

@adamkendis adamkendis merged commit f486549 into dev May 21, 2020
@adamkendis adamkendis deleted the BACK-PickleBase branch May 21, 2020 19:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants