Skip to content
This repository has been archived by the owner on May 31, 2023. It is now read-only.

refactor caching #27

Open
jstriebel opened this issue Jan 18, 2019 · 0 comments
Open

refactor caching #27

jstriebel opened this issue Jan 18, 2019 · 0 comments
Labels

Comments

@jstriebel
Copy link
Contributor

jstriebel commented Jan 18, 2019

  • clear cache only for relevant datasets on /data/tiggers/clearCache/<organization_name>/<dataset_name> endpoint
  • configure cache-size based on dataset
    The cache size should depend on:
    • number of datasets
    • per dataset
      • datatype
      • chunk_size
    • Probably it should be one global cache that is aware of the stored sizes.
  • Consider Redis as a cache to enable multiprocessing.
    see https://redis.io/topics/config#configuring-redis-as-a-cache
  • Caches might need to be invalidated if dataset config changes
@jstriebel jstriebel changed the title configure cache-size based on dataset refactor caching Feb 25, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant