[COST-5252] cache schema/table exists

[maskarb]

Jira Ticket

COST-5252

Description

This change will cache the result of the schema and table lookup in trino.

Testing

1. clean db and redis cache:

$ make delete-test-customer-data; make delete-testing; make delete-trino-data; make delete-redis-cache

2. with a clean db, open a shell with access to redis:

$ REDIS_HOST=localhost make shell

3. import the get-from-cache func and check the cache for the key (it should not be in cache):

>>> is_key_in_cache('schema-exists-trino-org1234567')
False

4. ingest data:

$ make create-test-customer; make load-test-customer-data test_source=ONPREM

5. once done, check the cache again. Key should be available and the value is True:

>>> is_key_in_cache('schema-exists-trino-org1234567')
True
>>> get_value_from_cache('schema-exists-trino-org1234567') 
True

6. Check for some table keys and values:

>>> get_value_from_cache('table-exists-trino-org1234567-openshift_pod_usage_line_items_daily')
True
>>> get_value_from_cache('table-exists-trino-org1234567-openshift_pod_usage_line_items')
True
>>> get_value_from_cache('table-exists-trino-org1234567-openshift_storage_usage_line_items_daily')
True
>>> get_value_from_cache('table-exists-trino-org1234567-openshift_storage_usage_line_items')
True
>>> get_value_from_cache('table-exists-trino-org1234567-openshift_node_labels_line_items_daily')
True
>>> get_value_from_cache('table-exists-trino-org1234567-openshift_node_labels_line_items')
True
>>> get_value_from_cache('table-exists-trino-org1234567-openshift_namespace_labels_line_items_daily')
True
>>> get_value_from_cache('table-exists-trino-org1234567-openshift_namespace_labels_line_items')
True

Release Notes

• proposed release note

* [[COST-5252](https://issues.redhat.com/browse/COST-5252)] cache schema/table exists

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.1%. Comparing base (cc5a954) to head (922804d).

Additional details and impacted files

@@          Coverage Diff          @@
##            main   #5213   +/-   ##
=====================================
  Coverage   94.1%   94.1%           
=====================================
  Files        371     371           
  Lines      30901   30927   +26     
  Branches    4540    4542    +2     
=====================================
+ Hits       29074   29104   +30     
+ Misses      1165    1163    -2     
+ Partials     662     660    -2