Enable users to visualise CaDeT datasets in QuickSight

[simon-pope]

Brief summary of what this Epic is

This epic covers the work required to speed up making CaDeT data available for visualisation in QuickSight. This will use LakeFormation. This approach should make ~40% of AP data available for visualisation within QuickSight.

CaDeT data has been selected as its output all lives in one bucket and it is structured in such a way that a Glue Crawler should be able to reconstruct the metadata from bucket contents, removing the need for copying/moving the metadata too.

Acceptance Criteria
This epic will be complete when:

1. User able to access QuickSight from within Control Panel
2. User is able to create datasources from CaDeT data
3. Users’ CaDeT permissions are replicated into QuickSight without additional work for user or AP
4. User with permissions on CaDeT data can visualise it using QS

Source document: QS next steps (author:Julia Lawrence)

List of issues in this epic

• Set up user permissions - 📖 Synchronise Permissions between LakeFormation and DEDA for mojap-derived-tables bucket #5600
• Replicate CaDeT bucket - 📖 Implement Replication for mojap-derived-tables bucket into APC Ireland #5599
• Users - 📖 Synchronise Permissions between LakeFormation and DEDA for mojap-derived-tables bucket #5600
• Metadata - 🕸 Register CaDeT tables in APC Glue catalog so the data can be queried #5859 and 🔱 Productionise Glue Copy Metadata script #6133
• Embed QS in to Control Panel - 🧐 Embed AP Compute Quicksight within Control Panel #5532
• QuickSight Guidance and Documentation - 📖 QuickSight Guidance and Documentation #5783

Other information

• Roadmap deliverable - New Feature
• Target delivery date January '24