Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add get-schema lambda #1793

Merged
merged 2 commits into from
Oct 9, 2023
Merged

Add get-schema lambda #1793

merged 2 commits into from
Oct 9, 2023

Conversation

MatMoore
Copy link
Contributor

@MatMoore MatMoore commented Oct 5, 2023

This is an initial implementation of the lambda that will serve the /data-product/{data-product}/table/{table-name} endpoint. Once this is in, I can define the API gateway part in terraform.

ministryofjustice/modernisation-platform#5155 needs to be merged before this one.

Next steps

This will eventually replace daap-get-glue-metadata, since the source of truth for a schema is now s3, rather than glue. Once this endpoint has been successfully deployed, I will remove daap-get-glue-metadata.

The response is not finalised yet - this endpoint should be consistent with #1194 so we are thinking of simplifying the schema to just the essential parts instead of returning the full glue metadata. (See https://github.com/ministryofjustice/modernisation-platform-environments/blob/dpl-1194-create-table-schema/terraform/environments/data-platform/data-product-table-schema-json-schema/v1.0.0/moj_data_product_table_spec.json).

@MatMoore MatMoore changed the title [WIP] Add get-schema lambda [Do not merge] Add get-schema lambda Oct 5, 2023
@MatMoore MatMoore force-pushed the dpl-1659-display-schema-lambda branch 2 times, most recently from 96d8228 to 281dd49 Compare October 6, 2023 08:54
@MatMoore MatMoore marked this pull request as ready for review October 6, 2023 09:18
@MatMoore MatMoore requested a review from a team October 6, 2023 09:18
This will serve the /data-product/{data-product}/table/{table-name}
endpoint.

This will eventually replace daap-get-glue-metadata, since the source of
truth for a schema is now s3, rather than glue. Once this endpoint has
been successfully deployed, I will remove daap-get-glue-metadata.
@MatMoore MatMoore force-pushed the dpl-1659-display-schema-lambda branch from 281dd49 to da57623 Compare October 6, 2023 14:21
@MatMoore MatMoore changed the title [Do not merge] Add get-schema lambda Add get-schema lambda Oct 6, 2023
@murdo-moj
Copy link
Contributor

This link is useful to check your ECR repo has the image in once you've merged (assume shared services from one of the MP accounts) https://user-guide.modernisation-platform.service.justice.gov.uk/user-guide/member-read-only-core-accounts.html#switching-roles

@LavMatt
Copy link
Contributor

LavMatt commented Oct 9, 2023

Is your plan to merge this returning the fully registered schema, including the information that's probably not very interesting to a user and then refine once my create schema PRs are merged? Looks good other than one minor comment

@MatMoore
Copy link
Contributor Author

MatMoore commented Oct 9, 2023

Is your plan to merge this returning the fully registered schema, including the information that's probably not very interesting to a user and then refine once my create schema PRs are merged? Looks good other than one minor comment

Yeah that's the plan - if I merge it now I can work on the terraform in the meantime

@MatMoore MatMoore merged commit 6a3590b into main Oct 9, 2023
@MatMoore MatMoore deleted the dpl-1659-display-schema-lambda branch October 9, 2023 16:02
@MatMoore MatMoore linked an issue Oct 11, 2023 that may be closed by this pull request
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

APi End point : Display a Table schema
3 participants