Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Schema checking for tables #37

Open
lars-reimann opened this issue Nov 24, 2021 · 0 comments
Open

Schema checking for tables #37

lars-reimann opened this issue Nov 24, 2021 · 0 comments
Labels
dsl 🗒️ Issues regarding the domain specific programming language enhancement 💡 New feature or request
Milestone

Comments

@lars-reimann
Copy link
Member

lars-reimann commented Nov 24, 2021

Is your feature request related to a problem? Please describe.

When accessing columns of a table, we may need to check

  1. whether a column with the given name exists,
  2. whether the column has a compatible type.

Describe the solution you'd like

Polars has a method collect_schema to compute the schema of a DataFrame or LazyFrame. We may, hence, generate code to fetch the schema of a Table from the runner in the background. Once the information is available, we can run further checks without running code.

The schema checks themselves can be described as constraints in the stub language.

@lars-reimann lars-reimann added enhancement 💡 New feature or request dsl 🗒️ Issues regarding the domain specific programming language labels Nov 24, 2021
@lars-reimann lars-reimann self-assigned this Nov 24, 2021
@lars-reimann lars-reimann transferred this issue from another repository Jun 7, 2022
@lars-reimann lars-reimann removed their assignment Nov 9, 2022
@lars-reimann lars-reimann removed this from Safe-DS Nov 9, 2022
@lars-reimann lars-reimann added this to DSL Mar 7, 2023
@github-project-automation github-project-automation bot moved this to Backlog in DSL Mar 7, 2023
@lars-reimann lars-reimann added this to the v0.9.0 milestone Jan 8, 2024
@lars-reimann lars-reimann self-assigned this Feb 1, 2024
@lars-reimann lars-reimann modified the milestones: v0.9.0, v0.10.0 Feb 18, 2024
@lars-reimann lars-reimann modified the milestones: v0.10.0, v0.11.0 Apr 2, 2024
@lars-reimann lars-reimann removed their assignment Apr 8, 2024
@lars-reimann lars-reimann modified the milestones: v0.11.0, Future Apr 8, 2024
@lars-reimann lars-reimann changed the title Describe schema of tabular dataset Schema checking for tables Nov 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dsl 🗒️ Issues regarding the domain specific programming language enhancement 💡 New feature or request
Projects
Status: Backlog
Development

No branches or pull requests

1 participant