Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New aws_glue transform #751

Closed
binarylogic opened this issue Aug 13, 2019 · 1 comment
Closed

New aws_glue transform #751

binarylogic opened this issue Aug 13, 2019 · 1 comment
Labels
domain: processing Anything related to processing Vector's events (parsing, merging, reducing, etc.) domain: transforms Anything related to Vector's transform components meta: idea Anything in the idea phase. Needs further discussion and consensus before work can begin. needs: approval Needs review & approval before work can begin. needs: requirements Needs a a list of requirements before work can be begin provider: aws Anything `aws` service provider related transform: new A request for a new transform type: feature A value-adding code addition that introduce new functionality.

Comments

@binarylogic
Copy link
Contributor

  • Requires a database and table name
  • Pulls down a static schema
  • Ensures data coming out of the transform always conforms to that schema
  • Similar to Segments protocols features: https://segment.com/product/protocols/
@binarylogic binarylogic added Type: New Feature needs: requirements Needs a a list of requirements before work can be begin labels Aug 13, 2019
@binarylogic binarylogic added this to the Improved support for schemas milestone Sep 7, 2019
@binarylogic binarylogic modified the milestones: Improved support for schemas, Improve data processing Sep 17, 2019
@binarylogic binarylogic added the needs: approval Needs review & approval before work can begin. label Dec 28, 2019
@binarylogic binarylogic mentioned this issue Jan 31, 2020
Closed
This was referenced Feb 7, 2020
Merged
Closed
@binarylogic binarylogic added type: feature A value-adding code addition that introduce new functionality. and removed type: new feature labels Jun 16, 2020
@binarylogic binarylogic removed this from the Initial Schema Support milestone Aug 2, 2020
@binarylogic binarylogic added domain: vrl Anything related to the Vector Remap Language domain: processing Anything related to processing Vector's events (parsing, merging, reducing, etc.) domain: transforms Anything related to Vector's transform components meta: idea Anything in the idea phase. Needs further discussion and consensus before work can begin. provider: aws Anything `aws` service provider related labels Aug 7, 2020
@JeanMertz JeanMertz removed the domain: vrl Anything related to the Vector Remap Language label Jun 7, 2022
@jszwedko jszwedko added the transform: new A request for a new transform label Aug 1, 2022
@jszwedko
Copy link
Member

Closing due to lack of demand. Leave a comment if this would be useful to you with your use-case!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
domain: processing Anything related to processing Vector's events (parsing, merging, reducing, etc.) domain: transforms Anything related to Vector's transform components meta: idea Anything in the idea phase. Needs further discussion and consensus before work can begin. needs: approval Needs review & approval before work can begin. needs: requirements Needs a a list of requirements before work can be begin provider: aws Anything `aws` service provider related transform: new A request for a new transform type: feature A value-adding code addition that introduce new functionality.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@Hoverbear @jszwedko @JeanMertz @binarylogic