Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Converting DELIMITED stream to another format fails when VALUE_DELIMITER is specified #4200

Closed
mikebin opened this issue Dec 29, 2019 · 0 comments · Fixed by #4366
Closed
Assignees
Labels
Milestone

Comments

@mikebin
Copy link

mikebin commented Dec 29, 2019

Describe the bug

When creating a new stream in AVRO or JSON format from a source stream defined as DELIMITED with an explicit delimiter set with VALUE_DELIMITER, the CSAS statement fails with error Delimeter only supported with DELIMITED format

To Reproduce

Problem occurs in ksqlDB 0.6.0 and newer CP 5.4.0-SNAPSHOT versions.

Step 1: Create source stream as DELIMITED with an explicit VALUE_DELIMITER:

create stream csv_stream (val1 string, val2 string) with (kafka_topic='csv-data', value_format='delimited', value_delimiter=',', partitions=1);

Step 2: Insert a record into the source topic:

insert into csv_stream (val1, val2) values ('v1', 'v2');

Step 3: Try to create a new derived stream in JSON format from csv_stream:

create stream json_stream with (value_format='json') as select * from csv_stream;

Expected behavior

In the example above, json_stream should successfully be created and convert records from CSV to JSON format in the output stream.

Actual behaviour

Exception occurs when executing the CSAS statement:

Delimeter only supported with DELIMITED format

Note: there's also a typo in the error message. Should say Delimiter instead of Delimeter.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants