Remove fastjson library

[gabrywu]

fix #24154,
hi @apilloud can you help to review this PR?

[github-actions]

Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment assign set of reviewers

[github-actions]

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @bvolpato for label java.
R: @damccorm for label build.

Available commands:

• stop reviewer notifications - opt out of the automated review tooling
• remind me after tests pass - tag the comment author after tests pass
• waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

[Abacn]

Thanks for working on this! There are merge conflicts - could you please rebase onto the current master? Also, consider add this change to CHANGES.md.

[gabrywu]

Thanks for working on this! There are merge conflicts - could you please rebase onto the current master? Also, consider add this change to CHANGES.md.

added

[Abacn]

Run SQL PostCommit

[Abacn]

There are test failures:

org.apache.beam.sdk.extensions.sql.meta.provider.kafka.KafkaTableProviderIT.testFake2[0]

Error Message
java.lang.RuntimeException: illegal table properties: { "format" : "json",}
	at org.apache.beam.sdk.extensions.sql.TableUtils.parseProperties(TableUtils.java:50)
	at org.apache.beam.sdk.extensions.sql.meta.provider.kafka.KafkaTableProviderIT.testFake2(KafkaTableProviderIT.java:156)
...

Previously a ill-formed json { "format" : "json",} works, now it does not.

Similarly, it is nice to tolerant trailing comma

[gabrywu]

I will add ALLOW_TRAILING_COMMA flag

[Abacn]

Thanks again for the fix. It appears fastjson parser in general is more relax than the default jackson mapper. Let me do some small experiments regarding the default behavior of two parsers, specifically, the list in https://fasterxml.github.io/jackson-core/javadoc/2.9/com/fasterxml/jackson/core/JsonParser.Feature.html

[Abacn]

Experiment result shows fastjson in general is much more relax in non-standard syntax. We may need to add other configs, see below.

config	fastjson default	jackson default	jackson relaxed
normal	o	o	o
ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER	o	x	o
ALLOW_COMMENTS	o	x	o
ALLOW_MISSING_VALUES	o	x	o
ALLOW_NON_NUMERIC_NUMBERS	o	x	o
ALLOW_NUMERIC_LEADING_ZEROS	o	x	o
ALLOW_SINGLE_QUOTES	o	x	o
ALLOW_TRAILING_COMMA	o	x	o
ALLOW_UNQUOTED_CONTROL_CHARS	o	x	o
ALLOW_UNQUOTED_FIELD_NAMES	o	x	o
ALLOW_YAML_COMMENTS	x	x	o

[Abacn]

Run SQL PostCommit

[Abacn]

LGTM