Enhance Bufr data support including multi-category messages

[Yaqiang]

Enhance Bufr data support including multi-category messages in a sigle data file, so that prepbufr data file is supported. Also CMA bufr tables were added for reading CMA released bufr data files.

Description of Changes

_ Add CMA bufr tables (table B and D) as resource tables for reading the bufr data files released from CMA.

_ prepbufr data file may containes multiple category messages such as ADPUPA, ADPSFC, etc. BufrIosp2 only support single category messages before. So BufrIosp2 and related classes (BufrIospBuilder, EmbeddedTable, TableA, ...) was revised to support more root variables (not just 'obs').

_ 'reallyRead' function in ucar.nc2.Variable class has problem when a Structure variable read result is ArrayObject with ArraySequence as elements, so it was revised to solve the issue.

• 'extractMemberArrayFromIteration' in ucar.ma2.ArraySequence class was revised for SEQUENCE data type case.

I test them using MeteoInfoLab (version 3.9.7) bufr reading scripts with netcdf library behand.

PR Checklist

• Link to any issues that the PR addresses
• Add labels
• Open as a draft PR
  until ready for review
• Make sure GitHub tests pass
• Mark PR as "Ready for Review"

[lesserwhirls]

Greetings @Yaqiang!

Thank you for this contribution! There are two issues at play with the github checks. This first is minor, in that there are some issues detected with the code style. These can be seen by running ./gradlew spotlessCheck, and in most cases can be fixed by running ./gradlew spotlessApply.

The second is there are failing tests. It looks like there is a test failing due to an error trying to reach a remote server (unrelated to your pull requests). I ran our full testsuite against your PR and did find some failures related to the changes, however. For example, when trying to read a sequence from the attached .bufr file using the old API (NetcdfFile.open):

try (NetcdfFile nc = NetcdfFile.open("ecmwf-wmo16-hasOptionalSection.bufr")) {
    Variable var = nc.findVariable("obs.seq1");
    Array data = var.read();
}

we get the following error:

java.lang.NullPointerException
	at ucar.nc2.iosp.bufr.BufrIosp2.findRootSequence(BufrIosp2.java:227)
	at ucar.nc2.iosp.bufr.BufrIosp2.readData(BufrIosp2.java:210)
	at ucar.nc2.NetcdfFile.readData(NetcdfFile.java:2122)
	at ucar.nc2.Variable.reallyRead(Variable.java:854)
	at ucar.nc2.Variable._read(Variable.java:736)
	at ucar.nc2.Variable.read(Variable.java:614)
	at ucar.nc2.Variable.reallyRead(Variable.java:795)
	at ucar.nc2.Variable._read(Variable.java:736)
	at ucar.nc2.Variable.read(Variable.java:614)

I'm going to open a PR here shortly to disable the failing tests when running on GitHub (we've seen connectivity issues with this server before when running on GitHub), so that should help clear up the GitHub checks.

[Yaqiang]

@lesserwhirls Thanks for you review and helpful information on this PR! I mentioned that the check is failling but unfortunatelly I am very busy in these days to response quickly. Can you comment me how to do in next step? Also you mentioned the file "ecmwf-wmo16-hasOptionalSection.bufr" which I didn't find here. Otherwise I will debug the problem on this file.

[lesserwhirls]

Ah, yes, I forgot to attach the file! Here it is:

ecmwf-wmo16-hasOptionalSection.bufr.zip

These would be my suggestion for the next steps:

1. rebase or merge in the changes I've made to the maint-5.x branch into your develop branch, which will allow the unit tests to further test your changes. I suspect the unit tests will pass once you've picked up the changes to the maint-5.x branch.
2. once you have those changes, you can run ./gradlew spotlessApply to fix the codestyle check and commit those changes.
3. at that point, the bufr file above can be used to debug the issue uncovered by the larger test suite.

Thank you again!