Jpuerto/nihdev 454 ivt adjust dir schema validation for shared uploads

[jpuerto-psc]

This PR adds support for the global and non_global shared uploads defined here: https://docs.google.com/document/d/1n2McSs9geA9Eli4QWQaB3c9R3wo5d5U1Xd57DWQfN5Q

This PR also adds an example shared PhenoCycler dataset for automated testing.

[jpuerto-psc]

Two example uploads in DEV that passed metadata/directory schema validation (fail on plugins because the files are empty).

[jpuerto-psc]

Leaving this open for now as it requires some input from Stephen Fisher

[gesinaphillips]

Unless uploads with shared directories will be passed "global" and "non_global" as part of the Upload's upload_ignore_globs argument, I think the __get_no_ref_errors method needs to be updated to ignore the presence of global/non_global directories because they are not technically referenced. If you copy the new good-cedar-phenocycler-shared example from dataset-iec-examples to dataset-examples (because the two dirs are called with different args during testing) you should see the following error when you run the tests:

Reference Errors:
  No References:
    Files:
    - global.
    - non_global.

One way of solving this would be to add to self.upload_ignore_globs if self.shared_directories is True, e.g.:

        if self.shared_directories:
            self.upload_ignore_globs = [
                *self.upload_ignore_globs,
                *["global", "non_global"],
            ]

I added this inside _get_no_ref_errors just before non_metadata_paths is created and it avoided the no-ref error in the phenocycler example. HOWEVER I am not sure if this has unwanted downstream effects!

[jpuerto-psc]

Unless uploads with shared directories will be passed "global" and "non_global" as part of the Upload's upload_ignore_globs argument, I think the __get_no_ref_errors method needs to be updated to ignore the presence of global/non_global directories because they are not technically referenced. If you copy the new good-cedar-phenocycler-shared example from dataset-iec-examples to dataset-examples (because the two dirs are called with different args during testing) you should see the following error when you run the tests:

@gesinaphillips - we should be fine here, the ingest-pipeline invocation basically ignores all directories at the top-level (which is why extras doesn't get caught either).