Add LocalFilesystemToGoogleDriveOperator

[ulsc]

Operator to upload a list of files to a Google Drive folder, alongside a file which can be used to have more Google Drive operators.

[turbaszek]

One small comment, otherwise looks good to me 🚀

[github-actions]

The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the core of Airflow. If the committers decide that the full tests matrix is needed, they will add the label 'full tests needed'. Then you should rebase to the latest main or amend the last commit of the PR, and push it with --force-with-lease.

[potiuk]

Added it so we might add it to the new release of providers :)

[ulsc]

it would be a problem in line 104: remote_location=str(self.drive_folder / local_path.name), since str doesn't have a name parameter.

[ulsc]

drive_folder is also a template field, so to support jinja altogether, we need to change the path composition a bit.

[eladkal]

LGTM
will merge when CI is green

[eladkal]

I prefer not to be picky and catch all OSError but maybe that is just me :)

[ulsc]

FileNotFoundError seemed like the main error cause in my case, but it'd be better to catch all OSErrors. How about adding OSError after FileNotFoundError?

[eladkal]

FileNotFoundError is subclasses of OSError.
So catching OSError is enough

[eladkal]

https://docs.python.org/3/library/exceptions.html#os-exceptions

[eladkal]

CI indeed help us :)
example dag is missing for this operator
https://github.com/apache/airflow/runs/5617058321?check_suite_focus=true#step:8:892

          with self.subTest("Detect missing example dags"):
              missing_example = {s for s in operator_sets if not has_example_dag(s)}
              missing_example -= self.MISSING_EXAMPLE_DAGS
  >           assert set() == missing_example
  E           AssertionError: assert set() == {('suite', 'local_to_drive')}
  E             Extra items in the right set:
  E             ('suite', 'local_to_drive')
  E             Use -v to get the full diff

[eladkal]

merged this one too fast :)
We should do something like:

        except FileNotFoundError as e:
            self.log.info('File not found: %s: %s', local_path, e)
            raise
        except OSError as e:
            self.log.info('An OSError occurred for file: %s: %s', local_path, e)
            raise

or

except OSError as e:
    raise AirflowException(
        f'Exception: There was exception related to file in path {local_path}  '
        f'full error is ({e}).'
    )

Would you mind open a follow up PR?

[ulsc]

Raise would fail the dag too early, however the intention was failing after seeing the whole landscape. That's why we logged the problems and raised as a result, if user doesn't want to ignore.