feat: add optimize command in python binding

[loleek]

Description

This is a implementation of the Optimize Command for python binding.

Related Issue(s)

#622

[wjones127]

This looks quite good. Added a few suggestions.

[wjones127]

It would be nice to have this be typed for the sake of autocompletion, but doing that in Rust right now involves a bit of boilerplate. One lightweight option is https://docs.python.org/3.8/library/typing.html#typing.TypedDict, but that's Python>=3.8 only. We still have a month or two until 3.7 is EOL.

[wjones127]

Perhaps something like:

if TYPE_CHECKING and sys.version_info().minor >= 8:
    from typing import TypedDict

    class MetricDetails(TypeDict):
        min: int
        max: int
        avg: float
        total_files: int
        total_size: int
    
    class OptimizeMetrics(TypeDict):
        num_files_added: int
        num_files_removed: int
        files_added: MetricDetails
        files_removed: MetricDetails
        partitions_optimized: int
        num_batches: int
        total_considered_files: int
        total_files_skipped: int
        preserve_insertion_order: bool

Then you can modify the signature:

def optimize(
            self,
            partition_filters: Optional[List[Tuple[str, str, Any]]] = None,
            target_size: Optional[int] = None,
    ) -> "OptimizeMetrics":

[wjones127]

(I'm happy to leave this for a follow up later FYI)

[loleek]

ok. I'll leave this in current PR.

[djouallah]

can you guys please don't release the next version of python package before you merge this, this is a very important functionality