SNOW-1887892: improve process pool + thread pool logic, add retry logic

[sfc-gh-yuwang]

…not wait, add retry logic

1. Which Jira issue is this PR addressing? Make sure that there is an accompanying issue to your PR.

   Fixes SNOW-1887892

2. Fill out the following pre-review checklist:

   • I am adding a new automated test(s) to verify correctness of my new code
     • If this test skips Local Testing mode, I'm requesting review from @snowflakedb/local-testing
   • I am adding new logging messages
   • I am adding a new telemetry message
   • I am adding new credentials
   • I am adding a new dependency
   • If this is a new feature/behavior, I'm adding the Local Testing parity changes.
   • I acknowledge that I have ensured my changes to be thread-safe. Follow the link for more information: Thread-safe Developer Guidelines

3. Please describe how your code solves the related issue.

   this PR meant to do two things:
   i. decouple process pool download and thread pool upload/copy into table
   ii. add retry logic for both process pool and thread pool
   test for partition download will be added in other PR

[github-actions]

Seems like your changes contain some Local Testing changes, please request review from @snowflakedb/local-testing

[github-actions]

Seems like your changes contain some Local Testing changes, please request review from @snowflakedb/local-testing

[sfc-gh-aling]

I'm curious how does this as_completed work?

let's say I have 10 futures, and 7th job finishes first, would as_completed(process_pool_futures) return 7th job first?

[github-actions]

Seems like your changes contain some Local Testing changes, please request review from @snowflakedb/local-testing