Fix Iceberg statistics accumulation after schema evolution

[BlueStalker]

This fixes the issues when there is a schema change (drop or change column) on iceberg tables, then the partitions schema table query failed with verification error. With this fix, it will return the rest columns and escape the failed ones.

Before the change, the query on "$partitions" will fail if there are column dropped, now it is just escape the column

[cla-bot]

Thank you for your pull request and welcome to our community. We could not parse the GitHub identity of the following contributors: Curt.
This is most likely caused by a git client misconfiguration; please make sure to:

1. check if your git client is configured with an email to sign commits git config --list | grep email
2. If not, set it up using git config --global user.email [email protected]
3. Make sure that the git commit email is configured in your GitHub account settings, see https://github.com/settings/emails

[findepi]

cc @alexjo2144

[vgankidi]

Currently we loop through idToMetricMap from the datafile and look it up in idToTypeMapping from the table schema. Does it make sense to lookup the ids from idToTypeMapping in idToMetricMap instead?
Since we don't care about ids in data file which are not in table schema as schema evolves.

[BlueStalker]

@alexjo2144 Any more comments, can we merge this?

[alexjo2144]

Code changes look good, just need one tweak to the test still.

We need a maintainer to take a look though, I can't merge things into Trino. @findepi ?

[BlueStalker]

Code changes look good, just need one tweak to the test still.

We need a maintainer to take a look though, I can't merge things into Trino. @findepi ?

updated

[BlueStalker]

@findepi Any other suggestions?

[alexjo2144]

Looks good to me. I'd probably just word the commit/title a little differently.

Maybe something like "Fix Iceberg statistics accumulation after schema evolution"

[findepi]

Merged, thank you @BlueStalker for your PR!
and thank you @alexjo2144 for your review