Treat less compatible tags as lower priority in resolver

[charliermarsh]

Summary

This is a second pass at #7556, which was reverted in #7608 due to a regression in #7606. The behavior is actually correct, but a package (nmslib) publishes inconsistent metadata, and the change here happened to cause us to select a wheel with "wrong" metadata. It's arbitrary, but it did cause a regression for folks.

Since we're now seeing other issues caused by the wrongness here (and since the reporter in #7606 has since removed the dependency), I'm inclined to ship this fix.

Closes #7553.
Closes #9283.

[zanieb]

I'm still sort of hesitant.

One of the linked issues comes from selecting Python 2 wheels? I feel like we should never read metadata from those?

[charliermarsh]

We can change that, but why hesitant? The current behavior is legitimately incorrect — it treats less compatible wheels as more compatible.

[zanieb]

Perhaps I'm not following. I'm going off the title:

invalid platform as more compatible than invalid Python

This sounds like we prefer an invalid platform over an invalid Python version — I don't see one of those as more-correct?

[charliermarsh]

I think the PR title is kind of bad (I copied it over from the previous PR). My understanding of what's happening is that, at present, if we have two wheels with incompatible tags, we treat the wheel the wheel with "less compatible" tags as "higher priority" (which is wrong). Later, in error reporting, we say no wheels with a matching Python implementation tag if the "highest priority" tag is IncompatibleTag::Python, because we're demonstrating that the best wheel we could find uses a different Python implementation. But that's not true -- there are wheels with matching Python implementations, we just treated them as "lower priority" by accident.

[charliermarsh]

Basically: I think everywhere else we actually do encode that mismatching platform tag is more compatible than mismatching Python implementation or ABI:

#[derive(Debug, Eq, Ord, PartialEq, PartialOrd, Clone)]
pub enum IncompatibleTag {
    /// The tag is invalid and cannot be used.
    Invalid,
    /// The Python implementation tag is incompatible.
    Python,
    /// The ABI tag is incompatible.
    Abi,
    /// The Python version component of the ABI tag is incompatible with `requires-python`.
    AbiPythonVersion,
    /// The platform tag is incompatible.
    Platform,
}

So the system assumes that in various places. Right now, we would actually actively prioritize Python 2 wheels over Python 3 wheels.

[zanieb]

Thanks for explaining! Makes sense to me then.