Removal of dependency on 'org.apache.commons.*'

[cweitkamp]

In openhab/openhab-core#1433 and openhab/openhab-core#1441 (and more) we removed dependency on org.apache.commons.* libraries. They will be removed from OH3 Core API and thus not available anymore for OH add-ons too. Most of the methods which are used by several bindings are convenience helper methods and can be replaced easily by basic Java methods. Other methods are not yet available in Java 8 but in Java 11 and have to be replace later. It would be a good start to remove as much as we can before.

---

org.apache.commons.net is an exception be because is is used by org.openhab.core.serial and thus it will be okay for add-ons too.

[lsiepel]

These bindings have a remaining import package for org.apache.commons i'll try to come up with some fixes, but certainly do not have the time to fix all of them.

• bluetooth [bluetooth] Null annotations and SAT #13967
• bsblan => [bsblan] Remove org.apache.commons #14515
• digitalstrom [digitalstrom] code refactoring #14402
• dscalarm (see pjlinkdevice PR for SubnetUtils)
• ecobee [ecobee] Remove org.apache.commons #14403
• elerotransmitterstick [elerotransmitterstick] Remove apache.commons #14405
• enturno [enturno] Remove org.apache.commons #14406
• exec [exec] Remove org.apache.common #14443
• folderwatcher org.apache.commons.net.ftp
• heos org.apache.commons.net.telnet
• innogysmarthome [innogysmarthome] Remove org.apache.commons #14407
• irtrans [irtrans] Remove org.apache.common #14408
• kaleidescape => [kaleidescape] Remove Apache StringEscapeUtils #14513 @mlobstein
• keba [keba] Remove org.apache.commons #14409
• km200 [km200] Remove org.apache.commons #14411
• logreader org.apache.commons.io.input
• lutron (org.apache.commons.net)
• mail org.apache.commons.mail
• max [max] Remove org.apache.commons #14413
• neato [neato] Remove org.apache.common #14415
• nibeuplink [nibeuplink] Remove org.apache.common #14416
• ntp org.apache.commons.net.ntp
• oceanic [oceanic] Remove org.apache.common #15332
• omnikinverter [omnikinverter] Remove org.apache.common #14418
• onebusaway [onebusaway] Remove org.apache.common #14419
• onkyo [onkyo] Remove org.apache.common #14420
• pentair [pentair] Remove org.apache.common #14421
• phc [phc] Remove import org.apache.common #14422
• pjlinkdevice [pjlinkdevice] Remove org.apache.common #14430
• plclogo (see pjlinkdevice PR for SubnetUtils)
• plugwise [plugwise] Remove org.apache.common #14432
• rme [rme] Remove org.apache.common #14433
• russound (see pjlinkdevice PR for SubnetUtils)
• sensibo [sensibo] Remove org.apache.common #14434
• smartmeter [smartmeter] Remove org.apache.common #14436
• solaredge [solaredge] Remove org.apache.common #14437
• sonos [sonos] Remove org.apache.common #14438
• upnpcontrol [upnpcontrol] Remove org.apache.common #14439
• weathercompany [weathercompany] Remove org.apache.common #14440
• zway (see pjlinkdevice PR for SubnetUtils)
• imperihome [imperihome] Remove org.apache.common #14441
• neeo [neeo] Remove org.apache.common #14442

[lsiepel]

@openhab/add-ons-maintainers As I'm almost half way, i like to get some reviews, merges or feedback before i proceed. It takes less time than i thought, so might do the others too.

edit: Sorry for all the PR's, but once i got started i could not help it and continued.

edit2: Finished for now. If the subnetutils fix is ok, I’ll apply them to the remaining ones. So maybe it is a good moment to look after the others.

I hope we can now 'blacklist' all the org.apache libs and only whitelist the ones below. @wborn mentioned .net earlier, but i would like to propose to add the others too, as they are more than just a simple convenience helper. If you look at the unscapehtml4 method for instance, it is complex, large and perfectly maintained outside of openHAB. Bringing that into openHAB would be introducing unnecessary maintenance if you ask me.

Maybe add a proxy utility class in core, addons can access those util classes and it re-routes to the apache libs. In that way it is easy to prevent these lib usage in addons and if anyone is ever feeling to imnplement them it can be done without any change in addons repo.

• StringEscapeUtils.unescapeHtml4 (i think this can be fixed here)
• org.apache.commons.net.ftp
• org.apache.commons.net.telnet
• org.apache.commons.net.ntp
• org.apache.commons.io.input
• org.apache.commons.mail

[lsiepel]

@hypetsch i could also fix the unescapeHtml4 for the bsblan binding, because it only unescapes units. I don't have such a device and the openapi documentation lacks details about possible units. Could you be of any help telling me the possible units? Is it only celcius and fahrenheit or are there more units?

[hypetsch]

I don't have a device with the latest firmware either, but from a quick look in the repo it seems to me that - at least in the latest version - the units depend on the localization and should for e.g. German be the "defines" starting with UNIT_ specified in https://github.com/fredlcore/BSB-LAN/blob/master/BSB_LAN/localization/LANG_DE.h

[jlaur]

Only a few left:

$ grep -R "org.apache.commons.lang3.StringUtils"
bundles/org.openhab.binding.sensibo/src/main/java/org/openhab/binding/sensibo/internal/model/SensiboModel.java:import org.apache.commons.lang3.StringUtils;
bundles/org.openhab.binding.sensibo/src/main/java/org/openhab/binding/sensibo/internal/model/SensiboSky.java:import org.apache.commons.lang3.StringUtils;
bundles/org.openhab.io.neeo/src/main/java/org/openhab/io/neeo/internal/TokenSearch.java:import org.apache.commons.lang3.StringUtils;
bundles/org.openhab.binding.fineoffsetweatherstation/src/main/java/org/openhab/binding/fineoffsetweatherstation/internal/domain/DebugDetails.java:import org.apache.commons.lang3.StringUtils;
$ grep -R "org.apache.commons.lang3"
bundles/org.openhab.binding.sensibo/src/main/java/org/openhab/binding/sensibo/internal/model/SensiboModel.java:import org.apache.commons.lang3.StringUtils;
bundles/org.openhab.binding.sensibo/src/main/java/org/openhab/binding/sensibo/internal/model/SensiboSky.java:import org.apache.commons.lang3.StringUtils;
bundles/org.openhab.io.neeo/src/main/java/org/openhab/io/neeo/internal/TokenSearch.java:import org.apache.commons.lang3.StringUtils;
bundles/org.openhab.persistence.mongodb/src/test/java/org/openhab/persistence/mongodb/internal/VerificationHelper.java:import org.apache.commons.lang3.tuple.Pair;
bundles/org.openhab.binding.fineoffsetweatherstation/src/main/java/org/openhab/binding/fineoffsetweatherstation/internal/domain/DebugDetails.java:import org.apache.commons.lang3.StringUtils;
itests/org.openhab.binding.max.tests/itest.bndrun:      org.apache.commons.lang3;version='[3.14.0,3.14.1)',\

[lsiepel]

Any suggestions on how to fix this for the mongodb? It depends on this Pair type and there is no drop in replacement. Without refactoring all the code in VerificationHelper i would end up making some kind of apache clone.

[jlaur]

How about something like:

public record Pair<L, R>(L left, R right) {}

?

The refactoring risk should be low as it is only used in a test class.

[lsiepel]

Thanks for the sugggestion. Just created a PR to get this done.

[jlaur]

@lsiepel - I believe this issue can finally be closed? 😄

$ grep -R "org.apache.commons.lang3"
bundles/org.openhab.binding.argoclima/src/main/java/org/openhab/binding/argoclima/internal/utils/StringUtils.java: * @implNote The interface is modeled on {@link org.apache.commons.lang3.StringUtils} interface (which is not used as it
bundles/org.openhab.binding.argoclima/src/main/java/org/openhab/binding/argoclima/internal/utils/StringUtils.java:     * @implNote API-compatible with {@link org.apache.commons.lang3.StringUtils#strip(String, String)} (except for
bundles/org.openhab.binding.argoclima/src/main/java/org/openhab/binding/argoclima/internal/utils/StringUtils.java:     * @implNote API-compatible with {@link org.apache.commons.lang3.StringUtils#splitByWholeSeparator(String, String)}

[jlaur]

@lsiepel - sorry, it cannot:

grep -R "org.apache.commons."

[lsiepel]

We are not there yet. Let’s hope 4.2 is the last one with these libs 😁

[lsiepel]

Think this can be closed now? There are some apache dependency's left, but they are sub of org.apache.commons.net or org.openhab.core.serial