SPARQL conformance tests

[WolfgangFahl]

https://www.w3.org/2009/sparql/docs/tests/ has a test suite see #564

• I have not found an automation approach for testing the suite yet but could imagine that it would be possible.
• A continuous integration test for the suite would IMHO be worthwile to create
• I am wondering whether SPARQL engines such as Jena, blazegraph and Virtuoso actually pass the test suite.
• I am wondering how relevant the different tests are and whether full conformance is actually a worthwile goal

[hannahbast]

@WolfgangFahl We already have someone working on exactly that test suite :-) It's @joaomarques90

[LorenzBuehmann]

• I am wondering whether SPARQL engines such as Jena, blazegraph and Virtuoso actually pass the test suite.

Apache Jena of course does, it has SPARQL 1.0 and SPARQL 1.1 test suite as test cases. RDF4J also has the test suite as Java tests integrated. For the other triple stores I don't know, Github code is online, maybe you can find the reference to it there.

There is also a published report: http://tft-reports.bordercloud.com/

And an ongoing discussion regarding some test issues: w3c/sparql-dev#38

[AndreaWesterinen]

I forked the BorderCloud code, made some changes and tested the tests against a Stardog instance.

All the details and links to the code are at https://wikitech.wikimedia.org/wiki/User:AndreaWest/WDQS_Testing/Running_TFT.