more automated tests

[totaam]

Issue migrated from trac ticket # 847

component: tests | priority: critical | resolution: fixed

2015-04-29 08:27:08: antoine created the issue

---

Follow up from #177, see also #660 - in particular things like #822.

• integration tests: we want some tests that start a server and connect to it.
  Shadow server, normal server, proxy, etc... Even the tcp proxy can be exercised this way.
  Concurrent connections (spawn 10 xpra info?), etc.

Here's a tricky one that I would like to be able to catch with some tests, but it is going to be HARD: r8604 broke nvenc4 + nvenc5 with the proxy server only (fixed by r9413 + backport in 9414).

• client rendering tests: we should be able to fire up a virtual display, create a window (try both pixmap and opengl backends) and paint on it (no client class involved), then check that no errors or exceptions were triggered.

• this one would be hard to check for: xpra start fails on OS X #867

[totaam]

2015-04-29 10:29:46: antoine changed status from new to assigned

[totaam]

2015-04-29 10:29:46: antoine commented

---

(fix milestone - too late for 0.15)

[totaam]

2015-05-18 08:35:20: antoine edited the issue description

[totaam]

2015-05-20 04:11:42: antoine edited the issue description

[totaam]

2015-05-20 04:11:42: antoine changed title from add some client-server integration tests to more automated tests

[totaam]

2015-05-21 12:58:10: antoine edited the issue description

[totaam]

2015-07-28 07:54:27: antoine commented

---

I don't see how this can easily be automated, but it would be nice to catch bugs like #926 automatically.

[totaam]

2015-11-15 08:30:51: antoine changed priority from major to critical

[totaam]

2015-11-15 08:30:51: antoine commented

---

And also catch things like: #1031

[totaam]

2016-07-12 17:51:51: antoine commented

---

Milestone renamed

[totaam]

2016-08-21 10:55:50: antoine commented

---

Milestone renamed

[totaam]

2017-01-28 10:09:50: antoine changed status from assigned to new

[totaam]

2017-01-28 10:09:50: antoine changed owner from antoine to smo

[totaam]

2017-01-28 10:09:50: antoine commented

---

As of r14869 + r14868 + r14867 + r14866, the unit tests have been improved, most run with both python2 and python3 and we now also run the tests as part of the build process for win32 (r14870) and osx (r14871)!

@smo: FYI, feel free to just close.

[totaam]

2017-02-06 23:34:34: smo changed status from new to closed

[totaam]

2017-02-06 23:34:34: smo set resolution to fixed

[totaam]

2017-09-08 10:37:11: antoine commented

---

For reference, the latest run scripts allow us to pass a specific unit test to run (useful for debugging), and the following environment variables are also useful:

DELETE_TEMP_FILES=0 \
XPRA_ALL_DEBUG=1 \
XPRA_TEST_DEBUG=1 \
    ./run2 ./unit/server/server_sockets_test.py