Skip to content
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.

Purge API - Internal server error #3300

Closed
ukcb opened this issue May 29, 2018 · 5 comments
Closed

Purge API - Internal server error #3300

ukcb opened this issue May 29, 2018 · 5 comments

Comments

@ukcb
Copy link

ukcb commented May 29, 2018

The Purge API is not working properly since v0.30.0.

Here is the output of curl:

{
     "errcode": "M_UNKNOWN",
     "error": "Internal server error"
}

My logfile:

#################################################################################################
2018-05-25 20:02:25,796 - synapse.http.server - 102 - ERROR - POST-379- Failed handle request via <function _async_render at 0x7fa705693c08>: <XForwardedForRequest at 0x7fa6dff1e680 method=POST uri=/_matrix/client/r0/admin/purge_history/!MGUaVpZzXIfxmhJrpV:xxxxxx?access_token=<redacted> clientproto=HTTP/1.1 site=8008>: Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 651, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1355, in gotResult
    _inlineCallbacks(r, g, deferred)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
--- <exception caught here> ---
  File "/usr/lib/python2.7/dist-packages/synapse/http/server.py", line 79, in wrapped_request_handler
    yield h(self, request)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/http/server.py", line 305, in _async_render
    callback_return = yield callback(request, **kwargs)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/rest/client/v1/admin.py", line 179, in on_POST
    room_event_after_stream_ordering,
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 320, in runInteraction
    result = yield self.runWithConnection(inner_func, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 365, in runWithConnection
    inner_func, *args, **kwargs
  File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 246, in inContext
    result = inContext.theWork()
  File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 262, in <lambda>
    inContext.theWork = lambda: context.call(ctx, func, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 118, in callWithContext
    return self.currentContext().callWithContext(ctx, func, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 81, in callWithContext
    return func(*args,**kw)
  File "/usr/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py", line 307, in _runWithConnection
    compat.reraise(excValue, excTraceback)
  File "/usr/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py", line 298, in _runWithConnection
    result = func(conn, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 361, in inner_func
    return func(conn, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 316, in inner_func
    func, *args, **kwargs
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 241, in _new_transaction
    r = func(txn, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 853, in _simple_select_one_txn
    txn.execute(select_sql, keyvalues.values())
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 82, in execute
    self._do_execute(self.txn.execute, sql, *args)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 112, in _do_execute
    sql, *args
psycopg2.ProgrammingError: operator does not exist: text = record
LINE 1: ..., topological_ordering FROM events WHERE event_id = (2498, 3...
                                                             ^
HINT:  No operator matches the given name and argument type(s). You might need to add explicit type casts.
#############################################################################################################

I use debian stretch and matrix-synapse v0.30.0.
@ukcb ukcb mentioned this issue May 29, 2018
Closed
@richvdh
Copy link
Member

richvdh commented Jun 6, 2018

This was introduced in 5f27ed7

richvdh added a commit that referenced this issue Jun 6, 2018
@richvdh
Fix event-purge-by-ts admin API
0546715 
This got completely broken in 0.30.

Fixes #3300.
@richvdh richvdh mentioned this issue Jun 6, 2018
Merged
@ukcb
Copy link
Author

ukcb commented Jun 7, 2018

Here is the output of v0.31.0.

2018-06-07 17:01:56,993 - synapse.rest.client.v1.admin - 185 - WARNING - POST-4- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,021 - synapse.rest.client.v1.admin - 185 - WARNING - POST-5- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,049 - synapse.rest.client.v1.admin - 185 - WARNING - POST-6- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,081 - synapse.http.server - 102 - ERROR - POST-7- Failed handle request via <function _async_render at 0x7fec8085cc08>: <XForwardedForRequest at 0x7fec781040e0 method='POST' uri='/_matrix/client/r0/admin/purge_history/!KgVuDGvtVRMZUjtKrr:xxxxxx?access_token=<redacted>' clientproto='HTTP/1.1' site=8008>: Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 651, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1355, in gotResult
    _inlineCallbacks(r, g, deferred)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
--- <exception caught here> ---
  File "/usr/lib/python2.7/dist-packages/synapse/http/server.py", line 79, in wrapped_request_handler
    yield h(self, request)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/http/server.py", line 305, in _async_render
    callback_return = yield callback(request, **kwargs)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/rest/client/v1/admin.py", line 179, in on_POST
    room_event_after_stream_ordering,
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 325, in runInteraction
    result = yield self.runWithConnection(inner_func, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 370, in runWithConnection
    inner_func, *args, **kwargs
  File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 246, in inContext
    result = inContext.theWork()
  File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 262, in <lambda>
    inContext.theWork = lambda: context.call(ctx, func, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 118, in callWithContext
    return self.currentContext().callWithContext(ctx, func, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 81, in callWithContext
    return func(*args,**kw)
  File "/usr/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py", line 307, in _runWithConnection
    compat.reraise(excValue, excTraceback)
  File "/usr/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py", line 298, in _runWithConnection
    result = func(conn, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 366, in inner_func
    return func(conn, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 321, in inner_func
    func, *args, **kwargs
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 246, in _new_transaction
    r = func(txn, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 861, in _simple_select_one_txn
    txn.execute(select_sql, list(keyvalues.values()))
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 87, in execute
    self._do_execute(self.txn.execute, sql, *args)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 117, in _do_execute
    sql, *args
psycopg2.ProgrammingError: operator does not exist: text = record
LINE 1: ..., topological_ordering FROM events WHERE event_id = (2622, 1...
                                                             ^
HINT:  No operator matches the given name and argument type(s). You might need to add explicit type casts.
2018-06-07 17:01:57,106 - synapse.rest.client.v1.admin - 185 - WARNING - POST-8- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,132 - synapse.rest.client.v1.admin - 185 - WARNING - POST-9- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,159 - synapse.rest.client.v1.admin - 185 - WARNING - POST-10- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,188 - synapse.rest.client.v1.admin - 185 - WARNING - POST-11- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,218 - synapse.rest.client.v1.admin - 185 - WARNING - POST-12- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,246 - synapse.rest.client.v1.admin - 185 - WARNING - POST-13- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,274 - synapse.rest.client.v1.admin - 185 - WARNING - POST-14- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,303 - synapse.rest.client.v1.admin - 185 - WARNING - POST-15- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)
2018-06-07 17:01:57,335 - synapse.http.server - 102 - ERROR - POST-16- Failed handle request via <function _async_render at 0x7fec8085cc08>: <XForwardedForRequest at 0x7fec781043b0 method='POST' uri='/_matrix/client/r0/admin/purge_history/!erZCGvpJrEIXRgUqXC:xxxxxx?access_token=<redacted>' clientproto='HTTP/1.1' site=8008>: Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 651, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1355, in gotResult
    _inlineCallbacks(r, g, deferred)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
--- <exception caught here> ---
  File "/usr/lib/python2.7/dist-packages/synapse/http/server.py", line 79, in wrapped_request_handler
    yield h(self, request)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/http/server.py", line 305, in _async_render
    callback_return = yield callback(request, **kwargs)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/rest/client/v1/admin.py", line 179, in on_POST
    room_event_after_stream_ordering,
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 325, in runInteraction
    result = yield self.runWithConnection(inner_func, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 370, in runWithConnection
    inner_func, *args, **kwargs
  File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 246, in inContext
    result = inContext.theWork()
  File "/usr/lib/python2.7/dist-packages/twisted/python/threadpool.py", line 262, in <lambda>
    inContext.theWork = lambda: context.call(ctx, func, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 118, in callWithContext
    return self.currentContext().callWithContext(ctx, func, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/twisted/python/context.py", line 81, in callWithContext
    return func(*args,**kw)
  File "/usr/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py", line 307, in _runWithConnection
    compat.reraise(excValue, excTraceback)
  File "/usr/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py", line 298, in _runWithConnection
    result = func(conn, *args, **kw)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 366, in inner_func
    return func(conn, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 321, in inner_func
    func, *args, **kwargs
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 246, in _new_transaction
    r = func(txn, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 861, in _simple_select_one_txn
    txn.execute(select_sql, list(keyvalues.values()))
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 87, in execute
    self._do_execute(self.txn.execute, sql, *args)
  File "/usr/lib/python2.7/dist-packages/synapse/storage/_base.py", line 117, in _do_execute
    sql, *args
psycopg2.ProgrammingError: operator does not exist: text = record
LINE 1: ..., topological_ordering FROM events WHERE event_id = (2661, 4...
                                                             ^
HINT:  No operator matches the given name and argument type(s). You might need to add explicit type casts.
2018-06-07 17:01:57,359 - synapse.rest.client.v1.admin - 185 - WARNING - POST-17- [purge] purging events not possible: No event found (received_ts 1527786116893 => stream_ordering 2622)

Nothing is deleted. Why is received_ts compared to stream_ordering here?

@richvdh
Copy link
Member

richvdh commented Jun 7, 2018

this is fixed in #3363, which will be in the next release.

@richvdh richvdh closed this as completed Jun 7, 2018
@ukcb
Copy link
Author

ukcb commented Jul 6, 2018

Here is the output of v0.32.1.

I was hoping the cleanup would work with the new version. Unfortunately, that does not work.

2018-07-06 23:15:19,295 - root - 210 - WARNING - None- ***** STARTING SERVER *****
2018-07-06 23:15:19,314 - root - 213 - WARNING - None- Server /usr/lib/python2.7/dist-packages/synapse/app/homeserver.py version 0.32.1
2018-07-06 23:15:58,560 - synapse.rest.client.v1.admin - 183 - WARNING - POST-22- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,590 - synapse.rest.client.v1.admin - 183 - WARNING - POST-23- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,616 - synapse.rest.client.v1.admin - 183 - WARNING - POST-24- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,702 - synapse.rest.client.v1.admin - 183 - WARNING - POST-27- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,729 - synapse.rest.client.v1.admin - 183 - WARNING - POST-28- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,779 - synapse.rest.client.v1.admin - 183 - WARNING - POST-30- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,802 - synapse.rest.client.v1.admin - 183 - WARNING - POST-31- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,827 - synapse.rest.client.v1.admin - 183 - WARNING - POST-32- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,851 - synapse.rest.client.v1.admin - 183 - WARNING - POST-33- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,877 - synapse.rest.client.v1.admin - 183 - WARNING - POST-34- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,933 - synapse.rest.client.v1.admin - 183 - WARNING - POST-36- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)
2018-07-06 23:15:58,963 - synapse.rest.client.v1.admin - 183 - WARNING - POST-37- [purge] purging events not possible: No event found (received_ts
 1530314158457 => stream_ordering 3068)

Matching events are enough in the database.

$ psql -d synapse
psql (9.6.7)
Type "help" for help.
synapse=# SELECT stream_ordering, origin_server_ts FROM events WHERE origin_server_ts <= 1530314158457;
 stream_ordering | origin_server_ts 
-----------------+------------------
            1834 |    1505431296652
            1835 |    1505431296675
            1836 |    1505431296707
              -5 |    1505431296771
              -6 |    1505431296890
              -7 |    1505431296942
            1839 |    1505431324688
            1847 |    1505431342329
            1851 |    1505431362937
            1837 |    1505431380055
            1842 |    1505431388875
            1849 |    1505431419364
            1845 |    1505431462581
            1841 |    1505431462908
             -16 |    1505431549841
             -17 |    1505474986570
             -18 |    1505475071307
            1846 |    1505476051287
            1857 |    1508261856313
            1858 |    1508261856379
            1859 |    1508261856411
            1992 |    1508261856734
            1966 |    1508261856901
            2040 |    1508261898083
            1860 |    1508261969718
            1985 |    1508261969990
            1980 |    1508270855020
            2004 |    1508271982403
            1861 |    1508331967979
            1996 |    1508411049391
            2009 |    1508413415536
            1862 |    1508453269544
            2060 |    1508499207898
            2083 |    1508631217242
            1863 |    1508754453943
            1864 |    1508756858622
            1865 |    1508756958499
            1866 |    1508858106782
            2007 |    1508900560813
            2027 |    1509214357292
            1867 |    1509230842495
            2056 |    1509230872575
            2023 |    1510949027041
            1868 |    1511021270081
            2068 |    1511021278924
            1869 |    1511029936198
            2063 |    1511030051137
            1870 |    1511302473166
            2017 |    1511302491984
            1871 |    1511379192047
            1872 |    1511379194356
            1873 |    1511379209700
            1874 |    1511533392162
            1875 |    1513165217171
            1876 |    1513166509447
            2042 |    1513166985466
            1877 |    1513166985759
            1878 |    1513166985974
            1962 |    1513166993766
            1879 |    1513167406739
            1880 |    1513167698179
            1881 |    1513176726478
            1882 |    1513176736796
            1883 |    1513176756363
            1884 |    1513193730011
            2003 |    1513193756956
            1885 |    1513229794595
            1886 |    1513257578061
            1887 |    1513258501002
            1888 |    1513258504823
            1889 |    1513262032749
            1890 |    1513297501669
            2037 |    1513299730150
            1891 |    1513833380420
            1978 |    1513887559077
            1892 |    1513887707331
            2015 |    1514034219263
            2071 |    1514062939502
            1893 |    1514085645109
            1960 |    1514085868366
            1894 |    1514113706394
            1987 |    1514114203611
            2053 |    1514191093764
            1895 |    1514228769622
            2022 |    1514229955062
            1896 |    1514387949459
            2075 |    1514405161521
            1973 |    1514789032791
            1897 |    1514815292122
            2014 |    1514815467066
            1898 |    1515168293407
            1899 |    1515216972381
            1900 |    1515373305857
            1901 |    1515373831192
            1902 |    1515374119847
            1903 |    1515381112994
            2024 |    1515381204804
            1965 |    1515444365444
            1963 |    1515536861844
            1904 |    1515552208407
            1905 |    1515552231604
            1906 |    1515897157437
            2074 |    1515923396238
            1907 |    1516027443838
            1908 |    1516178186325
            2030 |    1516213623091
            1909 |    1516216142918
            1910 |    1516216170603
            2059 |    1516216185703
            2000 |    1516252823409
            1971 |    1516292783414
            2029 |    1516292783785
            2052 |    1516293656603
            2048 |    1516299970011
            1911 |    1516351621583
            1912 |    1516351642510
            1913 |    1516351664593
            1914 |    1516382563738
            1988 |    1516587074450
            2050 |    1516737112694
            1955 |    1516737766854
            1915 |    1516740093370
            1975 |    1516743082663
            1916 |    1517257469880
            2043 |    1517258901607
            1917 |    1517419361561
            1957 |    1517419408812
            1918 |    1517619873465
            2087 |    1517619874772
            1959 |    1517740817332
            2061 |    1517950742144
            2082 |    1518053240681
            2036 |    1518053241564
            1969 |    1518053241695
            2005 |    1518116477647
            2012 |    1518117775781
            1956 |    1518118470727
            2010 |    1518118660795
            2002 |    1518118974482
            1958 |    1518119001402
            2034 |    1518323214005
            1974 |    1518323214404
            1919 |    1518369104402
            1920 |    1519110873517
            1921 |    1519110874378
            1922 |    1519327309210
            1986 |    1519327322885
             -20 |    1519396591593
             -21 |    1519396592006
             -22 |    1519396592304
             -23 |    1519396592667
             -24 |    1519396592971
             -25 |    1519396615733
            2019 |    1519442737920
            2013 |    1519442976714
            1989 |    1519443083077
            2069 |    1519606475913
            1923 |    1519780886169
            1838 |    1519782063997
            1924 |    1519838634508
            2077 |    1519870250527
            2055 |    1520208464767
            1925 |    1520238199891
            2033 |    1520275788242
            2057 |    1520709922887
            2046 |    1520710281956
            2062 |    1520710635595
            2070 |    1520711089353
            2031 |    1520711423791
            2032 |    1520712616613
            1990 |    1520712840381
            2039 |    1520712921047
            2086 |    1520714406410
            2020 |    1520717747576
            1926 |    1520948132717
            2066 |    1520953243363
            1927 |    1520971834870
            2028 |    1520975715998
            2084 |    1521120838945
            1928 |    1521139678845
            1929 |    1521179714975
            1930 |    1521203782155
            2011 |    1521203782592
            1982 |    1521244460762
            1931 |    1521296080537
            2038 |    1521296083358
            1932 |    1521378099860
            1979 |    1521378981445
            2047 |    1521394739603
            1840 |    1521395035730
            1933 |    1521418299324
            2026 |    1521418300301
            1934 |    1521478147931
               2 |    1521572308066
               3 |    1521572308120
               4 |    1521572308165
               5 |    1521572308251
               6 |    1521572308309
               7 |    1521572308368
               8 |    1521572308411
             -37 |    1521572355687
               9 |    1521572393943
              10 |    1521572393948
              11 |    1521572393962
              12 |    1521572393981
              13 |    1521572611706
              15 |    1521574037455
              16 |    1521574037495
              17 |    1521574037532
              18 |    1521574037581
              19 |    1521574037615
              20 |    1521574037689
              21 |    1521574088424
              22 |    1521575795219
              23 |    1521575795262
              24 |    1521575795304
              25 |    1521575795360
              26 |    1521575795421
              27 |    1521575795469
              28 |    1521575795524
              29 |    1521575877562
              30 |    1521575877569
              31 |    1521575877583
              32 |    1521575877597
              33 |    1521575931525
              34 |    1521575953500
              37 |    1521576171907
              74 |    1521645259319
              75 |    1521645438413
              76 |    1521645438454
              77 |    1521645438494
              78 |    1521645438547
              79 |    1521645438609
              80 |    1521645438655
              81 |    1521645438714
              82 |    1521645470188
              83 |    1521645470196
              84 |    1521645599304
              85 |    1521645599320
              86 |    1521645599341
              87 |    1521645650582
              88 |    1521645761593
            1935 |    1521652333977
            1976 |    1521652335655
            1981 |    1521655027753
             102 |    1521664468066
             105 |    1521665147027
             109 |    1521730708443
             110 |    1521730730569
             111 |    1521730844548
             112 |    1521730897821
             113 |    1521730964819
             130 |    1521736076115
            2001 |    1521903228708
             -38 |    1521993806181
             278 |    1522055175593
             279 |    1522055175647
             280 |    1522055175717
             281 |    1522055486973
             282 |    1522055487010
             283 |    1522055487069
             284 |    1522056003106
             285 |    1522056003151
             286 |    1522056003209
            2073 |    1522140026751
             348 |    1522158345704
             372 |    1522182446171
             375 |    1522182899308
            1936 |    1522200857161
            2078 |    1522201697620
             396 |    1522272491120
            2025 |    1522448541040
            1972 |    1522448709917
            2067 |    1522448863763
            1937 |    1522495657007
            1991 |    1522510743942
            1961 |    1522526876314
            1938 |    1522618333544
            2045 |    1522618476970
             704 |    1522778296614
             705 |    1522778296712
             706 |    1522778296767
             707 |    1522778296832
             708 |    1522778296891
             709 |    1522778296985
             710 |    1522778297070
             712 |    1522778336488
             729 |    1522778879674
             730 |    1522778879678
            1939 |    1522838791658
            1940 |    1522838794492
            1941 |    1523117018118
            1970 |    1523231958680
            2085 |    1523387773243
            2006 |    1523389129192
            1282 |    1523599876922
            1942 |    1523708319451
            2079 |    1523713489814
            1997 |    1523750134637
            2080 |    1523750137893
            1382 |    1523909125151
            1383 |    1523909125208
            1384 |    1523909125255
            1385 |    1523909125320
            1386 |    1523909125387
            1387 |    1523909125454
            1943 |    1524092396437
            1944 |    1524155116941
            2051 |    1524155221685
            1999 |    1524156324128
            1945 |    1524173828080
            1946 |    1524174351770
            2049 |    1524174788149
            1947 |    1524174828420
            2035 |    1524175300892
            2016 |    1524178563993
            2041 |    1524178585533
            2072 |    1524233017454
            1948 |    1524299378199
            2044 |    1524308249148
            1949 |    1524322308399
            1950 |    1524338644408
            1431 |    1524395808263
            1432 |    1524395808329
            1433 |    1524395808383
            1434 |    1524395808440
            1435 |    1524395808498
            1436 |    1524395808557
            1437 |    1524395808626
            1951 |    1524485894347
            1977 |    1524494654042
            2058 |    1524494819749
            1964 |    1524494997511
            1968 |    1524495136223
            1443 |    1524518300943
            1994 |    1524546113523
            1446 |    1524566586745
            1463 |    1524581143506
            1477 |    1524586363385
            1952 |    1524598219347
            2021 |    1524636157709
             -36 |    1524674625079
            1998 |    1524733966676
            1984 |    1524793462786
            2065 |    1524793513100
            1983 |    1524809410327
            1953 |    1524841768121
            1954 |    1524857659970
            2008 |    1524865827560
            1993 |    1524866135151
            1773 |    1525004258897
            1774 |    1525004258967
            1775 |    1525004259027
            1776 |    1525004259084
            1777 |    1525004259134
            1778 |    1525004259192
            1779 |    1525004259263
            1784 |    1525004375615
            1782 |    1525004375620
            1780 |    1525004375646
            1781 |    1525004375650
            1783 |    1525004375656
            1785 |    1525004375917
            1786 |    1525004375990
            1787 |    1525004454510
            1788 |    1525004509875
            1789 |    1525004650896
            1790 |    1525004817128
            1797 |    1525030889046
            -135 |    1525080150687
            1967 |    1525080191781
            1805 |    1525097690472
            1806 |    1525097720203
            -632 |    1525097872942
            1808 |    1525097900296
            1809 |    1525098006698
            1810 |    1525098006781
            1811 |    1525098006834
            1812 |    1525098006892
            1813 |    1525098006965
            1814 |    1525098007025
            1815 |    1525098103437
            1816 |    1525098186773
            1817 |    1525098252636
            1818 |    1525098312236
            1819 |    1525098505784
            1820 |    1525099269201
            1821 |    1525099370475
            1822 |    1525099413956
            1823 |    1525100087873
            1824 |    1525100148933
            -643 |    1525100702897
            -644 |    1525100737018
            -645 |    1525100843400
            1829 |    1525101592393
            1830 |    1525101673901
            1831 |    1525101748526
            1832 |    1525102586182
            -650 |    1525102656757
            1852 |    1525103497969
            1853 |    1525103539147
            1854 |    1525103689984
            1855 |    1525103841473
            -651 |    1525103985902
            2088 |    1525104048200
            2090 |    1525104081922
            2091 |    1525104084189
            2092 |    1525104085829
            2093 |    1525104086725
            2095 |    1525104087318
            2096 |    1525104087501
            2097 |    1525104087630
            2089 |    1525104087771
            2102 |    1525104136437
            2103 |    1525104169540
            2105 |    1525104237558
            2106 |    1525104279902
            2107 |    1525104452432
            -652 |    1525104598620
            2115 |    1525111373841
            2207 |    1525721345028
            2269 |    1526287775659
            2270 |    1526287775805
            2271 |    1526287775883
            2272 |    1526287775946
            2273 |    1526287776025
            2274 |    1526287776100
            2275 |    1526287776166
            2278 |    1526287834516
            2284 |    1526288024992
            2285 |    1526288025133
            2322 |    1526375000497
            2323 |    1526375000550
            2324 |    1526375000610
            2325 |    1526375000659
            2326 |    1526375000732
            2327 |    1526375000810
            2328 |    1526375000869
            2353 |    1526389121940
            2382 |    1526395851322
            2381 |    1526395851334
            2404 |    1526423029624
            2466 |    1526669973846
            2482 |    1526732014238
            -654 |    1526896609473
            2510 |    1526924731570
            2513 |    1526970501619
            2514 |    1526986647997
            2515 |    1526987916476
            2516 |    1526987949795
            2552 |    1527002803136
            2553 |    1527003220322
            2554 |    1527003231555
            2557 |    1527003411065
            2558 |    1527004216527
            2560 |    1527005123165
            2582 |    1527273570402
            2583 |    1527273583076
            2587 |    1527277468759
            2588 |    1527277856188
            2661 |    1528192488326
            2705 |    1528385523040
            2706 |    1528385523104
            2707 |    1528385523155
            2708 |    1528385523222
            2709 |    1528385523288
            2710 |    1528385523352
            2711 |    1528385523439
            2712 |    1528385541134
            2713 |    1528385596104
            2714 |    1528385609620
            2715 |    1528385632536
            2716 |    1528385666310
            2718 |    1528385697156
            2717 |    1528385697167
            2719 |    1528385770483
            2720 |    1528385784940
            2721 |    1528385809587
            2722 |    1528385879096
            2724 |    1528386073668
            2725 |    1528386088514
            2727 |    1528386172045
            2728 |    1528386228718
            2729 |    1528386251403
            2730 |    1528386263060
            2731 |    1528386281459
            2732 |    1528386307498
            2733 |    1528386422478
            2734 |    1528386451892
            2735 |    1528386460229
            2736 |    1528386510754
            2737 |    1528386565968
            2738 |    1528387338474
            2745 |    1528400217106
            2746 |    1528407772222
            2762 |    1528820507704
            2763 |    1528820561386
            2764 |    1528820571559
            2765 |    1528825376947
            2766 |    1528825538914
            2767 |    1528842711538
            2770 |    1528879513909
            2771 |    1528879540839
            2772 |    1528882518728
            2773 |    1528882592449
            2776 |    1528969618184
            2777 |    1528969866560
            2781 |    1528989919539
            2782 |    1528989945665
            2786 |    1528997064169
            2787 |    1528997078232
            2789 |    1529000671332
            2790 |    1529001575640
            2791 |    1529001698879
            2792 |    1529001714754
            2793 |    1529001728819
            2794 |    1529002098413
            2795 |    1529002189536
            2797 |    1529050168571
            2799 |    1529074598759
            2800 |    1529074877266
            2801 |    1529075648451
            2802 |    1529077358101
            2803 |    1529077552480
            2804 |    1529077592067
            2805 |    1529077596058
            2806 |    1529077677363
            2807 |    1529078518449
            2808 |    1529079263137
            2817 |    1529081102237
            2818 |    1529083024702
            2824 |    1529143676315
            2825 |    1529143787070
            2835 |    1529178485112
            2836 |    1529268842818
            2837 |    1529269021936
            2839 |    1529303396995
            2840 |    1529303597905
            2841 |    1529303642360
            2842 |    1529303698116
            2844 |    1529332740175
            2845 |    1529333923400
            2846 |    1529334011328
            2847 |    1529334022379
            2848 |    1529334027879
            2849 |    1529334043967
            2850 |    1529334067347
            2851 |    1529334096588
            2852 |    1529334129081
            2853 |    1529334148395
            2854 |    1529334170459
            2855 |    1529334183102
            2856 |    1529334193527
            2857 |    1529334301402
            2858 |    1529334401903
            2859 |    1529334411595
            2860 |    1529334469720
            2861 |    1529334545894
            2862 |    1529334791942
            2863 |    1529334899533
            2864 |    1529335016842
            2865 |    1529335153180
            2866 |    1529335199546
            2869 |    1529336069590
            2870 |    1529336467360
            2871 |    1529336590697
            2872 |    1529336606198
            2873 |    1529336640144
            2874 |    1529336667853
            2875 |    1529336680062
            2876 |    1529336755365
            2877 |    1529336842894
            2878 |    1529336881329
            2879 |    1529336910769
            2880 |    1529336925294
            2881 |    1529337148225
            2882 |    1529337237615
            2884 |    1529337678564
            2897 |    1529415109073
            2905 |    1529439490876
            2907 |    1529440579825
            2912 |    1529496113437
            2913 |    1529507408544
            2914 |    1529507448541
            2915 |    1529507471678
            2916 |    1529507488461
            2917 |    1529507619366
            2918 |    1529507969623
            2920 |    1529508000564
            3006 |    1529954023433
            3007 |    1529954023586
            3008 |    1529954023712
            3009 |    1529954023787
            3010 |    1529954023881
            3011 |    1529954023947
            3012 |    1529954024013
            3013 |    1529954030210
            3014 |    1529954330442
            3015 |    1529961395211
            3016 |    1529961580169
            3017 |    1529961640402
            3018 |    1529961705004
            3019 |    1529970711757
            3020 |    1529987287248
            3031 |    1530045044478
            3035 |    1530049148673
            3040 |    1530129453438
            3041 |    1530130875261
            3042 |    1530130937224
            3043 |    1530131708745
            3044 |    1530131728224
            3045 |    1530131734008
            3046 |    1530132463151
(613 rows)

@ukcb
Copy link
Author

ukcb commented Jul 7, 2018

I partly see a Purge-ID, so it seems to work in principle. I will keep watching.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@richvdh @ukcb