Deletion of conflicting rule doesn't solve the route conflict

[oscartrullols]

I have created some oathkeeper rules, adding them as it's done in "ory/examples".

by mistake, two of them were applying to the same route, so obviously, the error when trying to access the route was:
{"error":{"code":500,"status":"Internal Server Error","message":"Expected exactly one rule but found multiple rules"}}

I delete one of them (and verify it has been deleted with GET /rules), but the error doesn't go away, even after waiting for more than 30s

see gist for details and steps to reproduce the problem

[aeneasr]

I can reproduce this.