Add log entries for prefill plugins to submissions

[LaurensBurger]

Thema / Theme

Admin

Omschrijving / Description

When investigating something wrong/missing from a submission it would be nice to see the status of the prefill plugin results and if the cause of why i'm looking at the submission was in fact the prefill plugin failing to retrieve data.

Currently the prefill plugins are logged in the timeline log entries as:

[[2024-07-11 11:19:23 CEST] (Submission 123): Prefill plugin "StUF-BG" (stufbg) reported: Successfully retrieved information to prefill fields: BSN (bsn), Geslacht (geslachtsaanduiding), Straatnaam (straatnaam), Voornamen (voornamen), Huisnummer (huisnummer), Voorvoegsels (voorvoegselGeslachtsnaam), Huisletter (huisletter), Achternaam (geslachtsnaam), Toevoeging (huisnummertoevoeging), Postcode (postcode), Woonplaats (woonplaatsNaam), Geboortedatum (geboortedatum)]
or
[[2024-07-10 15:28:44 CEST] (Submission 123): Prefill plugin "KvK Bedrijf via KvK-nummer" (kvk-kvknumber) returned empty values]

if these were also visible in the submission log, it would save them a lot of time (since the log entries search is very slow and not very accurate)

Added value / Toegevoegde waarde

No response

Aanvullende opmerkingen / Additional context

No response

[joeribekker]

Refinement: It might be related to excluded entries because of AVG. It might be just removing this exclude. Please check and report in this ticket what other entries will popup because of this.

[vaszig]

Refinement: It might be related to excluded entries because of AVG. It might be just removing this exclude. Please check and report in this ticket what other entries will popup because of this.

This is happening on purpose since all the prefill log events are marked as TimelineLogTags.AVG. All this kind of tags are excluded from the SubmissionLogInline and this was done because of #943. Removing the exclude would mean that we show the prefill fields in the admin, but the following are affected as well:

• outgoing_request_log_details_view_admin
• submission_details_view_admin
• submission_details_view_api
• submission_export_list

@joeribekker what is your opinion?Do we want to revert this and remove the exclude?

[joeribekker]

Can we add a new tag "submission lifecycle" and just use this as filter on the submission page?

[sergei-maertens]

Refinement:

• Currently some log records are tagged as AVG/GDPR so they can be filtered
• The submissions logs now exclude this tag
• Tags are not meant to be used for excusion, rather inclusion
• Add new tag for all lifecycle events and do an inclusion filter instead of the AVG exclusion
• This means that an event can have multiple (decoupled) tags so they show up in different contexts