-
Notifications
You must be signed in to change notification settings - Fork 12
/
ChangeLog.txt
276 lines (209 loc) · 9.76 KB
/
ChangeLog.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
#
# Copyright 2016-2021 Internet Corporation for Assigned Names and Numbers.
#
# This Source Code Form is subject to the terms of the Mozilla Public
# License, v. 2.0. If a copy of the MPL was not distributed with this
# file, you can obtain one at https://mozilla.org/MPL/2.0/.
#
Version 1.2.3 - 2023-07-31
--------------------------
* No change from ~rc2.
Version 1.2.3-rc2 - 2023-07-10
--------------------------
* Update m4 macros to remove build warnings on Ubuntu Jammy
* Inspector: Update pseudoanonymisation code for OpenSSL 3.0 to remove warnings
about deprecated functions on Ubuntu Jammy
Version 1.2.3-rc1 - 2023-06-14
--------------------------
* Inspector: Extend template backend to write EDNS OPT codes
Version 1.2.2 - 2022-07-11
--------------------------
* Minor documentation updates
Version 1.2.2-rc1 - 2022-05-24
--------------------------
* Extend SIGUSR1 mechanism to DNSTAP capture
* Align DNSTAP stats logging better with network capture stats logging
* Various minor updates to documentation
Version 1.2.2-beta1 - 2022-05-18
--------------------------
* Provide a mechanism to force a C-DNS file rollover via a SIGUSR1 signal to
compactor. See KNOWN ISSUES for more info on file rollover issues. This change
does not effect PCAP file rollovers. NOTE: this can result in a C-DNS file
containing no DNS messages being produced.
* Update Catch from 2.13.2 to 2.13.9 (Thanks LeSuisse)
Version 1.2.1 - 2022-03-23
--------------------------
* Minor documentation update to address
https://github.com/dns-stats/compactor/issues/80
Version 1.2.1-rc2 - 2022-01-26
--------------------------
* The behaviour of `compactor` is changed when an interrupt (SIGINT, SIGTERM)
is received e.g. when the service is restarted or a user enters ^C.
Previously all of the in progress C-DNS compression was aborted and all of
the in progress output files (compressed and uncompressed) were removed. Now
the `.raw` uncompressed output file is left on disk so it can be manually
recovered (i.e. renamed and compressed). Users will now need to choose how to
managed these uncompressed files. Behaviour on SIGHUP (re-reading of config
file without affecting any in progress compression) is unchanged.
* Additional default logging is added of the specific signal received by
`compactor`, when file rotation occurs and when compression is aborted.
* New `log-file-handing` option to log low level details of file
processing on file rotation and compression. This aids with debugging of file
processing problems and measurement of C-DNS file compression times.
* Text added in the documentation to clarify time patterns are needed in file
output patterns for filename based file rotation to occur (based on the
`rotation-period` option).
* Fix a bug relating to `compactor` start_time handling introduced in rc1.
Version 1.2.1-rc1 - 2022-01-18
--------------------------
* Modify the format output by the debug option `--debug-qr` to be more human
readable (`--debug-dns` output is left unchanged).
* Fix 2 minor bugs where an incorrect start time could be written to the CDNS
file, resulting in a negative file duration.
* Documentation: correct the dependency list.
* Fix build issue when using `configure --disable-pseudo-anonymisation`. Thanks
Sean Burford for reporting this.
* Add example docker image as a submodule in `contrib/dns-stats-docker`. Thanks
to Sean Burford for providing this.
Version 1.2.1-beta2 - 2021-09-23
--------------------------
* Bump the private version because schema extended with new stats.
* Add new stats to C-DNS: sniffer drops, matcher drops and sampling discards,
and 3 libpcap stats. The libpcap stats should not be considered reliable and
provided for information only.
* Fix file durations for files with more than one C-DNS block in them so high
traffic rates can be correctly calculated from the statistics.
* Constrain size of matcher queue to reduce memory consumption when
dropping/sampling.
* Add `-D` option (--relaxed-mode). With this option a warning (not an error) is
issued for unrecognized command line and config file options.
Version 1.2.1-beta1 - 2021-08-23
--------------------------
* Change behaviour of internal sniffer channel when overloaded to better
report and manage dropping/sampling of packets
* This fixes a bug where the 'Total Packets processed' statistic did not
include any packets dropped during overload
* Improve `log-interval` statistics and packet drop logging
* EXPERIMENTAL: New sampling mode option (disabled by default)
* sampling can be enabled at a specified rate for a specified time
when packet drops exceed a specified threshold (see config options)
Version 1.2.0 - 2021-05-07
--------------------------
* Fix build issue when using --disable-dnstap.
* Add KNOWN ISSUE about the observed performance on VMs being much lower than
expected, which is under investigation.
* Minor documentation updates.
Version 1.2.0-rc1 - 2021-04-19
------------------------------
* Get revised signal handling building on Mac as well as Linux and FreeBSD.
* Correct stats reporting processed message count to RFC8618. Retain
total packet count as compactor-specific item.
* Minor test and documentation updates.
Version 1.2.0-beta4 - 2021-04-12
--------------------------------
* Add raw packet count and out of order count to statistics when
collecting through DNSTAP. Also optionally periodically log statistics
during collection as with PCAP.
* Revise signal handling for better reliability with DNSTAP.
* Catch malformed packets in DNSTAP collection and add count to statistics.
* If configured service address does not exist on any interface
log a warning not an error.
Version 1.2.0-beta3 - 2021-03-30
--------------------------------
* Add DNSTAP options to sample config file.
Version 1.2.0-beta2 - 2021-03-25
--------------------------------
* Doxygen updates.
Version 1.2.0-beta1 - 2021-03-24
--------------------------------
* Add custom field of collection start time to block and to info file.
File duration in info file is now end-start time.
* Add capture from DNSTAP, either over Unix socket or from file.
Version 1.1.0 - 2020-12-09
--------------------------
* No change from ~rc1.
Version 1.1.0-rc1 - 2020-11-25
------------------------------
* No change from ~beta1.
Version 1.1.0-beta1 - 2020-10-26
--------------------------------
* Add custom field of collection end time to block and time
section to info file.
Version 1.0.0 - 2020-03-12
--------------------------
* No change from ~rc1.
Version 1.0.0-rc1 - 2020-02-25
------------------------------
* Fix exception decoding IPv6 without transport flags.
* Additional filtering in test for newer tshark versions.
Version 1.0.0-beta1 - 2019-09-20
--------------------------------
* Supports C-DNS as described in RFC8618.
** compactor writes only C-DNS 1.0 format.
** inspector reads C-DNS 1.0 and all previously supported draft formats.
* New fine-grained selection of data stored in C-DNS via excluded_fields file.
** Previous section 'include' settings are deprecated,
and may only be used if excluded_fields file is not specified.
** Default values may be supplied to inspector for individual items of data not
present in the C-DNS file. A complete set of defaults must be supplied
when outputting PCAP.
* inspector command line options --info-only and --report-only are
deprecated, and replaced with --no-info and --no-output.
* Added template items query_response_query_has_no_question
and query_response_response_has_no_question. Item
query_response_query_has_question is deprecated.
* Addresses stored in C-DNS files may be stored only to a given prefix
length, potentially saving storage space.
Version 0.12.3 - 2019-07-08
---------------------------
* Fix occasional failure in tshark test.
Version 0.12.3-rc1 - 2019-05-22
-------------------------------
* Add new Geo template modifier for AS netmask.
* Improve build speed by building common objects into static library.
* Fix spacing bug in inspector error output.
Version 0.12.2 - 2019-02-08
---------------------------
* Bug fix: inspector was not reading query size from C-DNS and
reporting 0 for query_size in templates.
* Correct response delay field name in test template and add
additional template test.
* Documentation: Document Geo template modifiers.
Version 0.12.1 - 2019-02-06
---------------------------
* Documentation: corrections.
Version 0.12.1-rc1 - 2019-01-21
-------------------------------
* Fix bug stopping pseudo-anonymisation key specification on command line.
* Accept PCAP with link type RAW as produced by dnscap.
* Add optional file rotation on compactor output when uncompressed
output reaches a specified limit.
* Add text template inspector output format as alternative to PCAP output.
* Small change to .info format when reporting inconsistencies converting
C-DNS to PCAP.
* Improve error handling on packet decode.
Version 0.11.1 - 2018-05-08
---------------------------
* Documentation: correct location of compactor configuration file.
Version 0.11.1-rc1 - 2018-05-03
-------------------------------
* Enable use with libtins v4.0.
* Fix potential (but never seen) segfault in response matching.
* Check for required tools in test scripts and skip test if not found.
Version 0.11.0 - 2018-03-12
---------------------------
* Document draft version implemented.
* Fix documentation internal links.
Version 0.11.0-rc1 - 2018-03-05
-------------------------------
* Add pseudo-anonymisation of output to inspector.
* CBOR - use definite-length items where possible.
* Small packet receive optimisation.
* Improve detection of malformed EDNS0.
Version 0.10.1 - 2017-06-16
---------------------------
* Fix typos in README and author in user guide.
* Add missing file to distribution tarball.
Version 0.10.0 - 2017-06-15
---------------------------
* First open source release.