v23.04.0 development #247
Merged
v23.04.0 development #247
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…version updates and bug fixes. idaholab/Malcolm@v6.4.2...v6.4.3 * Enhancements - Import the [NetBox Device Type Library](https://github.com/netbox-community/devicetype-library) on NetBox first run to populate manufacturers, device types, models and modules - [idaholab#127](idaholab#127) have `install.py --configure` ask about other storage locations for PCAP, Zeek logs and OpenSearch indices - [idaholab#128](idaholab#128) have `install.py --configure` prompt for Arkime to manage uploaded PCAP files or not * Component version updates - Alpine Linux to [v3.17](https://alpinelinux.org/posts/Alpine-3.17.0-released.html) for some Docker containers' base images - Filebeat to [v8.5.2](https://www.elastic.co/guide/en/beats/libbeat/current/release-notes-8.5.2.html) - NetBox to [v3.3.9](https://github.com/netbox-community/netbox/releases/tag/v3.3.9) - Zeek to [v5.0.4](https://github.com/zeek/zeek/releases/tag/v5.0.4) - opensearch-py to [v2.0.1](https://github.com/opensearch-project/opensearch-py/releases/tag/v2.0.1) - Fluent Bit to [v2.0.6](https://www.fluentbit.io/announcements/v2.0.6/) * Fixes - Fix some bad links in the documentation and other minor documentation improvements - Fix [idaholab#126](idaholab#126), suricata logs show up in Arkime as "notip" for the protocol - Fix [idaholab#129](idaholab#129), filtering by rootId in Arkime returns no results - Fix Docker health checks for NetBox and supporting containers - Fix "read-only" version of nginx.conf - Tweaks to `install.py` memory recommendations Squashed commit of the following: commit 40c7ea0 Merge: 476d941 92e8800 Author: Seth Grover <[email protected]> Date: Tue Dec 6 14:38:24 2022 -0700 Merge branch 'development' of https://github.com/mmguero-dev/Malcolm into v643_merge_idaholab commit 92e8800 Author: Seth Grover <[email protected]> Date: Tue Dec 6 14:37:20 2022 -0700 update SHA sums for ISOs for release candidate commit 63282c4 Author: Seth Grover <[email protected]> Date: Mon Dec 5 14:40:13 2022 -0700 for idaholab#127, apply 'wipe' logic to directories that are mounted in locations other than under Malcolm install repo. adds 'pyyaml' dependency to install/control scripts commit 476d941 Merge: 62518b1 8f25215 Author: Seth Grover <[email protected]> Date: Mon Dec 5 07:59:44 2022 -0700 Merge branch 'development' of https://github.com/mmguero-dev/Malcolm into v643_merge_idaholab commit 8f25215 Author: Seth Grover <[email protected]> Date: Mon Dec 5 07:58:19 2022 -0700 update SHA sums for ISOs for release candidate commit 782e9ed Author: Seth Grover <[email protected]> Date: Thu Dec 1 15:38:26 2022 -0700 ensure missing paths get assigned correct ownership if install.py is run by root commit 44fdcc3 Author: Seth Grover <[email protected]> Date: Thu Dec 1 13:11:47 2022 -0700 update SHA sums for ISOs for release candidate commit 8efa19e Author: Seth Grover <[email protected]> Date: Thu Dec 1 10:29:04 2022 -0700 documentation update commit 259cd29 Author: Seth Grover <[email protected]> Date: Thu Dec 1 09:49:39 2022 -0700 update nginx-proxy to be based on alpine 3.17 commit 935745d Author: Seth Grover <[email protected]> Date: Wed Nov 30 15:25:49 2022 -0700 remove fediverse link in embedded documentation commit 81124ed Author: Seth Grover <[email protected]> Date: Wed Nov 30 15:16:26 2022 -0700 Fix bad download links in embedded documentation commit 153ddf1 Author: Seth Grover <[email protected]> Date: Wed Nov 30 14:23:38 2022 -0700 fix reset with https commit 5671755 Author: Seth Grover <[email protected]> Date: Wed Nov 30 13:50:52 2022 -0700 added flexibility in demo reset/populate data commit 4e8e695 Author: Seth Grover <[email protected]> Date: Tue Nov 29 16:20:22 2022 -0700 Update opensearch-py to v2.0.1 (https://github.com/opensearch-project/opensearch-py/releases/tag/v2.0.1) commit 5b6ca11 Author: SG <[email protected]> Date: Tue Nov 29 10:10:22 2022 -0700 Update some docker images' base image from alpine 3.16 to 3.17 commit 4ac4381 Author: Seth Grover <[email protected]> Date: Tue Nov 29 07:02:21 2022 -0700 Fix 'E722 do not use bare except' warning commit fb5fa22 Author: Seth Grover <[email protected]> Date: Sat Nov 26 21:23:51 2022 -0700 Bump zeek to v5.0.4 commit cccb709 Author: Seth Grover <[email protected]> Date: Sat Nov 26 21:22:43 2022 -0700 beats v8.5.2 commit 569671c Author: Seth Grover <[email protected]> Date: Sat Nov 26 21:21:34 2022 -0700 fluent bit 2.0.6 for windows scripts commit 486ccbb Author: Seth Grover <[email protected]> Date: Mon Nov 21 13:58:59 2022 -0700 pause netbox in read-only mode commit bd05c0c Author: Seth Grover <[email protected]> Date: Mon Nov 21 13:17:08 2022 -0700 fix read-only version of nginx.conf commit b23bdb7 Author: Seth Grover <[email protected]> Date: Mon Nov 21 12:12:34 2022 -0700 tweak script for demo population commit f13fd12 Author: Seth Grover <[email protected]> Date: Mon Nov 21 10:57:33 2022 -0700 load netbox device type library on startup (see idaholab#17) commit 7be8ada Author: Seth Grover <[email protected]> Date: Mon Nov 21 09:03:12 2022 -0700 Fix idaholab#126, suricata logs show up in Arkime as 'notip' for protocol commit b20d0a3 Author: Seth Grover <[email protected]> Date: Mon Nov 21 08:30:34 2022 -0700 fix idaholab#129, filtering by rootId in Arkime returns no results commit 4cf2b81 Author: Seth Grover <[email protected]> Date: Mon Nov 21 06:58:08 2022 -0700 don't report netbox services as unhealthy if they are disabled commit 3d50a52 Author: Seth Grover <[email protected]> Date: Mon Nov 21 06:50:54 2022 -0700 adjust memory recommendations in install.py script commit 2fc15d4 Author: SG <[email protected]> Date: Fri Nov 18 12:28:18 2022 -0700 idaholab#127, have install.py --configure ask about other storage locations for PCAP, zeek logs and opensearch indices commit 9f73809 Author: SG <[email protected]> Date: Fri Nov 18 12:08:21 2022 -0700 specify keystore location commit aef542b Author: SG <[email protected]> Date: Fri Nov 18 11:59:52 2022 -0700 idaholab#127, have install.py --configure ask about other storage locations for PCAP, zeek logs and opensearch indices commit c40cd48 Author: SG <[email protected]> Date: Fri Nov 18 11:53:48 2022 -0700 idaholab#127, have install.py --configure ask about other storage locations for PCAP, zeek logs and opensearch indices commit 3501539 Author: SG <[email protected]> Date: Fri Nov 18 10:08:50 2022 -0700 implement idaholab#128, have install.py prompt for Arkime to manage PCAP or not commit f0ab2d8 Author: Seth Grover <[email protected]> Date: Thu Nov 17 12:52:25 2022 -0700 bump development for v6.4.3 commit a046e77 Author: Seth Grover <[email protected]> Date: Thu Nov 17 10:16:21 2022 -0700 update SHA sums for downloads
…into v23.01.0_merge_idaholab
…into v23.01.0_merge_idaholab
…into v23.02.0_merge_idaholab
…into v23.03.0_merge_idaholab
…into v23.03.0_merge_idaholab
Malcolm v23.03.0 is a release with enhancements, component version updates and bug fixes.
* Enhancements
- Replace Zeek's [misc/scan.zeek with ncsa/bro-simple-scan](https://github.com/zeek/zeek/blob/cdadc329859810244244c8800f0102543e4f134f/NEWS#L540-L541)
- terminate `start` and `restart` scripts once Malcolm has started properly (cisagov#240 and cisagov#241, thanks @Njinx)
- minor usability improvements for ISO-installed Malcolm and Hedgehog (idaholab#155)
+ Added a "Configure Malcolm" menu item (under the "Internet" GTK menu with the other Malcolm stuff) and launcher on the top panel of icons in Malcolm. This runs `./scripts/install.py --configure` in full screen. May look at starting this automatically on first boot in the future. (Malcolm)
+ Added Malcolm shortcut to gtk-3.0/bookmarks so it shows up in Thunar sidebar (Malcolm)
+ Added /opt/sensor/sensor_ctl shortcut to gtk-3.0/bookmarks so it shows up in Thunar sidebar (Hedgehog)
+ Have tilix from launcher panel start in /opt/sensor/sensor_ctl (Hedgehog)
- minor tweaks to defaults for `install.py --configure` (enable offline-capable file scanners by default)
- interrupt NetBox startup import script when `netbox-restore` is run
- added NetBox restore logic to `reset_and_auto_populate.sh` script (used mostly for demos and presentations)
* Component version updates
- Arkime to [v4.2.0](https://github.com/arkime/arkime/blob/93c89d68b25a4a56f7a6b8099a2661af9648ebaf/CHANGELOG#L39-L66)
- [OpenSearch](https://github.com/opensearch-project/OpenSearch/blob/bc50a2edcf29c3c41b7a777575c61e1874847d8a/release-notes/opensearch.release-notes-2.6.0.md) and [OpenSearch Dashboards](https://github.com/opensearch-project/OpenSearch-Dashboards/blob/69bcbfeea9bb345364e47f048cd5bcfe64c9c242/release-notes/opensearch-dashboards.release-notes-2.6.0.md) to 2.6.0
- [Logstash](https://www.elastic.co/guide/en/logstash/current/releasenotes.html) from v8.4.0 to v8.6.1
- [Beats](https://www.elastic.co/guide/en/beats/libbeat/current/release-notes-8.6.2.html) to v8.6.2
- Zeek to [v5.0.7](https://github.com/zeek/zeek/releases/tag/v5.0.7)
- OpenSearch-Py to [v2.2.0](https://github.com/opensearch-project/opensearch-py/releases/tag/v2.2.0) (and remove opensearch-dsl which is now part of opensearch-py)
- Supercronic to [v0.2.2](https://github.com/aptible/supercronic/releases/tag/v0.2.2)
- Capa to [v5.0.0](https://github.com/mandiant/capa/releases/tag/v5.0.0)
- Fluent Bit to [v2.0.9](https://github.com/fluent/fluent-bit/releases/tag/v2.0.9)
- Version updates to various Python package dependencies
* Fixes
- last few seconds' Zeek logs prior to log rotation may be lost (idaholab#151)
- in ISO-packaged Malcolm installation `scripts` directory, symlink `netbox-backup` and `netbox-restore` to `control.py`
- improve opensearchpy connect/health check logig in `pcap_watcher.py` in `pcap-monitor` container
…nal OpenSearch connections
…bar:version to ghcr.io/idaholab/malcolm/foobar:version
…r user configure
…rything every time
…rything every time
…s docker-compose YAML files
…into v23.04.0_merge_cisagov
…into v23.04.0_merge_cisagov
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
There was a problem hiding this comment.
CodeQL found more than 10 potential problems in the proposed changes. Check the Files changed tab for more details.
…into v23.04.0_merge_cisagov
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Malcolm v23.04.0 is a release with enhancements, component version updates and bug fixes.
v23.03.0...v23.04.0
Enhancements
tx-rx-secure.shscript as wrapper around croc automatically creating and using a local-only relayComponent version updates
Fixes
Malcolm and Hedgehog Linux may be obtained by pulling or building the Docker images and/or building the ISO installer images as described in the documentation. Unofficial ISO installer images for Malcolm and Hedgehog Linux are not hosted on GitHub, but may be downloaded from https://malcolm.fyi/.