Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[aggregator] Add support for default configuration #3856

Merged
merged 2 commits into from
Oct 20, 2021
Merged

Conversation

nbroyles
Copy link
Collaborator

What this PR does / why we need it:

This commit adds sane defaults that can be used for spinning
up the aggregator. Allows clients to greatly simplify the
provided config and only specify configuration options they need.
Additionally makes spin up of aggregator for local development
and integration tests easier. Also, does some minor cleanup
for aggregator in test harness.

Special notes for your reviewer:

Does this PR introduce a user-facing and/or backwards incompatible change?:


Does this PR require updating code package or user-facing documentation?:


This commit adds sane defaults that can be used for spinning
up the aggregator. Allows clients to greatly simplify the
provided config and only specify configuration options they need.
Additionally makes spin up of aggregator for local development
and integration tests easier. Also, does some minor cleanup
for aggregator in test harness.
@nbroyles nbroyles requested a review from fishie9 October 19, 2021 22:23
@codecov
Copy link

codecov bot commented Oct 19, 2021

Codecov Report

Merging #3856 (021d816) into master (021d816) will not change coverage.
The diff coverage is n/a.

❗ Current head 021d816 differs from pull request most recent head c69b9b6. Consider uploading reports for the commit c69b9b6 to get more accurate results

Impacted file tree graph

@@          Coverage Diff           @@
##           master   #3856   +/-   ##
======================================
  Coverage    56.8%   56.8%           
======================================
  Files         552     552           
  Lines       63272   63272           
======================================
  Hits        35980   35980           
  Misses      24087   24087           
  Partials     3205    3205           
Flag Coverage Δ
aggregator 63.3% <0.0%> (ø)
cluster ∅ <0.0%> (∅)
collector 58.4% <0.0%> (ø)
dbnode 60.4% <0.0%> (ø)
m3em 46.4% <0.0%> (ø)
metrics 19.7% <0.0%> (ø)
msg 74.4% <0.0%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 021d816...c69b9b6. Read the comment docs.


return cfg, nil
}

func updateAggregatorFilepaths(cfg config.Configuration) (config.Configuration, []string, error) {
tmpDirs := make([]string, 0, 1)
if cfg.KVClient.Etcd != nil && cfg.KVClient.Etcd.CacheDir == "*" {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this * something we need to keep around?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nah, that's an old convention that I'm killing off here. Good question though

@nbroyles nbroyles merged commit 5fe396f into master Oct 20, 2021
@nbroyles nbroyles deleted the nb/agg-defaults branch October 20, 2021 19:58
soundvibe pushed a commit that referenced this pull request Oct 26, 2021
* master:
  Remove unused message-read-error metric (#3869)
  Add p75/p25 as aggregation options (#3867)
  [aggregator] track dirty values to consume instead of scanning all within buffer past (#3847)
  [rules] Correctly match rollup tags for excludeBy operations (#3865)
  [dbnode] Create empty warm index fileset (#3859)
  [aggregator] Allow wait during tick to be interrupted on close (#3861)
  [aggregator] Add support for default configuration (#3856)
  [dbnode] Add WriteAttempt integration test index helper method (#3860)
  [tools] Allow reading all the shards in the directory in read_data_files (#3857)
  [tests] Add test for in-process aggregator writes
  [tools] Add annotation_checker tool (#3854)
  [tests] Convert docker-integration-tests/simple/test.sh to in-process test (#3850)
  [documentation] Update rollup rules documentation to provide an example of aggregating gauges (#3852)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants