Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change filestore to be indexed by unique ID #720

Merged
merged 11 commits into from
Jul 23, 2019

Conversation

drawlerr
Copy link
Contributor

@drawlerr drawlerr commented Jul 1, 2019

Races in the filestore will now be stored by their Trial ID, not their timestamp.

Relates #697

Copy link
Contributor

@dliappis dliappis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks like a well contained and solid change to me, thanks!

A few additional things:

@drawlerr drawlerr marked this pull request as ready for review July 3, 2019 13:42
@drawlerr drawlerr removed the request for review from danielmitterdorfer July 3, 2019 14:24
@drawlerr drawlerr added this to the 1.3.0 milestone Jul 3, 2019
Copy link
Contributor

@dliappis dliappis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left a comment as I don't fully understand why we need the latest commit 527e93a

We'll still need the changes in the docs mentioned here: #720 (review)

esrally/metrics.py Show resolved Hide resolved
@dliappis dliappis requested review from danielmitterdorfer and removed request for danielmitterdorfer July 8, 2019 13:39
@drawlerr drawlerr added the :Benchmark Candidate Management Anything affecting how Rally sets up Elasticsearch label Jul 10, 2019
Copy link
Contributor

@dliappis dliappis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for iterating! LGTM

Copy link
Member

@danielmitterdorfer danielmitterdorfer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think there is one bit missing: A workflow that we support is that the user retrieves the trial id (usually via esrally list races) and then compares two trial ids (esrally compare --baseline=... --contender=...). But at the moment this does not work. Listing races still shows timestamps but they cannot be used when comparing. Also, the compare subcommand needs to search via trial id now. I think it would be nice though if we would still show the trial timestamp in addition in the list subcommand (in the second column). Note that this also requires changing the respective docs in https://esrally.readthedocs.io/en/stable/tournament.html.

@danielmitterdorfer danielmitterdorfer added the enhancement Improves the status quo label Jul 11, 2019
@dliappis
Copy link
Contributor

@drawlerr c8f0d82 and 4131665 look good to me, thanks! The tournament docs still need updating.

Copy link
Member

@danielmitterdorfer danielmitterdorfer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for iterating. It looks mostly fine now; I just have a couple of minor comments.

esrally/reporter.py Show resolved Hide resolved
docs/tournament.rst Outdated Show resolved Hide resolved
Copy link
Member

@danielmitterdorfer danielmitterdorfer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for iterating. The changes look good to me now. LGTM :)

@drawlerr drawlerr merged commit aed6776 into elastic:master Jul 23, 2019
@drawlerr drawlerr deleted the unique-id branch July 23, 2019 16:21
novosibman pushed a commit to novosibman/rally that referenced this pull request Aug 12, 2019
novosibman pushed a commit to novosibman/rally that referenced this pull request Aug 12, 2019
novosibman pushed a commit to novosibman/rally that referenced this pull request Aug 12, 2019
danielmitterdorfer added a commit to danielmitterdorfer/rally that referenced this pull request Sep 13, 2019
With this commit we store the race file always as `race.json`.
Previously Rally had a logic built-in to create a unique file name if
there was a potential for duplicate race files (with the same race
timestamp) but as we're using the race id now for the base directory
this is not possible anymore.

Relates elastic#720
danielmitterdorfer added a commit that referenced this pull request Sep 16, 2019
With this commit we store the race file always as `race.json`.
Previously Rally had a logic built-in to create a unique file name if
there was a potential for duplicate race files (with the same race
timestamp) but as we're using the race id now for the base directory
this is not possible anymore.

Relates #720
Relates #773
novosibman pushed a commit to novosibman/rally that referenced this pull request Oct 2, 2019
With this commit we store the race file always as `race.json`.
Previously Rally had a logic built-in to create a unique file name if
there was a potential for duplicate race files (with the same race
timestamp) but as we're using the race id now for the base directory
this is not possible anymore.

Relates elastic#720
Relates elastic#773
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Benchmark Candidate Management Anything affecting how Rally sets up Elasticsearch enhancement Improves the status quo
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants