Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: comparison bugs #1137

Merged
merged 5 commits into from
Nov 9, 2022
Merged

Conversation

alexbarros
Copy link
Contributor

@alexbarros alexbarros commented Nov 7, 2022

Fixed some bugs (most likely caused by refactoring) and added support to time series comparison
autocorr
ts_support

@alexbarros alexbarros marked this pull request as ready for review November 7, 2022 15:53
@akx
Copy link
Contributor

akx commented Nov 8, 2022

Oh, and in addition to the inline review: if bugs are being fixed, shouldn't there be tests to verify them?

@codecov-commenter
Copy link

Codecov Report

Base: 89.94% // Head: 89.42% // Decreases project coverage by -0.51% ⚠️

Coverage data is based on head (7d31d55) compared to base (da26545).
Patch coverage: 34.04% of modified lines in pull request are covered.

Additional details and impacted files
@@                    Coverage Diff                     @@
##           feat/report-comparison    #1137      +/-   ##
==========================================================
- Coverage                   89.94%   89.42%   -0.52%     
==========================================================
  Files                         177      177              
  Lines                        5220     5258      +38     
==========================================================
+ Hits                         4695     4702       +7     
- Misses                        525      556      +31     
Flag Coverage Δ
py3.8-ubuntu-latest-pandas 89.42% <34.04%> (-0.52%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
src/pandas_profiling/visualisation/plot.py 72.72% <27.50%> (-7.83%) ⬇️
...ng/report/structure/variables/render_timeseries.py 93.10% <66.66%> (-6.90%) ⬇️
src/pandas_profiling/profile_report.py 80.78% <100.00%> (+0.08%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@alexbarros alexbarros merged commit 957a8dc into feat/report-comparison Nov 9, 2022
@alexbarros alexbarros deleted the fix/comparison_bugs branch November 9, 2022 13:49
alexbarros added a commit that referenced this pull request Nov 18, 2022
* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test
alexbarros added a commit that referenced this pull request Nov 18, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
alexbarros added a commit that referenced this pull request Nov 19, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
vascoalramos pushed a commit that referenced this pull request Nov 22, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
vascoalramos pushed a commit that referenced this pull request Nov 22, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
vascoalramos pushed a commit that referenced this pull request Nov 22, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
vascoalramos pushed a commit that referenced this pull request Nov 22, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
vascoalramos pushed a commit that referenced this pull request Nov 22, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
vascoalramos pushed a commit that referenced this pull request Nov 22, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
aquemy pushed a commit that referenced this pull request Nov 22, 2022
* ci: check for flake8 comprehensions

* fix(config): configuration order is now respected

* fix: index is no longer automatically added to dataframe

* feat: correlation alerts show the name of the correlation

* fix: strip tags from the title of the web report

* feat: comparing two or more datasets (see docs)

* docs(comparison): feature description

* docs(readme): include reference to the dataset comparison use case

* refactor: config private attribute

* refactor: config update, exclude defaults

* refactor: include style attribute in timeseries code

* refactor: include style attribute in templates

* test(comparisons): add tests for report comparison

* refactor: overall correlation lowercase

* refactor: frequency table kwargs

* refactor: frequency table styling

* refactor: fixing renderable tests

* refactor: fixing renderable tests

* style: formatting

* refactor: senstive test

* refactor: pass style argument

* feat: check for empty dataframe

* refactor: namespace invariant type check

* refactor: ipywidgets fixes

* refactor: ipywidgets no comparison support yet

* refactor: process feedback

* fix: comparison bugs (#1137)

* fix: refactoring bugs

* fix: update protected var labels for comparison

* fix: add support to timeseries comparison

* fix: style changes for readability

* test: add simple run test

* fix: reword comparison report doc (#1136)

* fix: rewording

Co-authored-by: Aarni Koskela <[email protected]>

* feat: add comparison validations (#1143)

* feat: add comparison validations

* feat: replace missing plots to avoid dependencies' confilicts (#1148)

* feat: add new missing histogram plot

* feat: add new missing matrix plot

* feat: add new missing heatmap plot

* feat: remove dendrogram

* feat: ignore columns not present on the base report (#1150)

* feat: select only the left side of the comparison

* chore: pre-commit fixes

* fix: not intersection of columns

* [skip ci] Code formatting

* fix: missing plots columns order

* [skip ci] Code formatting

* fix: interactions/missing plot colors

* fix: code formatting

Co-authored-by: Aarni Koskela <[email protected]>
Co-authored-by: Azory YData Bot <[email protected]>
Co-authored-by: alexbarros <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants