Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open issues for each of the many cheeky it.skip() instances in the codebase. #1452

Closed
iAmMichaelConnor opened this issue Aug 8, 2023 · 5 comments · Fixed by #1583
Closed
Assignees
Labels
T-bug Type: Bug. Something is broken. T-testing Type: Testing. More tests need to be added.

Comments

@iAmMichaelConnor
Copy link
Contributor

Several tests are skipped, but without explanation. We should work through and understand why, and open issues (and add a comment to the code with the issue number).

@iAmMichaelConnor iAmMichaelConnor added T-bug Type: Bug. Something is broken. T-testing Type: Testing. More tests need to be added. labels Aug 8, 2023
@github-project-automation github-project-automation bot moved this to Todo in A3 Aug 8, 2023
@jeanmon jeanmon self-assigned this Aug 16, 2023
@jeanmon
Copy link
Contributor

jeanmon commented Aug 16, 2023

Confirmed tests which failed locally

  • acir-simulator, index.test.ts, 'should run the transfer function without enough sender balance' (Task 1588)
  • circuits.js, rollup_wasm_wrapper.test.ts, 'calls base_rollup__sim' (Task 1586)
  • circuits.js, rollup_wasm_wrapper.test.ts, 'calls root_rollup__sim' (Task 1586)
  • e2e_nested_contract.test.ts, 'parent manually calls child' test suite with 3 following cases failing:
    'enqueues multiple public calls', 'enqueues multiple public calls with nested public calls', 'reads fresh value after write within the same tx' (Task 1587)

Performance Test

  • merkle_tree, sparse_tree.test.ts, 'measures time of inserting 1000 leaves at random positions for depth 254'

Placeholder/Unimplemented Tests

  • sequencer-client, l1-publisher.test.ts, 'waits for fee distributor balance' AND 'fails if contract is changed underfoot' (Task 1600)

REMARK: All other skipped tests were re-enabled as part of the PR #1583

@jeanmon
Copy link
Contributor

jeanmon commented Aug 16, 2023

@spalladino Should I open a ticket for the two un-implemented tests in l1-publisher.test.ts? Or should I remove them from the code?

@jeanmon
Copy link
Contributor

jeanmon commented Aug 16, 2023

@iAmMichaelConnor @benesjan Any idea how we should handle the performance test mentioned above? I added a comment in the code that we skip it because it is a performance test. Do we have any plan/guidelines on how to deal with performance tests at Aztec?
@iAmMichaelConnor Are you fine if we keep this test skipped?

@iAmMichaelConnor
Copy link
Contributor Author

I don't think we do have a plan for dealing with performance / benchmarking tests. Barretenberg contains a lot of benchmark tests, but that's because it's been optimised for historic products. We haven't reached a point where we want to optimise the typescript code yet. If all it's testing is speed (and there are other tests which are ensuring leaf insertion logic is correct), then it's probably fine to skip this test (especially if it takes a significant amount of time).

@spalladino
Copy link
Collaborator

@jeanmon let's open issues for those, and link to them in these TODOs:

// TODO: Check fee distributor has at least 0.5 ETH.

// TODO: Fail if blockchainStatus.nextBlockNum > thisBlockNum.

@jeanmon jeanmon moved this from Todo to In Review in A3 Aug 17, 2023
jeanmon added a commit that referenced this issue Aug 17, 2023
Resolves #1452 

# Checklist:
Remove the checklist to signal you've completed it. Enable auto-merge if
the PR is ready to merge.
- [x] If the pull request requires a cryptography review (e.g.
cryptographic algorithm implementations) I have added the 'crypto' tag.
- [x] I have reviewed my diff in github, line by line and removed
unexpected formatting changes, testing logs, or commented-out code.
- [x] Every change is related to the PR description.
- [x] I have
[linked](https://docs.github.com/en/issues/tracking-your-work-with-issues/linking-a-pull-request-to-an-issue)
this pull request to relevant issues (if any exist).
@github-project-automation github-project-automation bot moved this from In Review to Done in A3 Aug 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
T-bug Type: Bug. Something is broken. T-testing Type: Testing. More tests need to be added.
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

3 participants