Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure consistency across exercise tests #470

Closed
robphoenix opened this issue Jan 30, 2017 · 17 comments
Closed

Ensure consistency across exercise tests #470

robphoenix opened this issue Jan 30, 2017 · 17 comments

Comments

@robphoenix
Copy link
Contributor

robphoenix commented Jan 30, 2017

#465 highlighted certain test file inconsistencies between the exercises.
These were:

  1. lack of testVersion/targetTestVersion for all exercises, initialised at 1, to be incremented upon significant changes
  2. separate TestTestVersion function, rather than as part of main test function
  3. placement of TestTestVersion function as the first test function
  4. TestTestVersion function using Fatalf rather than Errorf
@robphoenix
Copy link
Contributor Author

robphoenix commented Jan 30, 2017

List of all exercises, to be checked individually for consistency and ticked off when meeting the above conditions.

  • accumulate
  • acronym
  • all-your-base
  • allergies
  • anagram
  • atbash-cipher
  • bank-account
  • beer-song
  • binary-search-tree
  • binary-search
  • binary
  • bob
  • bracket-push
  • circular-buffer
  • clock
  • connect
  • counter (deprecated)
  • crypto-square
  • custom-set
  • diamond
  • difference-of-squares
  • diffie-hellman
  • error-handling
  • etl
  • food-chain
  • gigasecond
  • grade-school
  • grains
  • hamming
  • hello-world
  • hexadecimal
  • house
  • isogram
  • kindergarten-garden
  • largest-series-product
  • leap
  • ledger
  • luhn
  • matrix
  • meetup
  • minesweeper
  • nth-prime
  • nucleotide-count
  • ocr-numbers
  • octal
  • paasio
  • palindrome-products
  • pangram
  • parallel-letter-frequency
  • pascals-triangle
  • perfect-numbers
  • phone-number
  • pig-latin
  • poker
  • pov
  • prime-factors
  • protein-translation
  • pythagorean-triplet
  • queen-attack
  • raindrops
  • react
  • rna-transcription
  • robot-name
  • robot-simulator
  • roman-numerals
  • saddle-points
  • say
  • scrabble-score
  • secret-handshake
  • series
  • sieve
  • simple-cipher
  • strain
  • sum-of-multiples
  • tournament
  • transpose
  • tree-building
  • triangle
  • trinary
  • twelve-days
  • variable-length-quantity
  • word-count
  • word-search
  • wordy

robphoenix pushed a commit that referenced this issue Jan 31, 2017
* added test versioning consistency to accumulate, see #470

* removed comment about test versioning in accumulate example
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 1, 2017
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 1, 2017
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 1, 2017
@tleen
Copy link
Member

tleen commented Feb 1, 2017

acronym is already ok...wait no, needs fatalf

robphoenix added a commit that referenced this issue Feb 1, 2017
changed test version check error to fatal in acronym, see #470
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 1, 2017
robphoenix added a commit that referenced this issue Feb 1, 2017
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 1, 2017
robphoenix added a commit that referenced this issue Feb 1, 2017
word-search: extract TestTestVersion function (#470)
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 1, 2017
robphoenix added a commit that referenced this issue Feb 1, 2017
luhn: move TestTestVersion to be first test (#470)
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 3, 2017
robphoenix added a commit that referenced this issue Feb 4, 2017
allergies: extracted test version test as its own function, see #470
robphoenix added a commit that referenced this issue Feb 4, 2017
atbash-cipher: added test versioning, see #470
robphoenix added a commit that referenced this issue Feb 4, 2017
robphoenix added a commit that referenced this issue Feb 6, 2017
bank-account: added test versioning, see #470
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 6, 2017
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 6, 2017
robphoenix added a commit that referenced this issue Feb 6, 2017
binary-search-tree: added test versioning, see #470
robphoenix pushed a commit to robphoenix/exercism-go that referenced this issue Feb 6, 2017
tleen added a commit that referenced this issue Mar 15, 2017
…es (#586)

* Isolated test version testing to its own function

See #470
tleen added a commit that referenced this issue Mar 15, 2017
…ises (#587)

* Isolated test version testing to its own function

See #470
tleen added a commit that referenced this issue Mar 15, 2017
tleen added a commit that referenced this issue Mar 16, 2017
tleen added a commit that referenced this issue Mar 16, 2017
tleen added a commit that referenced this issue Mar 16, 2017
…591)

* Isolated test version test to its own function

See #470
tleen added a commit that referenced this issue Mar 16, 2017
tleen added a commit that referenced this issue Mar 16, 2017
tleen added a commit that referenced this issue Mar 16, 2017
* Moved TestVersionTest to start of test functions
see #470
tleen added a commit that referenced this issue Mar 17, 2017
…596)

* Moved TestTestVersion to top of test functions
* Errorf -> Fatalf

See #470
@tleen
Copy link
Member

tleen commented Mar 17, 2017

I believe this is accomplished?

🍀 😄

@robphoenix
Copy link
Contributor Author

robphoenix commented Mar 17, 2017

@tleen you're a test consistency powerhouse! 💪 Well done for finishing this off.

@tleen
Copy link
Member

tleen commented Mar 17, 2017

Good stuff. I'll close this one out. 👍

@petertseng
Copy link
Member

Nice work doing this for all 80 of our exercises! (Plus the deprecated ones, I believe that makes it 85)

If y'all are thinking of other things to do, could consider ensuring that all exercises in x-common that have canonical-data.json have a test generator, and that the test generators still run (due to recent schema changes, some generators might require changes). This can help our track more easily keep up with changes to x-common (just rerun the generator, and we are done!).

No obligation to take this suggestion, since I don't consider myself to hold any special authority here; just whatever makes our lives as maintainers easier.

@tleen
Copy link
Member

tleen commented Mar 31, 2017

Sure. I'm sort of swamped at work till mid-April but if you make an issue for this we can slowly work our way through it like with the test versioning.

@robphoenix
Copy link
Contributor Author

I'd been thinking this same thing. I'll make a start on it in the coming weeks also.

@petertseng
Copy link
Member

OK. I can't start to make the issue for the next 4 hours. I will do it after that, unless one of you says you are before then.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants