newcsv.csv

URL,Title,Source Type,AP/TS,Name,AKA,Definition,Code Example,Causes / Effects,Frequency,Refactoring
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,7 Layer Testing,,"Numerous tests depend on the functionality of a single unit, typically incidentally. A single change in the code often breaks many tests in the build. Often exhibits itself when a team finds that even trivial changes to a system results in exorbitant effort to get back to a green build.",TRUE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Abnormal UTF-Use,,Test-suite overriding the default behavior of the unit testing framework,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Abnormal UTF-Use,,Overriding the default behavior of the testing framework by test-suite.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Absence of why,,where the code of the test just IS and does nothing to explain the use case,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Accidental test framework,,"related to over exertion asserts, where there’s an ad-hoc bit of what should be a test library, this also includes home-made shallow implementations for deep problems like managing resources such as database or file. It also includes manually pumping framework primitives, rather than using the framework as a whole.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Activation asymmetry,,"a default activation has no matching subsequent deactivation in the same statement block, or a deactivation has no matching previous activation",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Activation Asymmetry,,"A default activation has no matching subsequent deactivation in the same statement block, or a deactivation has no matching previous activation.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Activation Asymmetry,,"A default activation has no matching subsequent deactivation in the same statement block, or a deactivation has no matching previous activation.",FALSE,FALSE,TRUE,TRUE
https://ieeexplore.ieee.org/abstract/document/6606682,Hunting for smells in natural language tests,paper,Test Smell,Ambiguous Tests,,The test is underspecified and leaves room for interpretation,FALSE,TRUE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Anal Probe,,A test that is written in this ‘smelly’ way also violates encapsulation but due to unnecessary hiding of parts in the tested production code that need testing.,FALSE,FALSE,TRUE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Anal Probe,,"A test which has to use insane, illegal or otherwise unhealthy ways to perform its task like: Reading private fields using Java's setAccessible(true) or extending a class to access protected fields/methods or having to put the test in a certain package to access package global fields/methods.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,Anal Probe,,"A test that has to use unhealthy ways to perform its task, such as reading private fields using reflection",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Anonymous Test,,"An anonymous test is a test whose name is meaningless as it doesn't express the purpose of the test in the current context. However tests can be regarded as documentation, and the name is an important part of that as it should abstract what the test is all about.",TRUE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Anonymous Test,"Unclear Naming, Naming Convention Violation",The test name is meaningless and does not reveal the intent of it.,FALSE,FALSE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Anonymous Test,,Test-methods having a meaningless name,FALSE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Anonymous Test,,A test method with a meaningless and unclear method name,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Anonymous test case,,where we cannot tell from the test name what is being tested,FALSE,FALSE,FALSE,FALSE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Army of Clones,,"Different tests perform and implement similar actions, leading to duplicated pieces of test code",FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Army of Clones,,"Different tests perform and implement similar actions, leading to duplicated pieces of test code",FALSE,TRUE,TRUE,TRUE
https://blogs.sap.com/2013/02/14/abap-assertion-anti-patterns/,Abap assertion anti-patterns,webpage,Anti-pattern,ASSERT 1 = 2,,A case of developer simply yanking on the emergency brake whenever the code has dropped into a state that they didn’t know how to handle.,FALSE,TRUE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Assert the world,,"where the assertions prove everything, even uninteresting stuff.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.159.6145&rep=rep1&type=pdf,Parameterized Test Patterns For Effective Testing with Pex,technical paper/manuscript,Test Smell,Asserting Pre-condition and Invariants,,"Using the same API to express pre-conditions (i.e. argument validation), post-conditions, invariants, and assertions.",TRUE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Assertion Chorus,missing custom assertion method,where a series of assertions repetitively perform a long winded routine to test something.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Assertion diversion,,"where the wrong sort of assert is used, thus making a test failure harder to understand",TRUE,FALSE,FALSE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Assertion Roulette,,"It occurs when tests present assertions with no explanation in test methods. If one of those assertions fails, it is not possible to identify which one caused the problem;",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Assertion Roulette,,Several assertions with no explanation within the same test method,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/2970276.2970340,An empirical investigation into the nature of test smells,article,Test Smell,Assertion Roulette,,"As defined by van Deursen et al. this smell comes from having a number of assertions in a test method that have no explanation [42]. Thus, if an assertion fails, the  identification of the assert that failed can be difficult.",FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,Assertion Roulette,,Test method having more than one assertion.,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Assertion Roulette,,Several assertions with no explanation within the same test method,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Assertion Roulette,,A test method contains more than one assertion statement without an explanation/message (parameter in the assertion method),FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Assertion Roulette,,Several assertions with no explanation within the same test method,FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1109/MSR.2019.00072,Assessing diffusion and perception of test smells in scala projects,paper,Test Smell,Assertion Roulette,,"A test case that contains more than one assertion of which at least one does not provide a reason for assertion failure. In case the test fails, this test smell encumbers identifying which assertion failed and the reason why",TRUE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Assertion Roulette,,"If there are many assertions in a test method, it becomes difficult to determine which one caused a test failure",FALSE,FALSE,TRUE,FALSE
https://arxiv.org/abs/2107.13902,Developers perception on the severity of test smells: an empirical study,technical paper/manuscript,Test Smell,Assertion Roulette,,It occurs when a test method contains more than one assertion statement without an explanation or parameter in the assertion method,FALSE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3379597.3387471,Did You Remember To Test Your Tokens?,paper,Test Smell,Assertion Roulette,,"In test cases affected by this smell, it is hard to tell which of several assertions failed.",TRUE,TRUE,FALSE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Assertion Roulette,,A test method contains plenty of assertions without any explanation.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Assertion Roulette,,Multiple unexplained assertions in the same test method,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Assertion roulette,,"When a test case fails, you do not know which of the assertions is responsible for it",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Assertion Roulette,,A test that has multiple assertion statements that do not provide any description of why they failed,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Assertion Roulette,,"A test method has multiple nondocumented assertions, making it difficult to identify which one causes a failure",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/2897010.2897016,On the diffusion of test smells in automatically generated test code: an empirical study,paper,Test Smell,Assertion Roulette,,"As dened by Van Deursen et al., this smell comes from having a number of assertions in a test method that have no explanation. Thus, if an assertion fails, the identication of the assert that failed can be diffcult.",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Assertion Roulette,,A test method contains more than one assertion statement without an explanation/message (parameter in the assertion method),FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Assertion Roulette,,Occurs when a test method has multiple nondocumented assertions.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Assertion Roulette,,"Occurs when a test method contains multiple non-documented assertions. Thus, if an assertion fails, it can be difficult to identify wich one failed",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Assertion Roulette,,"You know something is wrong because your tests fail but it is unclear what. This smell comes from having a number of assertions in a single test method that do not have a distinct explanation. If one of the assertions fails, you do not know which one it is.",FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8529832,On the Relation of Test Smells to Software Code Quality,paper,Test Smell,Assertion Roulette,,A test that contains several assertions with no explanation,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Assertion Roulette,,"It occurs when a method has more than an assertion, so if one fails it is difficult to define which one.",FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9240623/,Pizza versus Pinsa: On the Perception and Measurability of Unit Test Code Quality,paper,Test Smell,Assertion Roulette,,Appears when a test includes a number of assertions without comments,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Assertion Roulette,,Occurs when a test case has multiple non-documented assertions,FALSE,TRUE,TRUE,FALSE
https://jrnl.nau.edu.ua/index.php/IPZ/article/download/3084/3036/0,Quality defects detection in unit tests,technical paper/manuscript,Test Smell,Assertion Roulette,,"It is hard to tell which of several assertions within the same test method caused a test failure. A test fails. Upon examining the output of the Test Runner, we cannot determine exactly which assertion failed",FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3422392.3422510,RAIDE: a tool for Assertion Roulette and Duplicate Assert identification and refactoring,paper,Test Smell,Assertion Roulette,,occurs when the optional parameter for explaining the assertion structure is absent,FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Assertion Roulette,,"This smell comes from having a number of assertions in a test method that have no explanation. If one of the assertions fails, you do not know which one it is",FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3425174.3425212,Refactoring Test Smells: A Perspective from Open-Source Developers,paper,Test Smell,Assertion Roulette,,collection of unexplained assertions in a single test method that makes it difficult to trace which exact assertion had a problem in the event of test failure,TRUE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9240691,"Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities",paper,Test Smell,Assertion Roulette,,A test that has multiple assertion statements that do not provide any description of why they failed,TRUE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121219301487?casa_token=UT0EMFzxTcQAAAAA:L9J82_15tdySkabcIMSHKPx8rVkrltOzcwgme5cIBWgT0txJENY5y-BdUmCYUoGHnoEjZJH-cYc,Scented since the beginning: On the diffuseness of test smells in automatically generated test code,article,Test Smell,Assertion Roulette,,"this smell “comes from having a number of assertions in a test method that have no explanation”. Thus, if an assertion fails, the identification of the cause behind the failure can be difficult",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477070,Smart prediction for refactorings in the software test code,paper,Test Smell,Assertion Roulette,,A test method that contains assertion statements without an explanation message. Non documented assertions impact the test code readability and understandability,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3337932.3338815,SoCRATES: Scala radar for test smells,paper,Test Smell,Assertion Roulette,,Atest case that contains more than one assertion of which at least one does not provide a reason for assertion failure. This test smell encumbers identifying which assertion failed and the reason why,FALSE,FALSE,FALSE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Assertion Roulette,,Occurs when a test method has multiple non-documented assertions. Multiple assertion statements in a test method without a descriptive message impacts readability/understandability/maintainability as it’s not possible to understand the reason for the failure of the test.,TRUE,FALSE,FALSE,FALSE
https://damorimrg.github.io/practical_testing_book/goodpractices/artifacts.html,Test Artifacts — The Practical Testing Book,webpage,Test Smell,Assertion Roulette,,"When a test method has many unexplained assertions, making it hard to tell which one may cause a test failure",TRUE,FALSE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Assertion Roulette,,A test method with multiple assertions without explanation messages,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3338906.3342500,Test-related factors and post-release defects: an empirical study,paper,Test Smell,Assertion Roulette,,Test classes having a large number of assertions without documentation,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Assertion Roulette,,Test commands with lots of asserts without description,FALSE,FALSE,FALSE,FALSE
https://search.proquest.com/openview/c52d821a4dd6ecb046957d9d6a532ae0/1?pq-origsite=gscholar&cbl=326341,The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems,article,Test Smell,Assertion Roulette,,A test containing several assertions with no explanation.,FALSE,FALSE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Assertion Roulette,,One test case may contain several assertions with no explanation. AR increases difficulties in comprehension,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3472674.3473981,Toward static test flakiness prediction: a feasibility study,paper,Test Smell,Assertion Roulette,,When atest method has multiple non-documented assertions.,FALSE,FALSE,FALSE,FALSE
https://dibt.unimol.it/staff/fpalomba/documents/C14.pdf,Towards Automated Tools for Detecting Test Smells: An Empirical Investigation into the Nature of Test Smells,technical paper/manuscript,Test Smell,Assertion Roulette,,when a test case contains multiple assertions without properly documenting all of them,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Assertion Roulette,,A test method contains more than one assertion statement without an explanation/message (parameter in the assertion method),FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3430665.3456328?casa_token=igLWdXV-fTYAAAAA:UZiEPkDc2-NRE6_Zi0Q9FRDeUjeyZcdVTLO9Kzk53cVuo7LC-nC7m690pw6vZpQmMfa5ktOcw2pvFw,Unit Test Smells and Accuracy of Software Engineering Student Test Suites,paper,Test Smell,Assertion Roulette,,"Individual unit tests that contain many assertions can be ""hard to tell which of several assertions within the same test method caused a test failure,""",FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Assertion Roulette,,Occurs when a test method has multiple nondocumented assertions.,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Assertion roulette,,It is hard to tell which of several assertions within the same test method caused a test failure.,FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121221000364,Why do builds fail?—A conceptual replication study,article,Test Smell,Assertion Roulette,,"JUnit classes containing at least one method having more than one assertion statement, and having at least one assertion statement without explanation.",FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Assertion Roulette,,It is hard to tell which of several assertions within the same test method caused a test failure.,FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,Assertion-free,,A test case without assertion,FALSE,FALSE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Assertionless Test,,"A test that does not contain at least one valid assertion is not a real test as it does only execute plain source-code, but never assert any data, state or functionality.",TRUE,TRUE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Assertionless Test,,"Pretending to assert data and functionality, but does not",TRUE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Assertionless Test,,A test that does not contain at least one valid assertion,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Assertionless Test,,A test that is acting to assert data and functionality but does not,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Assertionless Test,,Test commands that do not invoke asserts.,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Assertionless test,,A test method without any assertions.,FALSE,FALSE,FALSE,FALSE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Assertions should be Merciless,,Tests whose assertions do not prove the test method works correctly,TRUE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Asynchronous Code,,"A class cannot be tested via direct method calls. The test must start up an executable (such as a thread, process or application) and wait until it has finished starting up before interacting with it.",FALSE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Asynchronous Test,,A few tests take inordinately long to run; those tests contain explicit delays.,TRUE,TRUE,FALSE,TRUE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Autogeneration,,Auto-generated tests that test methods instead of behavior,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Bad comment rate,,the comment rate is too high or too low,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Bad Comment Rate,,The comment rate (number of comments per line) is too high or too low.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Bad Comment Rate,,The comment rate is too high or too low,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Bad documentation comment,,a documentation comment does not conform to its format,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Bad Documentation Comment,,A documentation comment does not conform to its format. Documentation comments like T3Doc need to conform to certain formatting rules and appear at certain positions in the source code.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Bad Documentation Comment,,"A documentation comment does not conform to a given format, e.g. T3Doc",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Bad naming,,an identifier does not conform to a given naming convention,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Bad Naming,,"An identifier does not conform to a given naming convention. Before this smell can be detected, the naming conventions have to be agreed on. Proposed naming conventions for TTCN-3 can be found on the official TTCN-3 home page.",TRUE,TRUE,FALSE,TRUE
https://scholarworks.rit.edu/theses/11053/,Test Naming Failures. An Exploratory Study of Bad Naming Practices in Test Code,thesis,Test Smell,Bad Naming,,"When a test fails, or when the test base requires maintenance, the test names are the first thing developers will generally attempt to understand before they apply changes to the test or the code being tested. If test names are poor quality, developers will need to spend time reading the code and determining how the test’s actual behavior is related to its name",TRUE,TRUE,TRUE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Bad Naming,,An identifier does not conform to a given naming convention,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Bad naming,,The test method name is not meaningful and thus leads to low understandability.,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6606682,Hunting for smells in natural language tests,paper,Test Smell,Badly Structured Test Suite,,The structure of the test suite does not follow the structure of the tested functionality,FALSE,TRUE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Badly Used Fixture,,A Badly Used Fixture is a xture that is not fully used by the tests in the test-suite.,TRUE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Behavior Sensitivity,,Changes to the production code lead to the failure of tests.,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Behavior Sensitivity,,Behavior Sensitivity is when changes to the SUT cause other tests to fail.,FALSE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Blethery prefixes,,where the implementation of a single line of test code is prefixed by a lot of characters before we get to the point,TRUE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Blinkered assertions,,"where the assertions are blind to the fact that the whole answer is wrong, because they’re focusing on a subset of the detail.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Boilerplate hell,,"where you can’t read the test because there’s so much code, perhaps a case of missing test data factory",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.159.6145&rep=rep1&type=pdf,Parameterized Test Patterns For Effective Testing with Pex,technical paper/manuscript,Test Smell,Branch To Assumption Anti-Pattern,,An assumption is conditionally executed.,TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Brittle Assertion,,A test method that has assertions that check data input,FALSE,FALSE,FALSE,FALSE
https://code.tutsplus.com/articles/maintainable-automated-ui-tests--net-35089,Maintainable automated ui tests,webpage,Test Smell,Brittle Test,,"UI tests containing procedural test code, duplicated steps and magic values",TRUE,FALSE,FALSE,TRUE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Brittle Test,,"Tests that break all the time when small things change undermine the importance of test breakage. Examples are testing that a greeting is inside an ""h1"" in a view or the exact wording of text on the screen.",FALSE,FALSE,FALSE,TRUE
https://code.tutsplus.com/tutorials/tips-to-avoid-brittle-ui-tests--net-35188,Tips to avoid brittle ui tests,webpage,Test Smell,Brittle UI Tests,,"Tests having fixed delays, bad selectors and targeting elements, and difficult investigating failures",TRUE,FALSE,FALSE,TRUE
https://www.youtube.com/watch?v=3Fa69eQ6XgM,Developer test anti-patterns by lasse koskela,webpage,Test Smell,Broad Assertion,,"Assertions that do not compare exact content and are, therefore, broad",TRUE,TRUE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Bumbling assertions,,"where there was a more articulate assertion available, but we chose a less sophisticated one and kind of got the message across. E.g. testing exceptions the hard way, or using equality check on list size, rather than a list size assertion.",TRUE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Bury The Lede,,A test's setup is so onerous that the reader forgets the purpose of the subject by the time they reach the relevant invocation and assertion of the subject.,TRUE,TRUE,FALSE,TRUE
https://mattarcherblog.wordpress.com/2010/11/29/how-test-automation-with-selenium-or-watir-can-fail/,How test automation with selenium can fail,webpage,Test Smell,Calculating expected results on the fly,,Any automated test that performs a comparison needs to know the expected results. If you believe that automatically calculating expected results is for you then I would at least consider separating the code that calculates the expected results from the code that performs the actual test.,TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Catching Unexpected Exceptions,,"If unexpected exceptions are caught, the tests can pass even if an exception is thrown.",FALSE,FALSE,TRUE,FALSE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Test Smell,Catching Unexpected Exceptions,,"When writing production code, developers are generally aware of the problems of uncaught exceptions, and so are relatively diligent about catching exceptions and logging the problem. In the case of unit tests, however, this pattern is completly wrong!",TRUE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Celery data,,where the data read from the system under test is in a format which is hard to make meaningful assertions on – for example raw JSON Strings.,FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Chafing,,"A test in which the author attempts to eliminate as much textual duplication as possible, even if the indirection it introduces confuses future readers of the intention and behavior of the test.",TRUE,TRUE,FALSE,TRUE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Chain Gang,,"Two or more tests that must run in a certain order, i.e. one test changes the global state of the system and the next test(s) depend on it.",FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Chain Gang,,"a couple of tests that must run in a certain order, i.e. one test changes the global state of the system (global variables, data in the database) and the next test(s) depends on it",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Chain Gang,,"A couple of tests that must run in a certain order, i.e. one test changes the global state of the system (global variables, data in the database) and the next test(s) depends on it.",FALSE,FALSE,FALSE,FALSE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,Changing implementation to make tests possible,,Changing the implementation solely for the sake of making testing possible,FALSE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Chatty logging,,"often a substitute for self-explanatory assertions or well defined test names, the test writes lots of data to the console or logs in order to explain test failures outside of the assertions",TRUE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Circumstantial evidence,,where the assertions are looking at things which are not direct proof of the behaviour,FALSE,FALSE,FALSE,FALSE
https://enterprisecraftsmanship.com/posts/code-pollution/,Code pollution,webpage,Test Smell,code pollution,,It takes place when you introduce additional code to your main code base in order to enable unit testing,TRUE,TRUE,FALSE,TRUE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Code Run Only by Tests,,Dead code (never touched in production) is very confusing to the developer trying to understand the system. Tested dead code doubly so.,FALSE,FALSE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Commented Code in the Test,Under-the-carpet Failing Assertion,"The test passes but some assertions or parts of the setup, which would cause a test failure, are commented out",FALSE,FALSE,TRUE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Commented Code in the Test,,Commented out assertions or setup may mean someone took a quick path to making the test pass.,FALSE,FALSE,FALSE,TRUE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Commented Test,,Test contents are commented so that it passes,TRUE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.115.3594&rep=rep1&type=pdf,A Refactoring Tool for TTCN-3,thesis,Test Smell,Comments,,"When something needs to be explained, it is probably better to move into a method with a descriptive name",FALSE,FALSE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Comments Only Test,,All test-code put into comments,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Comments Only Test,,A test that has been put into comments,FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Complex Assertions,,"The assertions in a test require many lines of code to implement. At first blush, since test-scoped logic is typically itself untested, this can be risky. Additionally, multi-line assertions are typically harder to read—both in terms of what they're doing and what they intend to say about the subject's behavior.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Complex conditional,,a conditional expression is composed of many Boolean conjunctions,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Complex Conditional,,A conditional expression is composed of many boolean conjunctions.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Complex Conditional,,A conditional expression is composed of many Boolean conjunctions.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Complex Teardown,,"Complex fixture teardown code is more likely to leave test environment corrupted by not cleaning up correctly. It is hard to verify that it has been written correctly and can easily result in ""data leaks"" that may later cause this or other tests to fail for no apparent reason.",TRUE,TRUE,FALSE,TRUE
https://alisterbscott.com/2015/01/20/five-automated-acceptance-test-anti-patterns/,Five automated acceptance test anti-patterns,webpage,Test Smell,Complicated set up scenarios within the tests themselves,,"Whilst there’s a place for automated end-to-end scenarios (I call these user journies), I prefer most acceptance tests to jump straight to the point.",TRUE,FALSE,FALSE,FALSE
https://www.codementor.io/@mgawinecki/anti-patterns-in-test-automation-101c6vm5jz,Anti-patterns in test automation,webpage,Anti-pattern,Conditional assertions,,it makes your test non-deterministic: you will never be sure which path will be verified in the next pass,TRUE,FALSE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Conditional Assertions,,The test verifies different properties depending on the environment when the environment state may change from one execution to the next,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Conditional Assertions,,The test verifies different properties depending on the environment when the environment state may change from one execution to the next,FALSE,TRUE,TRUE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Conditional assertions,,"potentially a case of over exertion or diversion – the choice of assertion in a test appears to be a runtime choice, leading to tests whose objectives are harder to understand/guarantee.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Conditional Logic,,"Breaks the linear execution path of a test, making it less obvious which parts of the tests get executed. This increases a test's complexity and maintenance costs.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Conditional Logic Test,,Test methods that contain conditional statements,FALSE,FALSE,FALSE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Conditional Test Logic,,"It occurs when tests present conditional logic (if-else or repeat instructions). Tests with this structure do not guarantee that the same flow is verified, besides allowing a particular piece of code not to be tested;",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Conditional Test Logic,,"A test method that contains one or more control statements (i.e., if, switch, conditional expression, for, foreach and while statement)",FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Conditional Test Logic,"Indented Test Code, Guarded Test",This is a test that contains either boolean branching logics like if/else-statements or loops like while. Such conditionals can lead to unpredictable results and decrease the understandability of the code.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3379597.3387471,Did You Remember To Test Your Tokens?,paper,Test Smell,Conditional Test Logic,,"The test case contains code that may or may not be executed [24, 26]. For example, we observed several instances of this smell in tests for the Token passed to authenticating servlet filter via HTTP request scenario. For example, some tests traversed different configurations in a loop, so the action performed during the test was dependent on the current configuration. This smell complicates reasoning about the actual authentication code and the path taken during test execution; which branch was taken or which iteration failed.",FALSE,TRUE,FALSE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Conditional Test Logic,Indented test code,A test contains code that may or may not be executed,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Conditional test logic,,A test case contains conditional logic within selection or repetition structures,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Conditional Test Logic,,Atest that has control flowstatements inside a test,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Conditional Test Logic,,"A test method contains one or more control statements, whereas it should be simple and execute all statements",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Conditional Test Logic,,"A test method that contains one or more control statements (i.e., if, switch, conditional expression, for, foreach and while statement)",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Conditional Test Logic,,"Test methods need to be simple and execute all statements in the production method. Conditions within the test method will alter the behavior of the test and its expected output, and would lead to situations where the test fails to detect defects in the production method since test statements were not executed as a condition was not met. Furthermore, conditional code within a test method negatively impacts the ease of comprehension by developers.",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Conditional Test Logic,,Occurs when a test method contains conditional expressions or loop structures. The test fails when a test statement is not executed,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Conditional Test Logic,,"Atest method that contains control flow statements (i.e if, switch, conditional expression, for, foreach and while statements).",FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Conditional Test Logic,,Runs against the rule that test cases need to be simple and execute all statements in the production code. Conditions within the test case alter the behavior of the test and lead to situations where the test fails to detect defects in the production code under some conditions,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3425174.3425212,Refactoring Test Smells: A Perspective from Open-Source Developers,paper,Test Smell,Conditional Test Logic,,Cccurs when the test outcome depends on a condition inside the test method,TRUE,FALSE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477070,Smart prediction for refactorings in the software test code,paper,Test Smell,Conditional Test Logic,,A test method that contains conditional and loop statements. Conditions within the test method can modify the test behavior and its expected output,FALSE,FALSE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Conditional Test Logic,,"Test methods need to be simple and execute all statements in the production method. Conditions within the test method will alter the behavior of the test and its expected output, and would lead to situations where the test fails to detect defects in the production method since test statements were not executed as a condition was not met. Furthermore, conditional code within a test method negatively impacts the ease of comprehension by developers.",TRUE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6862882/,Test code quality and its relation to issue handling performance,article,Test Smell,Conditional Test Logic,,When the number of possible paths is not kept as low as possible to keep tests simple and correct,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Conditional Test Logic,,A test method that contains a conditional statement as a prerequisite to executing the test statement,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Conditional Test Logic,,There exist conditions in a test case that may alter the behavior of the test and its expected output.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3472674.3473981,Toward static test flakiness prediction: a feasibility study,paper,Test Smell,Conditional Test Logic,,Conditional code within a test method negatively impacts the ease of comprehension by developers.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Conditional Test Logic,,"A test method that contains one or more control statements (i.e., if, switch, conditional expression, for, foreach and while statement)",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3430665.3456328?casa_token=igLWdXV-fTYAAAAA:UZiEPkDc2-NRE6_Zi0Q9FRDeUjeyZcdVTLO9Kzk53cVuo7LC-nC7m690pw6vZpQmMfa5ktOcw2pvFw,Unit Test Smells and Accuracy of Software Engineering Student Test Suites,paper,Test Smell,Conditional Test Logic,,"A test method that contains one or more control statements (i.e., if, switch, conditional expression, for, foreach and while statement)",FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Conditional Test Logic,,"Test methods need to be simple and execute all statements in the production method. Conditions within the test method will alter the behavior of the test and its expected output, and would lead to situations where the test fails to detect defects in the production method since test statements were not executed as a condition was not met. Furthermore, conditional code within a test method negatively impacts the ease of comprehension by developers.",TRUE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Conditional Test Logic,Indented Test Code,A test contains code that may or may not be executed,TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/6606682,Hunting for smells in natural language tests,paper,Test Smell,Conditional Tests,,Tests are very complex and contain conditional logic that is phrased in natural language,FALSE,TRUE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Conditional Verification Logic,,This is usually caused by wanting to prevent the execution of assertions if the SUT fails to return the right objects or the use of loops to verify the contents of collections returned by the SUT.,TRUE,TRUE,FALSE,TRUE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,Conditionals in tests,,having “ifs” in tests is wrong; it’s proof that you need another test scenario,FALSE,FALSE,FALSE,FALSE
https://www.codementor.io/@mgawinecki/anti-patterns-in-test-automation-101c6vm5jz,Anti-patterns in test automation,webpage,Anti-pattern,Conspiracy of silence,,When assertions in tests are failing with almost no clue why,TRUE,FALSE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Constant actual parameter value,,"the actual parameter values for a formal parameter of a declaration are the same for all references. Hence, this parametrisation is unnecessary.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Constant Actual Parameter Value,,"The value of an actual parameter is the same for all occurances. In contrast to Unused Parameter (4.3.1), the parameter is in use within the declaring entity and must not simply be removed. The declaring entity could be a template or a behavioral entity (function, test case or altstep).",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Constant Actual Parameter Value,,The actual parameter values for a formal parameter are the same for all references,FALSE,FALSE,FALSE,FALSE
https://apprize.best/c/unit/8.html,Chapter 8. The pillars of good unit tests,webpage,Test Smell,Constrained test order,,Tests expecting to be run in a specific order or expecting information from other test results,TRUE,TRUE,FALSE,TRUE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Constructor Initialization,,This smell occurs when test methods present a constructor;,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Constructor Initialization,,A test class that contains a constructor declaration,FALSE,TRUE,FALSE,TRUE
https://arxiv.org/abs/2107.13902,Developers perception on the severity of test smells: an empirical study,technical paper/manuscript,Test Smell,Constructor Initialization,,It occurs when a test method implements a constructor. It is recommended that all the fields be initialized inside the setUp() method,FALSE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Constructor Initialization,,Test class with constructor method and field initialization,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Constructor Initialization,,A test class that contains a constructor declaration,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Constructor Initialization,,"Ideally, the test suite should not have a constructor. Initialization of fields should be in the setUp() method. Developers who are unaware of the purpose of setUp() method would enable this smell by defining a constructor for the test suite.",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Constructor Initialization,,Occurs when a test suit method contains a constructor,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Constructor Initialization,,A test class that contains a constructor declaration.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Constructor Initialization,,"made by developers who are unaware of the purpose of the setUp() method that contains the preparation needed to perform test cases. As a result, they would define a constructor for the test suite, which is not ideal in practice",FALSE,TRUE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Constructor Initialization,,"Ideally, the test suite should not have a constructor. Initialization of fields should be in the setUp() method. Developers who are unaware of the purpose of setUp() method would give rise to this smell by defining a constructor for the test suite.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Constructor Initialization,,A test class that contains a constructor declaration,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Constructor Initialization,,"A test class may use a constructor instead of JUnit’s setUp(). This may introduce side effects when the test class inherits another class, i.e., the parent class’s constructor will still be invoked.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Constructor Initialization,,A test class that contains a constructor declaration,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Constructor Initialization,,"Ideally, the test suite should not have a constructor. Initialization of fields should be in the setUp() method. Developers who are unaware of the purpose of setUp() method would enable this smell by defining a constructor for the test suite.",TRUE,FALSE,TRUE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Contaminated Test Subject,,A test somehow morphs its subject into something less realistic for its own purposes and without regard for the resulting erosion in our confidence that the test ensures the subject's behavior under real-world conditions.,TRUE,TRUE,FALSE,TRUE
https://dzone.com/articles/unit-testing-smells-what-are-your-tests-telling-yo,Unit Testing Smells: What Are Your Tests Telling You?,webpage,Test Smell,Context Logic in Production Code,,When the production code becomes aware of the context in which it is used.,TRUE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Context Sensitivity,,"Changing the state or behaviour of the context in which the production code is embedded causes the failure of the test. This is the case, for example, when the code that is changed does not belong to the system under test.",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Context Sensitivity,,Context Sensitivity occurs when a test fails because the state or behavior of the context in which the SUT executes has changed in some way.,FALSE,TRUE,FALSE,TRUE
https://idp.springer.com/authorize/casa?redirect_uri=https://link.springer.com/article/10.1007/s10664-021-10016-2&casa_token=8C-rVSu9l74AAAAA:2s5rmzBFiH74xHZlTdpZsQCxwqL4cYIbWRH6Bdq1ehTjnxcpOwi8PPkhDrhKpHqjdrQf1_ZXaVRy5BysSQ,"Rotten green tests in Java, Pharo and Python",paper,Test Smell,Context-Dependent Rotten Green Assertion Test,,Tests contain multiple conditional branches with different assertions in each branch,TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3377812.3382151,RTj: a Java framework for detecting and refactoring rotten green test cases,paper,Test Smell,Context-Dependent Rotten Green Assertion Test,,Contains conditionals with different assertions in the different branches,TRUE,TRUE,TRUE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Contortionist testing,,this is really a design smell. You’re probably adding tests after the code was written and are required to bend over backwards to construct those tests owing to poorly designed code. This especially involves NEEDing to use mocking of static functions or types.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Control Logic,,"Test controlling the execution 
ow by using methods like debug or halt",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Control Logic,,A test method that controls test data flow by methods such as debug or halt,FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Counting on spies,,"occurs when injecting a proxy ob- ject (spy) in place of a dependency (or collaborator), and spying on how the consuming class calls it.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2015/05/25/unit-test-scaffolding.html,A few thoughts on unit test scaffolding,webpage,Test Smell,coupling between test methods,,Test methods (and all tests in general) must be perfectly isolated from each other. This means that changing one test must not affect any others.,TRUE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Curdled Test Fixtures,,"where there’s an inappropriate union of tests in the same fixture, or splitting into multiple fixtures where one would be better",TRUE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Cut-and-Paste Code Reuse,,"""Cut and Paste"" is a powerful tool for writing code fast but it results in many copies of the same code each of which must be maintained in parallel.",FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Data Sensitivity,,Modifications to the data on which the system under test relies cause the test to fail.,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Data Sensitivity,,Data Sensitivity occurs when a test fails because the data being used to test the SUT has been modified. It most commonly occurs when the contents of the test database is changed.,FALSE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Data-Ja Vu,,where some data that could be made immutable and loaded once is read for every instance of a test,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6569744,Automated Detection of Test Fixture Strategies and Smells,paper,Test Smell,Dead Field,,"Occurs when a class or its super classes have fields that are never used by any test method. Often dead fields are inherited. This can indicate a non-optimal inheritance structure, or that the super class conflicts with the single responsibility principle. Also, dead fields within the test class itself can indicate incomplete or deprecated development activities.",FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/6624053,Strategies for avoiding text fixture smells during software evolution,paper,Test Smell,Dead Field,,The dead field smell occurs when a class or its super classes have fields that are never used by any of the test methods.,FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Dead Field,,When a class has a field that is never used by any test methods.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Default Test,,A test class is named either ‘ExampleUnitTest’ or ‘ExampleInstrumentedTest’,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Default Test,,Automatically generated test class with default name,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Default Test,,"By default Android Studio creates default test classes when a project is created. These template test classes are meant to serve as an example for developers when writing unit tests and should either be removed or renamed. Having such files in the project will cause developers to start adding test methods into these files, making the default test class a container of all test cases and violate good testing practices. Problems would also arise when the classes need to be renamed in the future.",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Default Test,,Occurs when a test suit contains test classes created by default,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Default Test,,A test class is named either “ExampleUnitTest” or “ExampleInstrumentedTest”.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Default Test,,Occurs when an IDE creates default test suites when the project is created and developers keep the default name,FALSE,TRUE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Default Test,,"By default Android Studio creates default test classes when a project is created. These classes are meant to serve as an example for developers when wring unit tests and should either be removed or renamed. Having such files in the project will cause developers to start adding test methods into these files, making the default test class a container of all test cases. This also would possibly cause problems when the classes need to be renamed in the future.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Default Test,,Default or an example test suite created by Android Studio,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Default Test,,A test class is named either ‘ExampleUnitTest’ or ‘ExampleInstrumentedTest’,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Default Test,,"By default Android Studio creates default test classes when a project is created. These template test classes are meant to serve as an example for developers when writing unit tests and should either be removed or renamed. Having such files in the project will cause developers to start adding test methods into these files, making the default test class a container of all test cases and violate good testing practices. Problems would also arise when the classes need to be renamed in the future.",TRUE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678529/,JTDog: a Gradle Plugin for Dynamic Test Smell Detection,paper,Test Smell,Dependent test,,"A test that depends on other tests. If the test order changes, then the dependent test results will also change",FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Dependent Test,,"Occurs when the test being executed depends on other tests’ success. As a result, dependent tests can fail for the wrong reason",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Dependent Test,,A test that only executes on the successful execution of other tests,FALSE,FALSE,FALSE,FALSE
https://alisterbscott.com/2015/01/20/five-automated-acceptance-test-anti-patterns/,Five automated acceptance test anti-patterns,webpage,Test Smell,Directly executing JavaScript,,"Since WebDriver can directly execute any arbitrary JavaScript, it can be tempting to bypass DOM manipulation and just run the JavaScript.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3468264.3468609,How disabled tests manifest in test maintainability challenges?,paper,Test Smell,Disabled Test,,"Disabling failing tests temporarily can be seen as an added flexibility for developers to alleviate maintenance difficulties, but it may introduce technical debt.",TRUE,TRUE,TRUE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Disorder,,the sequence of elements within a module does not conform to a given order,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Disorder,,"The sequence of elements within a module does not conform to a given order.
A preferred ordering could be:
• imports
• module parameters
• data types
• port types
• component types
• templates
• functions
• altsteps
• test cases
• control part",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Disorder,,The sequence of elements within a module does not conform to a given order.,FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Doppelgänger,,"In order to test something, you have to copy parts of the code under test into a new class with the same name and package and you have to use classpath magic or custom classloader to make sure it is visible first (so your copy is picked up). This pattern indicates an unhealthy amount of hidden dependencies which you can’t control from a test.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Doppelgänger,,"In order to test something, you have to copy parts of the code under test into a new class with the same name and package and you have to use classpath magic or a custom classloader to make sure it is visible first (so your copy is picked up). This pattern indicates an unhealthy amount of hidden dependencies which you can't control from a test.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Duplicate alt branches,,different alt constructs contain duplicate branches,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Duplicate Alt Branches,,Different alt constructs contain duplicate branches,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Duplicate Alt Branches,,Different alt constructs contain duplicate branches.,FALSE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Duplicate Assert,,A test method that contains more than one assertion statement with the same parameters,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Duplicate Assert,,More than one of the same verification method that checks the same parameters,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Duplicate Assert,,"A test method that checks the same condition multiple times, while testing with different values often requires different test cases",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Duplicate Assert,,A test method that contains more than one assertion statement with the same parameters,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Duplicate Assert,,"This smell occurs when a test method tests for the same condition multiple times within the same test method. If the test method needs to test the same condition using different values, a new test method should be created. As a best practice, the name of the test method should be an indication of the test being performed. Possible situations that would give rise to this smell include (1) developers grouping multiple conditions to test a single method, (2) developers performing debugging activities, and (3) an accidental copy-paste of code",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Duplicate Assert,,Occurs when a test method tests the same condition multiple times,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Duplicate Assert,,A test method that contains more than one assertion statement with the same parameters.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Duplicate Assert,,Occurs when a test case tests for the same condition multiple times,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3422392.3422510,RAIDE: a tool for Assertion Roulette and Duplicate Assert identification and refactoring,paper,Test Smell,Duplicate Assert,,occurs when the test method has two or more assertion structures with the same parameters,FALSE,TRUE,FALSE,TRUE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Duplicate Assert,,"This smell occurs when a test method tests for the same condition multiple times within the same test method. If the test method needs to test the same condition using different values, a new test method should be utilized; the name of the test method should be an indication of the test being performed. Possible situations that would give rise to this smell include: (1) developers grouping multiple conditions to test a single method; (2) developers performing debugging activities; and (3) an accidental copy-paste of code.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Duplicate Assert,,Occurs when a test method has the exact assertion multiple times within the same test method,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Duplicate Assert,,"Occurs when a test case tests the same condition multiple times, which may increase test overhead.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Duplicate Assert,,A test method that contains more than one assertion statement with the same parameters,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Duplicate Assert,,"This smell occurs when a test method tests for the same condition multiple times within the same test method. If the test method needs to test the same condition using different values, a new test method should be created. As a best practice, the name of the test method should be an indication of the test being performed. Possible situations that would give rise to this smell include (1) developers grouping multiple conditions to test a single method, (2) developers performing debugging activities, and (3) an accidental copy-paste of code",TRUE,FALSE,TRUE,FALSE
https://techbeacon.com/app-dev-testing/7-ways-tidy-your-test-code,Writing good gherkin,webpage,Test Smell,Duplicate code,,"For test automation, it's especially easy to find yourself with the same code over and over. Steps such as logging in and navigating through common areas of the application are naturally a part of most scenarios.  However, repeating this same logic multiple times in various places is a code smell. Should there be a change in the application within this flow, you'll have to hunt down all the places where this logic is duplicated within your test code and update each one. This takes too much development time and also poses the risk of you missing a spot, therefore introducing a bug in your test code.",FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Duplicate component definition,,"two or more test components declare identical variables, constants, timers, or ports.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Duplicate Component Definition,,"Two or more components declare identical variables, constants, timers or ports.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Duplicate Component Definition,,"Two or more test components declare identical variables, constants, timers, or ports",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Duplicate In-Line Templates,,there are two or moresimilar or identical in-line templates,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Duplicate In-Line Templates,,Two or more similar or identical in-line templates.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Duplicate In-Line Templates,,Two or more in-line templates are very similar or identical.,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Duplicate Local Variable/Constant/Timer,,"the same local variable, constant, or timerisdefinedintwoormorefunctions, test cases, or altsteps running on the same test component.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Duplicate Local Variable/Constant/Timer,,"The same local variable, constant or timer is defined in two or more functions, test cases or altsteps running on the same component.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Duplicate Local Variable/Constant/Timer,,"The same local variable, constant, or timer is defined in two or more functions, test cases, or altsteps running on the same test component.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Duplicate Statements,,"There is a duplicate sequence of statements in the statement block of one or multiple behavioural entities (functions, test cases, and altsteps).",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Duplicate Statements,,"A duplicate sequence of statements in the statement block of one or multiple behavioral entities (functions, test cases and altsteps).",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Duplicate Statements,,"A duplicate sequence of statements occurs in the statement block of one or multiple behavioural entities (functions, test cases, and altsteps).",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Duplicate Template Fields,,the fields of two or more templates are identical or very similar,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Duplicate Template Fields,,The fields of two or more templates are identical or very similar,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Duplicate Template Fields,,The fields of two or more templates are identical or very similar.,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Duplicate test code,,Another test method tests the same thing.,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Duplicated Actions,,Some duplicated actions appear in multiple places.,FALSE,FALSE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.115.3594&rep=rep1&type=pdf,A Refactoring Tool for TTCN-3,thesis,Test Smell,Duplicated Code,,Any expressions which are exactly the same and occur at several different locations are better when they are unified as a change is only needed in one place.,FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,Duplicated Code,,Sets of test commands that contain the same invocation and data access sequence.,FALSE,FALSE,TRUE,FALSE
https://stackoverflow.com/questions/129693/is-duplicated-code-more-tolerable-in-unit-tests,Is duplicated code more tolerable in unit tests?,webpage,Test Smell,Duplicated code,,"If you have duplicated code in tests, it makes it harder to refactor the implementation code because you have a disproportionate number of tests to update. Tests should help you refactor with confidence, rather than be a large burden that impedes your work on the code being tested.",TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Duplicated Code,,A test method that has redundancy in the code.,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Duplicated Code,,Sets of test commands that contain the same invocation and data access sequence.,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Duplicated Code in Conditional,,duplicated code is found in the bodies of a series of conditionals,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Duplicated Code in Conditional,,The duplicated code can appear in a series of conditionals (with different conditions and the same action in each check) or in all legs of a conditional,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Duplicated Code in Conditional,,Duplicated code is found in the branches of a series of conditionals.,FALSE,FALSE,FALSE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Eager Test,,"It occurs when a test method checks many object methods at the same time. This test may be hard to understand, and to execute",FALSE,FALSE,FALSE,FALSE
https://www2.swc.rwth-aachen.de/docs/teaching/seminar2016/FsSE%20CTRelEng%202016.pdf#page=23,An analysis of information needs to detect test smells,paper,Test Smell,Eager Test,,This smell is caused when a test tries to check several methods of the object to be tested.,FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Eager Test,,A test method checks several methods of the tested object,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/2970276.2970340,An empirical investigation into the nature of test smells,article,Test Smell,Eager Test,,"A test is affected by Eager Test when it checks more than one method of the class to be tested, making the comprehension of the actual test target difficult.",FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,Eager Test,,A unit test has at least one method that uses more than one method of the tested class.,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Eager Test,,A test method checks several methods of the tested object,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Eager Test,,A test method contains multiple calls to multiple production methods,FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Eager Test,,A test method checks several methods of the tested object,FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1109/MSR.2019.00072,Assessing diffusion and perception of test smells in scala projects,paper,Test Smell,Eager Test,,"A test case that checks or uses more than one method of the class under test. Since its introduction [3], this smell has been somewhat broadly defined. It is left to interpretation which method calls count towards the maximum. Either all methods invoked on the class under test could count, or only the methods invoked on the same instance under test, or only the methods of which the return value is eventually used within an assertion.",TRUE,TRUE,TRUE,TRUE
https://ieeexplore.ieee.org/abstract/document/8530039,Automatic Test Smell Detection Using Information Retrieval Techniques,paper,Test Smell,Eager Test,,"This smell represents a test method that exercises more methods of the object under test, thus being not cohesive and harder to read and understand. Furthermore, it makes tests more dependent on each other and harder to maintain.",FALSE,FALSE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Eager Test,"Many Assertions, Multiple Assertions, The Free Ride",A test method handles too much functionality meaning that several assertions belong to the same test method,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/4021366,Characterizing the Relative Significance of a Test Smell,paper,Test Smell,Eager Test,,An Eager test is a test command which checks several methods of the unit to be tested,FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/4021983,Detecting redundant unit tests for AspectJ programs,paper,Test Smell,Eager Test,,This smell is caused when a test tries to check several methods of the object to be tested. This will reduce the readability which makes the test hard to understand  and also harder to be used as documentation because the test tries to check too many functionalities in a single method.,FALSE,TRUE,FALSE,FALSE
https://arxiv.org/abs/2107.13902,Developers perception on the severity of test smells: an empirical study,technical paper/manuscript,Test Smell,Eager Test,,When a test method contains multiple calls to multiple production methods,FALSE,FALSE,TRUE,TRUE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Eager Test,,Many procedures of the object to be tested is checked by a test method.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Eager Test,,Test method that checks many methods of the object to be tested,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Eager Test,,"A test that tries to verify too many functionalities, which can lead to difficulty in understanding the test code",FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Eager Test,,"A test method invokes several methods of the production code, making it difficult to comprehend and maintain",FALSE,FALSE,TRUE,FALSE
https://fpalomba.github.io/pdf/Conferencs/C51.pdf,Just-In-Time Test Smell Detection and Refactoring: The DARTS Project,paper,Test Smell,Eager Test,,Arises when a non-cohesive test exercises multiple methods of the production class,FALSE,FALSE,FALSE,TRUE
http://xunitpatterns.com/Obscure%20Test.html,Obscure Test,webpage,Test Smell,Eager Test,,The test is verifying too much functionality in a single Test Method.,TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/4359471,On The Detection of Test Smells: A Metrics-Based Approach for General Fixture and Eager Test,article,Test Smell,Eager Test,,"An Eager Test is a test command that checks several methods of the unit to be tested [5]. The S-S-V-T cycle, however, suggests isolating test scenarios for individual methods under test into separate test commands",FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/2897010.2897016,On the diffusion of test smells in automatically generated test code: an empirical study,paper,Test Smell,Eager Test,,"A test is affected by Eager Test when it checks more than one method of the class to be tested, making the comprehension of the actual test target diffcult.",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Eager Test,,Occurs when a test method invokes several methods of the production object,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Eager Test,,Occurs when a test method checks more than one method of the test class,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Eager Test,,"When a test method checks several methods of the object to be tested, it is hard to read and understand, and therefore more difficult to use as documentation.  Moreover, it makes tests more dependent on each other and harder to maintain.",FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8529832,On the Relation of Test Smells to Software Code Quality,paper,Test Smell,Eager Test,,A test method exercising more methods of the tested object,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Eager Test,,A test method that contains multiple calls to multiple production methods.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9240623/,Pizza versus Pinsa: On the Perception and Measurability of Unit Test Code Quality,paper,Test Smell,Eager Test,,Unit tests exercising more than one production method,FALSE,TRUE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Eager Test,,"When a test method checks several methods of the object to be tested, it is hard to read and understand, and therefore more difficult to use as documentation",FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9240691,"Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities",paper,Test Smell,Eager Test,,"A test that checks multiple different functionalities in one case, which makes it hard to read or understand.",TRUE,FALSE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Eager Test,,"A test that veries too much functionality. It is mostly, but not necessarily, a test with a large amount of statements and assertions. It is normally dicult to understand, and it offers a  poor documentation",FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121219301487?casa_token=UT0EMFzxTcQAAAAA:L9J82_15tdySkabcIMSHKPx8rVkrltOzcwgme5cIBWgT0txJENY5y-BdUmCYUoGHnoEjZJH-cYc,Scented since the beginning: On the diffuseness of test smells in automatically generated test code,article,Test Smell,Eager Test,,"A test is affected by Eager Test when it checks more than one method of the class to be tested, making the comprehension of the actual test target difficult",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477070,Smart prediction for refactorings in the software test code,paper,Test Smell,Eager Test,,"A test method calls multiple methods of the production class. The test method has several responsibilities, making it difficult to comprehend and maintain",FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Eager Test,"The Test It All, Split Personality",A test method that at- tempts to test several behaviors of the tested object.,TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3337932.3338815,SoCRATES: Scala radar for test smells,paper,Test Smell,Eager Test,,"A test case that checks or uses more than one method of the class under test. It is left to interpretation which method calls count towards the maximum, but we consider all methods invoked on the class under test. A solid principle is that every test case should test only one method such that the test only fails when the single method fails, and not because another irrelevant method fails.",FALSE,FALSE,FALSE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Eager Test,,Occurs when a test method invokes several methods of the production object. This smell results in difficulties in test comprehension and maintenance.,TRUE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6862882/,Test code quality and its relation to issue handling performance,article,Test Smell,Eager Test,,A test that attempts to test too much functionality,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Eager Test,,A test method that calls several methods of the object to be tested,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3338906.3342500,Test-related factors and post-release defects: an empirical study,paper,Test Smell,Eager Test,,A test method exercising more than one production method,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Eager Test,,Test commands that exercise too much at once.,FALSE,FALSE,FALSE,FALSE
https://search.proquest.com/openview/c52d821a4dd6ecb046957d9d6a532ae0/1?pq-origsite=gscholar&cbl=326341,The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems,article,Test Smell,Eager Test,,A test case testing more methods of the production target.,FALSE,FALSE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Eager Test,,"A test case may exercise several methods of the object under test, which may increase the difficulty in test maintenance",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3472674.3473981,Toward static test flakiness prediction: a feasibility study,paper,Test Smell,Eager Test,,When atest method invokes several methods of the production object.,FALSE,FALSE,TRUE,FALSE
https://dibt.unimol.it/staff/fpalomba/documents/C14.pdf,Towards Automated Tools for Detecting Test Smells: An Empirical Investigation into the Nature of Test Smells,technical paper/manuscript,Test Smell,Eager Test,,"A test is affected by Eager Test when it checks more than one method of the class to be tested, making the comprehension of the actual test target difficult.",FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Eager Test,,A test method contains multiple calls to multiple production methods,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3430665.3456328?casa_token=igLWdXV-fTYAAAAA:UZiEPkDc2-NRE6_Zi0Q9FRDeUjeyZcdVTLO9Kzk53cVuo7LC-nC7m690pw6vZpQmMfa5ktOcw2pvFw,Unit Test Smells and Accuracy of Software Engineering Student Test Suites,paper,Test Smell,Eager Test,,When a single test verifies too much functionality [24],FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Eager Test,,Occurs when a test method invokes several methods of the production object,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Eager test,,The test is verifying too much functionality in a single test method.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Eager Test,,A single test verifies too much functionality.,TRUE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Early Returning Test,,"Test returning a value and too early, maybe dropping assertions",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Early Returning Test,,A test method that returns a value too early which may drop assertions,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Easy Tests,The Dodger,This kind of test only checks simple things of the production code but it neglects the real logic of it.,FALSE,FALSE,TRUE,FALSE
https://alisterbscott.com/2015/01/20/five-automated-acceptance-test-anti-patterns/,Five automated acceptance test anti-patterns,webpage,Test Smell,Embedding implementation detail in your features/scenarios,,Acceptance test scenarios are meant to convey intention over implementation. If you start seeing things like URLs in your test scenarios you’re focusing on implementation.,TRUE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Empty Method Category,,Empty method categories,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Empty Method Category,,A test method with an empty method category,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Empty Shared-Fixture,,"Fixture defined, but empty",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Empty Shared-Fixture,,A test that defines a fixture with an empty body.,FALSE,FALSE,FALSE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Empty Test,,Occurs when test methods do not contain executable assertions;,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Empty Test,,A test method that does not contain a single executable statement,FALSE,TRUE,FALSE,TRUE
https://arxiv.org/abs/2107.13902,Developers perception on the severity of test smells: an empirical study,technical paper/manuscript,Test Smell,Empty Test,,It occurs when a test method does not contain executable instructions,FALSE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Empty Test,,Test method without executable statements,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Empty Test,,It occurs when a test method does not contain executable statements,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Empty Test,,A test method with no executable statements that it is never executed,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Empty Test,,A test method that does not contain a single executable statement,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Empty Test,,"Occurs when a test method has no executable statements. Such methods are possibly created for debugging purposes without being deleted or contain commented-out test statements. An empty test method can be considered problematic and more dangerous than not having a test case at all since JUnit will indicate that the test passes even if there are no executable statements present in the method body. As such, developers introducing behavior-breaking changes into production class, will not be notified of the alternated outcomes as JUnit will report the test as passing.",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Empty Test,,Occurs when a test method does not contain executable statements,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Empty Test,,A test method that does not contain a single executable statement.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Empty Test,,Occurs when a test case does not contain executable statements. Such tests are possibly created for debugging purposes and then forgotten about or contain commented out code,FALSE,TRUE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Empty Test,,"Occurs when a test method does not contain executable statements. Such methods are possibly created for debugging purposes and then forgotten about or contains commented out code. An empty test can be considered problematic and more dangerous than not having a test case at all since JUnit will indicate that the test passes even if there are no executable statements present in the method body. As such, developers introducing behavior-breaking changes into production class, will not be notified of the alternated outcomes as JUnit will report the test as passing.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Empty Test,,A test method that is empty or does not have executable statements,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Empty Test,,Test commands without a body.,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Empty Test,,Occurs when test code has no executable statements.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Empty Test,,A test method that does not contain a single executable statement,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Empty Test,,"Occurs when a test method has no executable statements. Such methods are possibly created for debugging purposes without being deleted or contain commented-out test statements. An empty test method can be considered problematic and more dangerous than not having a test case at all since JUnit will indicate that the test passes even if there are no executable statements present in the method body. As such, developers introducing behavior-breaking changes into production class, will not be notified of the alternated outcomes as JUnit will report the test as passing.",TRUE,FALSE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Empty Test-Method Category,,Empty testing method categories,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Empty Test-Method Category,,A test method with an empty test method category,FALSE,FALSE,FALSE,FALSE
https://buildplease.com/pages/testing-deep-equalilty/,How to Compare Object Instances in your Unit Tests Quickly and Easily,webpage,Test Smell,Equality Pollution,,The code that is put into production contains logic that should be exercised only during tests… A system that behaves one way in the test lab and an entirely different way in production is a recipe for disaster!,TRUE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Equality Pollution,,Test Logic in Production is the implementation of test-specific equality in the equals method of the SUT.,FALSE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Equality Sledgehammer Assertion,,"where the interesting behaviour we are trying to prove is a subset of asserting the equality of everything, for example just knowing the count would be enough, but we assert all values in all rows – don’t go too far, through, and end up with a Blinkered Assertion – the likely cause of this smell is lack of imagination when writing an assertion and just landing on equals",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Erratic test,,"A test that gives different results, depending on when it runs and who is running it",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Erratic Test,,One or more tests are behaving erratically; sometimes they pass and sometimes they fail.,FALSE,TRUE,FALSE,TRUE
https://thoughtbot.com/upcase/videos/testing-antipatterns,Rails Testing Antipatterns,webpage,Test Smell,Erratic Tests,,tests that will pass or fail without you changing anything,TRUE,FALSE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Everything is a property,,where a test class keeps what should be temporary variables in instance variables,TRUE,FALSE,FALSE,FALSE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Evolve Or,,Tests that are not maintained after SUT code evolution and still pass,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Exception Catch/Throw,,"Passing or failing of a test case depends on custom exception handling code or exception throwing, which may hide real problems and hamper debugging.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Exception Catching Throwing,,Occurs when a test method is explicitly dependent on the production method throwing an exception,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Exception Handling,,A test method that contains either a throw statement or a catch clause,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Exception Handling,,When an exception handling is performed within a test method.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Exception Handling,,"A test method for which pass or failure depends on the production/test method throwing an exception that is captured by catch statements, instead of using the frameworks specific exception assertions",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Exception Handling,,A test method that contains either a throw statement or a catch clause,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Exception Handling,,This smell occurs when the passing or failing of a test method is explicitly dependent on the production method throwing an exception. Developers should utilize JUnit’s exception handling features to automatically pass/fail the test instead of custom exception handling code or exception throwing.,TRUE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Exception Handling,,Occurs when passing or failing of a test case is dependent on the production method explicitly throwing an exception.,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3425174.3425212,Refactoring Test Smells: A Perspective from Open-Source Developers,paper,Test Smell,Exception Handling,,Occurs when the test manually handles both exceptions and test outcome,TRUE,FALSE,FALSE,TRUE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Exception Handling,,This smell occurs when a test method explicitly a passing or failing of a test method is dependent on the production method throwing an exception. Developers should utilize JUnit's exception handling to automatically pass/fail the test instead of writing custom exception handling code or throwing an exception.,TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Exception Handling,,Occurs when custom exception handling is utilized instead of using JUnit’s exception handling feature,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Exception Handling,,A test method that contains either a throw statement or a catch clause,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Exception Handling,,This smell occurs when the passing or failing of a test method is explicitly dependent on the production method throwing an exception. Developers should utilize JUnit’s exception handling features to automatically pass/fail the test instead of custom exception handling code or exception throwing.,TRUE,FALSE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Excessive Inline Setup,,There is too much setup in each of the tests/test methods.,FALSE,FALSE,TRUE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Excessive Inline setup,,Too much setup in every test means the reader has to skip most of the test to get to the meat.,FALSE,FALSE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3379597.3387471,Did You Remember To Test Your Tokens?,paper,Test Smell,Excessive Mocking,,"Refers to a test case which requires many mocks to run [35, 45]. The system under test may need a complex environment, specific resources, or depend on 3rd party systems which cannot be provided during test execution. Running tests against a database is a canonical example. If the database isn’t available, all tests will fail even though the system under test might be completely bug-free. A common solution is to mock those potential failures by mimicking the behavior of real objects. Developers also use mocks when testing authentication, but sometimes struggle with strategy.",FALSE,TRUE,FALSE,FALSE
https://dzone.com/articles/unit-testing-smells-what-are-your-tests-telling-yo,Unit Testing Smells: What Are Your Tests Telling You?,webpage,Test Smell,Excessive Mocking,,"Some mocking is an important part of any test suite because it makes testing your code much easier. But excessive mocking usually indicates design problems. You may have too many dependencies in the class under test, or you may be testing at the wrong level of abstraction.",FALSE,TRUE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Excessive Setup,,"A test that requires a lot of work setting up in order to even begin testing. Sometimes several hundred lines of code is used to setup the environment for one test, with several objects involved, which can make it difficult to really ascertain what is tested due to the “noise” of all of the setup going on.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Excessive Setup,Large Setup Methods,A mega setup is needed in order for the test to be run.,FALSE,FALSE,TRUE,FALSE
https://www.codurance.com/publications/tdd-anti-patterns-chapter-1,TDD anti patterns - Chapter 1,webpage,Test Smell,Excessive setup,,"Many dependencies you have to create beforehand (such as classes, operating system dependencies, databases - basically anything that removes the attention to the testing goal).",TRUE,FALSE,FALSE,FALSE
https://marabesi.com/tdd/2021/08/28/tdd-anti-patterns.html,"TDD anti-patterns - the liar, excessive setup, the giant, slow poke",webpage,Test Smell,Excessive setup,,"Many dependencies you have to create beforehand (such as classes, operating system dependencies, databases - basically anything that removes the attention to the testing goal).",TRUE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,Excessive Setup,,"A test that requires a lot of work setting up in order to even begin testing. Sometimes several hundred lines of code is used to setup the environment for one test, with several objects involved, which can make it difficult to really ascertain what is tested due to the “noise” of all of the setup going on.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Excessive Setup,,"A test that requires a huge setup in order to even begin testing. Sometimes several hundred lines of code are used to prepare the environment for one test, with several objects involved, which can make it difficult to really ascertain what is tested due to the “noise” of all of the setup going on.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,Excessive Setup,Mother Hen,"A test that requires a lot of work to set up in order to even begin testing. Sometimes several hundred lines of code are used to setup the environment for one test, with several objects involved, which can make it difficult to really ascertain what is being tested due to the “noise” of all of the setup.",FALSE,FALSE,FALSE,FALSE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Expected Exceptions and Verification,,A verification happens after an expected exception is thrown and halts the test method execution,TRUE,TRUE,FALSE,TRUE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Expecting Exceptions Anywhere,,Tests that do not track the step that raised the expected exception and pass,TRUE,TRUE,FALSE,TRUE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,External Data,,"A test that needs external data (fixtures, files, helper classes, etc.) in order to run can be hard to understand as the reader must file hop to get a clear picture.",FALSE,FALSE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,External Dependencies,,The tests depend on external factors.,FALSE,FALSE,TRUE,FALSE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Anti-pattern,External Dependencies,,"There are a number of external dependencies that code may need to rely on to work correctly. For example: a specific time or date, a third-party library jar, a file, a database, a network connection, a web container, an application container, randomness, many other dependencies",FALSE,TRUE,FALSE,TRUE
https://apprize.best/c/unit/8.html,Chapter 8. The pillars of good unit tests,webpage,Test Smell,External shared-state corruption,,Integration tests with shared resources and no rollback,TRUE,TRUE,FALSE,TRUE
https://semaphoreci.com/blog/2014/01/14/rails-testing-antipatterns-fixtures-and-factories.html,Rails Testing Antipatterns: Fixtures and Factories,webpage,Test Smell,Factories depending on database records,,Adding a hard dependency on specific database records in factory definitions leads to build failures in CI environment.,TRUE,TRUE,FALSE,TRUE
https://semaphoreci.com/blog/2014/01/14/rails-testing-antipatterns-fixtures-and-factories.html,Rails Testing Antipatterns: Fixtures and Factories,webpage,Test Smell,Factories pulling too many dependencies,,"Calling one factory may silently create many associated records, which accumulates to make the whole test suite slow (more on that later)",TRUE,TRUE,FALSE,TRUE
https://semaphoreci.com/blog/2014/01/14/rails-testing-antipatterns-fixtures-and-factories.html,Rails Testing Antipatterns: Fixtures and Factories,webpage,Anti-pattern,Factories that contain unnecessary data,,When factories define more data than necessary for a model to function,FALSE,FALSE,FALSE,TRUE
https://semaphoreci.com/blog/2014/01/14/rails-testing-antipatterns-fixtures-and-factories.html,Rails Testing Antipatterns: Fixtures and Factories,webpage,Test Smell,Factories with random data instead of sequences,,"When used alongside factories, random data generators may compromise the reliability of a test suite.",TRUE,TRUE,FALSE,TRUE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Fantasy Tests,,"Passing tests of code that wouldn't actually work in production, usually as a result of a stub returning a response that's substantially different from how a real instance would behave.",TRUE,TRUE,FALSE,TRUE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Fantasy Tests,,Passing tests of code that wouldn’t actually work in production,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Feature Envy,,A macro event uses another macro component’s macro events or components excessively.,FALSE,FALSE,FALSE,TRUE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Fire And Forget,,"A test that's at risk of exiting prematurely, typically before its assertions can run and fail the test run if necessary",TRUE,TRUE,FALSE,TRUE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Fire and Forget,Plate-Spinning,The test fakes the production implementations to simplify test of subject,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3472674.3473981,Toward static test flakiness prediction: a feasibility study,paper,Test Smell,Fire and Forget,,A test that is at risk of exiting prematurely because it does not properly wait for the results of external calls.,FALSE,FALSE,TRUE,FALSE
https://techbeacon.com/app-dev-testing/7-ways-tidy-your-test-code,Writing good gherkin,webpage,Test Smell,Flaky locator,,A key component to making UI automation work is to provide your tool with identifiers to the elements that you'd like it to find and interact with. Using flaky locators—ones that are not durable—is an awful code smell. ,TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9678529/,JTDog: a Gradle Plugin for Dynamic Test Smell Detection,paper,Test Smell,Flaky test,,A flaky test is a test that both passes and fails periodically with same code,FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Flaky test,,A flaky test is a test that could fail or pass for the same configuration. Flaky tests could be harmful for developers because their failures do not always indicate bugs in the code.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Flexible Test,,Test code verifies different functionality depending on when or where it is run.,TRUE,TRUE,FALSE,TRUE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,For Testers Only,,Occurs when a production class has methods only used by test methods;,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,For Testers Only,,A production class contains methods used only by test methods,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,For Testers Only,,A production class contains methods used only by test methods,FALSE,TRUE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,For Testers Only,,A production class contains methods used only by test methods,FALSE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,For Testers Only,,The production code contains code that is strictly reserved for tests.,FALSE,FALSE,TRUE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,For Testers Only,,When methods of production class are only used by test methods.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/2897010.2897016,On the diffusion of test smells in automatically generated test code: an empirical study,paper,Test Smell,For Testers Only,,"This smell arises when a production class contains methods only used by test methods. This kind of production classes should be removed, since it does not provide functionalities used by other classes in the system. From the testing side, this smell involves an extra effort needed in order to comprehend and modify as assertions.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,For Testers Only,,"When a production class contains methods that are only used by test methods, these methods either (1) are not needed and can be removed, or (2) are only needed to set up a fixture for testing. Depending on functionality of those methods, you may not want them in production code where others can use them.",FALSE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,For Testers Only,,"When a production class contains methods that are only used by test methods, these methods either (1) are not needed and can be removed, or (2) are only needed to set up a fixture for testing",FALSE,TRUE,FALSE,TRUE
https://www.sciencedirect.com/science/article/pii/S0164121219301487?casa_token=UT0EMFzxTcQAAAAA:L9J82_15tdySkabcIMSHKPx8rVkrltOzcwgme5cIBWgT0txJENY5y-BdUmCYUoGHnoEjZJH-cYc,Scented since the beginning: On the diffuseness of test smells in automatically generated test code,article,Test Smell,For Testers Only,,This smell arises when a production class contains methods only used by test methods,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,For Testers Only,,A production class that contains methods that are only used for test methods,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,For Testers Only,,Production methods or functions which are introduced specically to make the unit under test testable.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,For Testers Only,,Code exists in the SUT strictly for use by tests.,FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Fragile Fixture,,The modification of the fixture to enable the execution of a new test causes other tests to fail.,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Fragile Fixture,,"When a Standard Fixture is modified to accommodate a new test, several other tests fail. This is an alias for either Data Sensitivity or Context Sensitivity.",FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Fragile Test,Brittle Test,The test does not compile or cannot be run due to changes in test-independent parts of the production code.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Fragile test,,A test that fails or does not compile after any change to the production code,FALSE,FALSE,TRUE,FALSE
https://thoughtbot.com/upcase/videos/testing-antipatterns,Rails Testing Antipatterns,webpage,Test Smell,Fragile Test,,tests which seem to break when they shouldn't,TRUE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Fragile Test,Brittle Test,A test fails to compile or run when the SUT is changed in ways that do not affect the part the test is exercising.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Fragile Test,,A test fails to compile or run when the system under test (SUT) is changed in ways that do not affect the part the test is exercising.,FALSE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Fragile Test,,Tests that fail because minor changes were made to the SUT are called Fragile Tests.,FALSE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Fragile Test,,"The Buggy Tests may just be the project-level symptom of Fragile Test. For false positive test failures, a good place to start is the ""four sensitivities"" (Interface Sensitivity (see Fragile Test), Behavior Sensitivity (see Fragile Test), Data Sensitivity (see Fragile Test) and Context Sensitivity (see Fragile Test).) Each of these could be the change that caused the test to fail.",FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Frequent Debugging,,The developer has to manually debug most of the failures that occur in the test.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Frequent debugging,,Manual debugging is required to determine the cause of most test failures,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.1145/3430665.3456328?casa_token=igLWdXV-fTYAAAAA:UZiEPkDc2-NRE6_Zi0Q9FRDeUjeyZcdVTLO9Kzk53cVuo7LC-nC7m690pw6vZpQmMfa5ktOcw2pvFw,Unit Test Smells and Accuracy of Software Engineering Student Test Suites,paper,Test Smell,Frequent Debugging,,"Indicates when ambiguity in test results require developers to conduct additional, manual debugging to identify the cause of the failed test.",FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Frequent Debugging,Manual Debugging,Manual debugging is required to determine the cause of most test failures.,FALSE,TRUE,FALSE,TRUE
https://idp.springer.com/authorize/casa?redirect_uri=https://link.springer.com/article/10.1007/s10664-021-10016-2&casa_token=8C-rVSu9l74AAAAA:2s5rmzBFiH74xHZlTdpZsQCxwqL4cYIbWRH6Bdq1ehTjnxcpOwi8PPkhDrhKpHqjdrQf1_ZXaVRy5BysSQ,"Rotten green tests in Java, Pharo and Python",paper,Test Smell,Fully Rotten Green Test,,"tests that do not execute one or more assertions, and do not fall into any of the three previous categories.",FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3377812.3382151,RTj: a Java framework for detecting and refactoring rotten green test cases,paper,Test Smell,Fully Rotten Green Test,,Contains an assertion which was forced to fail.,TRUE,TRUE,TRUE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Fully-Parameterized Template,,"all fields of a template are defined by formal parameters. Hence, this template conveys no information on its own.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Fully-Parameterized Template,,All fields of a template are defined by formal parameters.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Fully-Parameterized Template,,All fields of a template are defined by formal parameters.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Fuzzy assertions,,"where lack of control for the system under test, causes us not to be able to predict the exact outcome, leading to fuzzy or partial matching in our assertions",TRUE,FALSE,FALSE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,General Fixture,,"It occurs when the configuration file is generic, and different tests perform tests using part of configuration data. Those files may be hard to read, understand, and they may slower test execution;",FALSE,FALSE,FALSE,FALSE
https://www2.swc.rwth-aachen.de/docs/teaching/seminar2016/FsSE%20CTRelEng%202016.pdf#page=23,An analysis of information needs to detect test smells,paper,Test Smell,General Fixture,,General Fixture smell is mainly caused when the setup f ixture (also known as the test context) is too general and has a broad functionality resulting in different tests accessing only certain parts of the fixture.,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/2970276.2970340,An empirical investigation into the nature of test smells,article,Test Smell,General Fixture,,"A test class is affected by this smell when the setUp method is too generic and the test methods only access part of it. In other words, the test fixture is not only responsible for setting the common environment for all the test methods.",FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,General Fixture,,A test fixture is too general and the test methods access only part of it.,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,General Fixture,,A test case fixture is too general and the test methods only access a part of it,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,General Fixture,,Not all fields instantiated within the setUp method of a test class are utilized by all test methods in the same test class,FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,General Fixture,,A test case fixture is too general and the test methods only access a part of it,FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1109/MSR.2019.00072,Assessing diffusion and perception of test smells in scala projects,paper,Test Smell,General Fixture,,"A test fixture that is too general. Ideally, test cases should use all the fields provided by their fixture. This might be difficult to uphold when the fixture is shared by several test cases.",TRUE,TRUE,TRUE,TRUE
https://ieeexplore.ieee.org/document/6569744,Automated Detection of Test Fixture Strategies and Smells,paper,Test Smell,General Fixture,,"occurs if test classes contain broad functionality in the implicit setup, and different tests only access part of the fixture. Problems caused by a general fixture are two-fold: firstly, the cause-effect relationship between fixture and the expected outcome is less visible, and tests are harder to read and understand. This can cause tests to be fragile: a change that should be unrelated affects tests because too much functionality is covered in the fixture. Secondly, the test execution performance can deteriorate, and test execution times may eventually lead to developers avoiding to execute tests.",FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/8530039,Automatic Test Smell Detection Using Information Retrieval Techniques,paper,Test Smell,General Fixture,,This smell arises when the setUp fixture is too general and different tests only access part of it. Van Deursen et al. [59] reported that this smell makes the comprehension of the test class harder.,FALSE,FALSE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,General Fixture,Badly Used Fixture,The setup contains more elements than is needed by any of the tests.,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/4021366,Characterizing the Relative Significance of a Test Smell,paper,Test Smell,General Fixture,,"It is considered good practice to gather test commands exercising the same unit under test together in a test case. This results in a minimal test case fixture which can be maximally reused by all test commands [8]. Therefore, a test case fixture starts to smell when it is larger than this limited set.",FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/4021983,Detecting redundant unit tests for AspectJ programs,paper,Test Smell,General Fixture,,"General Fixture smell is mainly caused when the setup fixture (also known as the test context) is too general and has a broad functionality resulting in different tests accessing only certain parts of the fixture. So even if a test uses only a small part of the entire fixture, it still has to execute the whole fixture even though major part of the fixture is irrelevant for that test.",FALSE,TRUE,FALSE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,General Fixture,,When the setUp fixture is too general and different tests only access part of that fixture.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,General Fixture,,Setup method fields that are not used in all test methods,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,General Fixture,,It occurs when the test setup method creates fixtures (class fields used by the test cases) and a portion of the tests use only a subset of the fixtures,FALSE,TRUE,FALSE,FALSE
https://fpalomba.github.io/pdf/Conferencs/C51.pdf,Just-In-Time Test Smell Detection and Refactoring: The DARTS Project,paper,Test Smell,General Fixture,,There is a General Fixture when the fixture (initialization of setup variables) of a test suite is too general and the test methods in the suite only use a part of it,FALSE,FALSE,FALSE,TRUE
https://thoughtbot.com/blog/lets-not,Let’s not,webpage,Test Smell,General Fixture,,When the fixture is then reused and augmented by each test to create the necessary setup,TRUE,TRUE,FALSE,TRUE
http://xunitpatterns.com/Obscure%20Test.html,Obscure Test,webpage,Test Smell,General Fixture,,The test is building or referencing a larger fixture than is needed to verify the functionality in question.,TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/4359471,On The Detection of Test Smells: A Metrics-Based Approach for General Fixture and Eager Test,article,Test Smell,General Fixture,,"It is considered good practice to gather test commands exercising the same unit under test together in a test case. This results in a minimal test case fixture that gets reused by all test commands [5]. Therefore, a test case fixture starts to smell when it contains attributes not used by all test commands.",FALSE,TRUE,TRUE,TRUE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,General Fixture,,Not all fields instantiated within the setUp method of a test class are utilized by all test methods in the same test class,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,General Fixture,,"Occurs when a test case fixture is too general, and the test methods only access part of it.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,General Fixture,,Occurs when a test case fixture is general and the test method only access part of it,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,General Fixture,,In the JUnit framework a programmer can write a setUp method that will be executed before each test method to create a fixture for the tests to run in. Things start to smell when the setUp fixture is too general and different tests only access part of the fixture. Such set-ups are harder to read and understand and may make tests run more slowly (because they do unnecessary work). The danger of having tests that take too much time to complete is that testing starts interfering with the rest of the programming process and programmers eventually may not run the tests at all.,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,General Fixture,,Not all fields instantiated within the setUp method of a test class are utilized by all test methods in the same test class.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,General Fixture,,Occurs when a test suite fixture is too general and some test cases only access a part of it.,FALSE,TRUE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,General Fixture,,"In the JUnit framework a programmer can write a setUp method that will be executed before each test method to create a fixture for the tests to run in. Things start to  mell when the setUp fixture is too general and different tests only access part of the fixture. Such setUps are harder to read and understand. Moreover, they may  make tests run more slowly (because they do unnecessary work)",FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3337932.3338815,SoCRATES: Scala radar for test smells,paper,Test Smell,General Fixture,,"A test fixture that is too general. Ideally, test cases should use all the fields provided by their fixture. This might be difficult to uphold when the fixture is shared by several test cases.",TRUE,FALSE,FALSE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,General Fixture,,Occurs when a test case fixture is too general and the test methods only access part of it. A test setup/fixture method that initializes fields that are not accessed by test methods indicates that the fixture is too generalized. A drawback of it being too general is that unnecessary work is being done when a test method is run.,TRUE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6624053,Strategies for avoiding text fixture smells during software evolution,paper,Test Smell,General Fixture,,"The general fixture smell occurs if test classes contain broad functionality in the implicit setup, and if several tests only access part of the fixture",FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,General Fixture,,"This smell emerges when setUp() fixture creates many objects, and test methods only use a subset",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,General Fixture,,A test case xture that is too large.,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,General Fixture,,"A test case’s fixture is too general, and the test code only accesses a part of it. The test case may execute unnecessary code and increase runtime overhead",FALSE,FALSE,TRUE,FALSE
https://dibt.unimol.it/staff/fpalomba/documents/C14.pdf,Towards Automated Tools for Detecting Test Smells: An Empirical Investigation into the Nature of Test Smells,technical paper/manuscript,Test Smell,General Fixture,,A test class is affected by this smell when the setUp method is too generic and the test methods only access part of it,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,General Fixture,,Not all fields instantiated within the setUp method of a test class are utilized by all test methods in the same test class,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,General Fixture,,"Occurs when a test case fixture is too general, and the test methods only access part of it.",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,General fixture,,The test is building or referencing a larger fixture than is needed to verify the functionality in question.,FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121221000364,Why do builds fail?—A conceptual replication study,article,Test Smell,General Fixture,,JUnit classes having at least one method not using the entire test fixture defined in the setUp() method,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,General Fixture,,Tests are consistently slow because each test builds the same fixture.,FALSE,TRUE,FALSE,TRUE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Generative,,A test loops over a data structure of discrete inputs and expected outputs to generate test cases.,TRUE,TRUE,FALSE,TRUE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Generous Leftovers,,"An instance where one unit test creates data that is persisted somewhere, and another test reuses the data for its own devious purposes. If the “generator” is run afterword, or not at all, the test using the data will outright fail.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Generous Leftovers,,The unit test creates data which remains afterwards and is used by other tests for their own purposes. This can cause the first test to fail if it tries to reuse the data.,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,Generous Leftovers,,"An instance where one unit test creates data that is persisted somewhere, and another test reuses the data for its own devious purposes. If the “generator” is ran afterward, or not at all, the test using that data will outright fail.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,Generous Leftovers,Wet Floor,"An instance where one unit test creates data that is persisted somewhere, and another test reuses the data for its own devious purposes. If the “generator” is ran afterward, or not at all, the test using that data will outright fail.",FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Get really clever and use random numbers in your tests,,considering using random numbers in tests as being a smell,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Goto Statement,,a goto statement is used,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Goto Statement,,A goto statement is used. The use of goto statements is inadvisable and should be avoided.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Goto Statement,,A goto statement is used,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Ground zero,,where the lack of testing with 0 is the source of a lot of bugs.,TRUE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Guarded Test,,Guarded Tests include boolean branching logics like ifTrue: or ifFalse:,TRUE,TRUE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Guarded Test,,Conditional test including branches like ifTrue:aBlock or ifFalse:aBlock,TRUE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Guarded Test,,A test that has conditional branches like ifTrue:aCode or ifFalse:aCode,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Half a helper method,,"where there’s a utility method to help a test do its job, yet all calls to it are immediately followed by the exact same code. This is because the method is only doing half the job it should, so your test has more boilerplate in it.",TRUE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Happenstance testing,,"where assertions are trying to lock down implementation details that are not directly important and might validly change, for example the exact wording of an exception",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Happy Path,,The test “stays on the happy path” (i.e. expected results) without testing for boundaries and exceptions.,FALSE,FALSE,FALSE,FALSE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Happy Path,,"A test that uses known input, which executes without exception and produces an expected output.",TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Happy Path,,The test methods only check the behaviour that is expected from the production code.,FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Happy Path,,The test stays on happy paths (i.e. expected results) without testing for boundaries and exceptions.,FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Happy Path,,The test stays on happy paths (i.e. expected results) without testing for boundaries and exceptions.,FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,Happy Path,,"The tests stay on happy paths (i.e. expected results, e.g. 18 years old) without testing for boundaries and exceptions (e.g. -2 years old)",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/4021983,Detecting redundant unit tests for AspectJ programs,paper,Test Smell,Hard-Coded Test Data,,This is caused due to the embedding or hard-coding of data values in the fixture of the SUT into the test method. This obscures causeeffect relationships between inputs and expected outputs,FALSE,FALSE,FALSE,FALSE
http://xunitpatterns.com/Obscure%20Test.html,Obscure Test,webpage,Test Smell,Hard-Coded Test Data,,"Data values in the fixture, assertions or arguments of the SUT are hard-coded in the Test Method obscuring cause-effect relationships between inputs and expected outputs.",TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/6606682,Hunting for smells in natural language tests,paper,Test Smell,Hard-Coded Values,,"Tests contain lots of ’magic numbers’ or Strings (e. g., test data or names of user interface elements).",FALSE,TRUE,TRUE,FALSE
https://www.integer-net.com/test-smell-hard-coded-values/,Test Smell: Hard Coded Values,webpage,Test Smell,Hard-Coded Values,,"Scalar values or value objects that are used directly in fixture setup, as parameters in the test exercise or as expected values in the verification. That is, they are not assigned to a named constant or variable.",TRUE,TRUE,FALSE,TRUE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Hard-to-Test Code,,"As the name suggests, code is hard to test. Few types of code are difficult to test, such as GUI components, multi-threaded code and test code",FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Hard-to-Test Code,,"""Legacy software"" (any software that doesn't have a complete suite of automated tests) can be hard to test since we are typically writing the tests ""last"" (after the software already exists.) If the design of the software is not conducive to automated testing, we may be forced to use Indirect Testing (see Obscure Test) via awkward interfaces that involve a lot of accidental complexity; that may result in Fragile Tests or a Fragile Fixture.",FALSE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Hard-to-Test Code,,"Another common cause, especially with ""legacy software"" (defined for our purposes as any software that doesn't have a complete suite of automated tests) is that the design of the software is not conducive to automated testing. This Hard-to-Test Code may force us to use Indirect Testing (see Obscure Test) and that may result in a Fragile Test or a Fragile Fixture (see Fragile Test).",FALSE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Hard-to-Test Code,,"Another common cause, especially with ""legacy software"" (defined for our purposes as any software that doesn't have a complete suite of automated tests) is that the design of the software is not conducive to automated testing. This situation is described in more detail in its own smell section, Hard-to-Test Code",FALSE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Hard-to-Test Code,,Code is difficult to test. Automated testing is a powerful tool that helps us develop software quickly even after we have a large code base to maintain but it only provides these benefits if most of our code has Fully Automated Test,FALSE,FALSE,FALSE,TRUE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,hard-to-write test,,"Making hacks that need an explanation or having complicated setups, so that a scenario can be tested",FALSE,TRUE,FALSE,FALSE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Hardcoded environment,,The test contains hardcoded references to the environment when the same requirement must be run against different test environments instead of having an environment-agnostic test.,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Hardcoded environment,,The test contains hardcoded references to the environment when the same requirement must be run against different test environments instead of having an environment-agnostic test.,FALSE,TRUE,TRUE,TRUE
https://www.codementor.io/@mgawinecki/anti-patterns-in-test-automation-101c6vm5jz,Anti-patterns in test automation,webpage,Anti-pattern,Hardcoded environment configuration,,"Imagine same checks must be run against both Firefox and Chrome; or against local and then pre-production test environments. No way to do it if you hardcoded references to browser type, server host or databases.",FALSE,FALSE,FALSE,TRUE
https://www.codementor.io/@mgawinecki/anti-patterns-in-test-automation-101c6vm5jz,Anti-patterns in test automation,webpage,Anti-pattern,Hardcoded test data,Magic Strings,maintaning hardcoded test data becomes a nightmare,FALSE,FALSE,FALSE,TRUE
http://blog.codepipes.com/testing/software-testing-antipatterns.html,Software Testing Anti-patterns,webpage,Anti-pattern,Having flaky or slow tests,,A test that sometimes fails and sometimes passes (without any code changes in between) is unreliable and undermines the whole testing suite,FALSE,TRUE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Herp Derp,,"words and comments in test code or names that add nothing, like simple or test or //given",TRUE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.159.6145&rep=rep1&type=pdf,Parameterized Test Patterns For Effective Testing with Pex,technical paper/manuscript,Anti-pattern,Hidden Complexity,,A piece of code that uses innocent looking API that in fact performs a lot of computation.,FALSE,TRUE,FALSE,TRUE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Hidden Dependency,,"A close cousin of the Local Hero, a unit test that requires existing data to have been populated somewhere before the test runs. If that data wasn’t populated, the test will fail and leave little indication to the developer what it wanted, or why… forcing them to dig through acres of code to find out where the data it was using was supposed to come from.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Hidden Dependency,,This smell is related to ‘The Local Hero’. The programmer needs to manually create data before the test can be run.,FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Hidden Dependency,,"closely related to the local hero, a unit test that requires some existing data to have been populated somewhere before the test runs",FALSE,FALSE,FALSE,FALSE
https://semaphoreci.com/blog/2014/07/10/tdd-antipatterns-local-hero.html,Tdd antipatterns: Local hero,webpage,Anti-pattern,Hidden Dependency,,"A unit test that requires some existing data to have been populated somewhere before the test runs. If that data wasn’t populated, the test will fail and leave little indication to the  developer what it wanted, or why… forcing them to dig through acres of code to find out where the data it was using was supposed to come from.",FALSE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,Hidden Dependency,,"A close cousin of The Local Hero, a unit test that requires some existing data to have been populated somewhere before the test runs. If that data wasn’t populated, the test will fail and leave little indication to the developer what it wanted, or why… forcing them to dig through acres of code to find out where the data it was using was supposed to come from.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Hidden Dependency,,"Closely related to the local hero, a unit test that requires some existing data to have been populated somewhere before the test runs. If that data wasn’t populated, the test will fail and leave little indication to the developer what it wanted, or why… forcing them to dig through acres of code to find out where the data it was using was supposed to come from.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.159.6145&rep=rep1&type=pdf,Parameterized Test Patterns For Effective Testing with Pex,technical paper/manuscript,Test Smell,Hidden Integration Test,,A PUT outcome depends on the state of the environment.,TRUE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Hidden Meaning,,"where something that should be part of the execution of the test, and appear in a test report, is hidden in a comment – essentially comment instead of name",TRUE,FALSE,FALSE,FALSE
https://apprize.best/c/unit/8.html,Chapter 8. The pillars of good unit tests,webpage,Test Smell,Hidden test call,,Tests calling other tests,TRUE,TRUE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Hidden Test Data,,The data are not directly visible and understandable in the test but are hidden in the fixture code,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Hidden Test Data,,The data are not directly visible and understandable in the test but are hidden in the fixture code,FALSE,TRUE,TRUE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Hooks everywhere,Testing Causes an Abstraction Virus,where the production code has awkward backdoors in it to allow test-time rewiring or intercepting,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,I wrote it like this,,testing the known implementation rather than the outcome of that implementation.,FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,I'll believe it when I see some flashing GUIs,,"An unhealthy fixation/obsession with testing the app via its GUI, “just like a real user.”",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,I'll believe it when I see some flashing GUIs,,"An unhealthy fixation/obsession with testing the app via its GUI 'just like a real user'. Testing business rules through the GUI is a terrible form of coupling. If you write thousands of tests through the GUI, and then change your GUI, thousands of tests break. Rather, test only GUI things through the GUI, and couple the GUI to a dummy system instead of the real system, when you run those tests. Test business rules through an API that doesn't involve the GUI.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Identity Dodgems,,"where each test case shares some sort of global resource – perhaps a database, or a singleton data store, so needs to choose identifiers carefully in order to avoid collisions with other tests. Better in this case to use a central ID generator, to avoid accidental collisions, or each test having to be aware of all other tests’ choice of IDs.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Idle PTC,,"A parallel test component (PTC) is created, but never started",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Idle PTC,,A PTC is created but never started. A PTC which is not started is of no use for the test case.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Idle PTC,,"A Parallel Test Component (PTC) is created, but never started.",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Ignored Test,,A test method or class that contains the @Ignore annotation,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Ignored Test,,When a test method is ignored through the framework’s annotation,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Ignored Test,,A test method or class that contains the @Ignore annotation,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Ignored Test,,"A test method is suppressed from running, which can create an additional overhead at compilation time or increase test code complexity",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Ignored Test,,A test method or class that contains the @Ignore annotation,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Ignored Test,,"JUnit 4 provides developers with the ability to suppress test methods from running. However, these ignored test methods result in overhead with regards to compilation time and an increase in code complexity and comprehension",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Ignored Test,,Occurs when a test method is suppressed from running,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Ignored Test,,A test method or class that contains the @Ignore annotation.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Ignored Test,,Caused by ignored test cases when it is possible to suppress some test cases from running,FALSE,TRUE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Ignored Test,,"JUnit 4 provides developers with the ability to suppress test methods from running. However, these ignored test methods result in overhead since they add unnecessary overhead with regards to compilation time, and increases code complexity and comprehension.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Ignored Test,,A test method that uses an ignore annotation which prevents the test method from running,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Ignored Test,,A test case that is disabled using JUnit’s @Ignore.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Ignored Test,,A test method or class that contains the @Ignore annotation,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Ignored Test,,"JUnit 4 provides developers with the ability to suppress test methods from running. However, these ignored test methods result in overhead with regards to compilation time and an increase in code complexity and comprehension",TRUE,FALSE,TRUE,FALSE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Improper clean up after tests have been run,,Improper cleanup occurs when the code that cleans up the mocks and anything created in the test is insufficient or entirely lacking. It may leave files open or objects in memory causing memory leaks. This can be especially important if your tests are doing any type of file manipulation or you are creating files specifically for testing.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Improper Test Method Location,,"Smalltalk-developers normally organize their source-code in packages, classcategories and method-categories. Although there is no common convention for doing so, most projects we encountered during our case study are organized in a very similar fashion. However we also noticed that tests are sometimes excluded from that.",FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6571656,On adequacy of assertions in automated test suites: an empirical investigation,paper,Test Smell,Inadequate Assertion,,"Every update to the execution state must eventually be verified in the assertions. In principle, assertions should verify the correctness of all updates to the  object/program state, otherwise the strength of the test oracles is considered not enough to guard the program against faults.",TRUE,TRUE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Inappropriate Assertions,Wrong Assert,"An inappropriate assertion is being used. For example, assertTrue is used to check the equality of values instead of assertEquals.",FALSE,FALSE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Inappropriately Shared Fixture,,Some tests in the fixture have no need of a setup at all.,FALSE,FALSE,TRUE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Inappropriately Shared Fixture,,Several test cases in the test fixture do not even use or need the setup / teardown. Partly due to developer inertia to create a new test fixture... easier to just add one more test case to the pile,FALSE,FALSE,FALSE,FALSE
https://jasonrudolph.com/blog/testing-anti-patterns-how-to-fail-with-100-test-coverage/,Testing anti-patterns: How to fail with 100% test coverage,webpage,Test Smell,Incidental coverage,,"Is it enough to know that your test suite encounters every line of code? Or don’t you want to be sure that it exercises every line? If you simply encounter the line without asserting that it produces the correct results, are you any better off?",TRUE,TRUE,FALSE,TRUE
https://cucumber.io/blog/bdd/cucumber-antipatterns-part-one/,Cucumber anti-patterns (part one),webpage,Anti-pattern,Incidental details,,"Rambling long scenarios with lots of incidental details can ruin a good story. Often times the scenarios are written as a test, rather than documentation, which can lead to fluffy scenarios.",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Inconsistent Hierarchy,,The macro component hierarchy is inconsistent with the structure of the GUI,FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/6606682,Hunting for smells in natural language tests,paper,Test Smell,Inconsistent Wording,,"Domain concepts are not used in a consistent way (e. g., several names are used for the same domain concept).",FALSE,TRUE,TRUE,FALSE
https://techbeacon.com/app-dev-testing/7-ways-tidy-your-test-code,Writing good gherkin,webpage,Test Smell,Indecent exposure,,"Classes and methods should not expose their internals unless there's a good reason to do so. In test automation code bases, we explicitly separate our tests from our framework. It's important to stay true to this by hiding internal framework code from our test layer. It's a code smell to expose class fields such as web elements used in Page Object classes, or class methods that return web elements. Doing so enables test code to access these DOM-specific items, which is not its responsibility. ",FALSE,TRUE,FALSE,TRUE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Indecisive,,"A test contains branching logic. Of course, test-scoped logic is always risky, since it is itself untested. But this smell portends some deeper issues worth discussing.",TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Indented Test,,"A test method that contains a large number of decision points, loops, and conditional statements",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Indented Test,,Overuse of loops and conditionals in test code.,FALSE,FALSE,FALSE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Indirect Testing,,"It occurs when test class has methods that perform tests in different objects because there are references to those objects at the test class, for example.",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Indirect Testing,,A test interacts with the object under test indirectly via another object,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,Indirect Testing,,A test allocates resources also used by others ,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Indirect Testing,,A test interacts with the object under test indirectly via another object,FALSE,TRUE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Indirect Testing,,A test interacts with the object under test indirectly via another object,FALSE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Indirect Testing,,The test method tests an object indirectly via another object.,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/4021983,Detecting redundant unit tests for AspectJ programs,paper,Test Smell,Indirect Testing,,The test method makes the interactions more complex by using another object to indirectly interact with the SUT,FALSE,FALSE,FALSE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Indirect Testing,,Methods of a test class perform tests on other objects due to references exist to them in the class to be tested.,FALSE,FALSE,FALSE,FALSE
http://xunitpatterns.com/Obscure%20Test.html,Obscure Test,webpage,Test Smell,Indirect Testing,,The Test Method is interacting with the SUT indirectly via another object thereby making the interactions more complex.,TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/2897010.2897016,On the diffusion of test smells in automatically generated test code: an empirical study,paper,Test Smell,Indirect Testing,,"A test that checks the corresponding production class using methods of another class. Such indirection, in addition to being a design error, can create problems  in the comprehension of the sequence of calls performed by the test case during its activities.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Indirect Testing,,A test class is supposed to test its counterpart in the production code. It starts to smell when a test class contains methods that actually perform tests on other  objects (for example because there are references to them in the class-to-be-tested).,FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8529832,On the Relation of Test Smells to Software Code Quality,paper,Test Smell,Indirect Testing,,A test that interacts with the object under test indirectly via another object,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Indirect Testing,,A test class is supposed to test its counterpart in the production code. It starts to smell when a test class contains methods that actually perform tests on other objects (for exa mple because there are references to them in the class-to-be-tested).,FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9240691,"Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities",paper,Test Smell,Indirect Testing,,Tests the class under test using methods from other classes,FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121219301487?casa_token=UT0EMFzxTcQAAAAA:L9J82_15tdySkabcIMSHKPx8rVkrltOzcwgme5cIBWgT0txJENY5y-BdUmCYUoGHnoEjZJH-cYc,Scented since the beginning: On the diffuseness of test smells in automatically generated test code,article,Test Smell,Indirect Testing,,"A test that checks the corresponding produc- tion class using methods of another class. Such indirection, in addition to being a design error, can create problems in the comprehension of the sequence of calls performed by the test case during its activities and make the test prone to flakiness",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Indirect Testing,,A test that interacts with a corresponding class by using another class.,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Indirect Testing,,Test commands that exercise components via other components.,FALSE,FALSE,FALSE,FALSE
https://search.proquest.com/openview/c52d821a4dd6ecb046957d9d6a532ae0/1?pq-origsite=gscholar&cbl=326341,The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems,article,Test Smell,Indirect Testing,,Atest interacting with the target via another object.,FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121221000364,Why do builds fail?—A conceptual replication study,article,Test Smell,Indirect Testing,,"JUnit classes invoking, besides methods of the tested class, methods of other classes in the production code",FALSE,FALSE,FALSE,FALSE
https://techbeacon.com/app-dev-testing/7-ways-tidy-your-test-code,Writing good gherkin,webpage,Test Smell,Inefficient waits,,Adding a hard-coded wait that tells the test to pause for x number of seconds is a code smell. ,FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Insufficient grouping,,a module or group contains too many elements.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Insufficient Grouping,,"A module or group contains too many elements. Especially for large modules, groups should be used to add logical structure to the module and enhance readability. If a group reaches a critical size, it can be structured further by subgroups.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Insufficient Grouping,,A module or group contains too many elements,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,"Integration test, masquerading as unit test",,"where there are too many layers involved in making a unit test, so it runs too long",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Interacting Test Suites,,The tests which are dependent on each other belong to different test suites.,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Interacting Test Suites,,A special case of Interacting Tests where the tests are in different test suites.,TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Interacting Tests,,The tests are dependent on each other.,FALSE,FALSE,TRUE,FALSE
https://jrnl.nau.edu.ua/index.php/IPZ/article/download/3084/3036/0,Quality defects detection in unit tests,technical paper/manuscript,Test Smell,Interacting Tests,,When a test depends on other tests. There is not enough information to understand the tested functionality,FALSE,TRUE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Interacting Tests,,Tests depend on each other in some way. Note that Interacting Test Suites and Lonely Test are specific variations of Interacting Tests.,FALSE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Interactive Test,,"An Interactive Test is a test that interrupts the automatic execution of a test, requiring manual actions from the user, for example pressing a button, closing a window or entering some data.",FALSE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Interface Sensitivity,,Changes to the interface that is used by the tested system affect the execution of the test.,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Interface Sensitivity,,Interface Sensitivity is when a test fails to compile or run because some part of the interface of the SUT that is uses has changed.,FALSE,TRUE,FALSE,TRUE
https://dzone.com/articles/unit-testing-smells-what-are-your-tests-telling-yo,Unit Testing Smells: What Are Your Tests Telling You?,webpage,Test Smell,Intermittent Test Failures,,"You run them with the same inputs over and over again, and usually, but not always, they produce the same output.",FALSE,TRUE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Invalid test data,,when the test data would not be valid if used in real life – does this make the test invalid or not?,FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Invasion Of Privacy,,A test is written directly against a method that's intended to be a private implementation detail of the subject.,TRUE,TRUE,FALSE,TRUE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Invasion of Privacy,,Testing of private function that is unreachable in production code,FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Invisible Assertions,,"A test which lacks any explicit assertions, leading future readers in the potentially frustrating position of puzzling over the intention of the test.",TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/4021983,Detecting redundant unit tests for AspectJ programs,paper,Test Smell,Irrelevant Information,,The test distracts the user by containing a lot of irrelevant details about the fixture and the user is not able to focus on what really affects the behavior of SUT,FALSE,FALSE,FALSE,FALSE
http://xunitpatterns.com/Obscure%20Test.html,Obscure Test,webpage,Test Smell,Irrelevant Information,,The test is exposing a lot of irrelevant details about the fixture that distract the test reader from what really affects the behavior of the SUT.,TRUE,TRUE,FALSE,TRUE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Is Mockito Working Fine?,,When the mock framerwork is tested intead of the SUT,TRUE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Is There Anybody There?,,any flickering test that occasionally breaks a build – bad test or bad code?,TRUE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Isolated PTC,,"A PTC is created and started, but neither connected to another component nor mapped to the TSI. A PTC which is not connected or mapped is isolated from all other components, especially the MTC, and is of no use for the test.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Isolated PTC,,"A PTC is created and started, but its ports are not connected to other ports.",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3379597.3387471,Did You Remember To Test Your Tokens?,paper,Test Smell,Issues in Exception Handling,The Silent Catcher,"A test case that succeeds even when an exception is thrown. Mostly, the exception is ignored along with its type, which represents specific semantics. This may lead to false results, e.g. when testing the authentication protocol.",FALSE,TRUE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,It looks right to me,,where the test data for negative cases makes the test hard to understand,TRUE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,It was like that when I got here,,"a test fixture that doesn’t take any care over managiong the pre and post-test state, leading to all manner of side effects, including The Leaky Cauldron and The Soloist",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Lack of Cohesion of Test Cases,,Occurs if test cases are grouped together in one test suite but are not cohesive.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/6569744,Automated Detection of Test Fixture Strategies and Smells,paper,Test Smell,Lack of Cohesion of Test Methods,,"Cohesion of a class indicates how strongly related and focused the various responsibilities of a class are [4]. Classes with high cohesion facilitate code comprehension and maintenance. Low cohesive methods are smelly because they aggravate reuse, maintainability and comprehension [6], [12]. The smell Lack of Cohesion of test methods (LCOTM) occurs if test methods are grouped together in one test class, but they are not cohesive.",FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/8530039,Automatic Test Smell Detection Using Information Retrieval Techniques,paper,Test Smell,Lack of Cohesion of Test Methods,,"This smell occurs if test methods (excluding the setUp fixture) are grouped together in one test class but they are not cohesive, causing comprehensibility and maintainability issues.",FALSE,FALSE,TRUE,FALSE
https://fpalomba.github.io/pdf/Conferencs/C51.pdf,Just-In-Time Test Smell Detection and Refactoring: The DARTS Project,paper,Test Smell,Lack of Cohesion of Test Methods,,When there is low cohesion between the test methods in a test suite,FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/6624053,Strategies for avoiding text fixture smells during software evolution,paper,Test Smell,Lack of Cohesion of Test Methods,,"Cohesion of a class indicates how strongly related and focused the various responsibilities of a class are [12]. Low cohesive classes are smelly because they negatively affect code reuse, maintainability and comprehension [8], [13]. The smell Lack of Cohesion of Test Methods (LCOTM) occurs if test methods are grouped together in one test class without being cohesive",FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Lack of Cohesion of Test Methods,,"When test methods are grouped in one test class, but they are not cohesive.",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Lack of Encapsulation,,Using primitive events directly instead of encapsulating actions into macro events.,FALSE,FALSE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Lack of Encapsulation,,The implementation details of a test are not properly hidden in the implementation layer and start appearing in its acceptance criteria.,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Lack of Encapsulation,,The implementation details of a test are not properly hidden in the implementation layer and start appearing in its acceptance criteria.,FALSE,TRUE,TRUE,TRUE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Lack of Macro Events,,A macro component does not have any macro events.,FALSE,FALSE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Large Fixture,,"Provides a large amount of data to the tests, making it difficult to understand the state of a unit under test and also obfuscating the purpose of the tests. Furthermore setup and teardown require a large amount of time slowing down the execution of the tests",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Large Macro Component,,"A single macro component contains too many primitive components, macro events, and macro components",FALSE,FALSE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.115.3594&rep=rep1&type=pdf,A Refactoring Tool for TTCN-3,thesis,Test Smell,Large Module,Large Class,indicates that the module may be trying to do too much. It becomes hard to read and it likely combines too many distinct code parts which are better off in multiple modules,FALSE,FALSE,FALSE,TRUE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Large Test File,,Things can be hard to find in a large test file and its documentation value is lost.,FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Lazy Test,,Several test methods check a method of the tested class using the same fixture.,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,Lazy Test,,Several test methods check a method of the tested class using the same fixture.,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Lazy Test,,Several test methods check a method of the tested class using the same fixture.,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Lazy Test,,Multiple test methods calling the same production method,FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Lazy Test,,Several test methods check a method of the tested class using the same fixture.,FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1109/MSR.2019.00072,Assessing diffusion and perception of test smells in scala projects,paper,Test Smell,Lazy Test,,"More than one test case with the same fixture that tests the same method. This smell affects test maintainability, as assertions testing the same method should be in the same test case. Like EAGER TEST, the original definition [3] leaves some details to interpretation. We consider every call to the class under test as a potential cause of LAZY TEST, irrespective of whether their results are used in an assertion.",TRUE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Lazy Test,,The test methods test the same method of the production code relying on the same fixture.,FALSE,FALSE,TRUE,FALSE
https://arxiv.org/abs/2107.13902,Developers perception on the severity of test smells: an empirical study,technical paper/manuscript,Test Smell,Lazy test,,It occurs when multiple test methods call the same production method,FALSE,FALSE,TRUE,TRUE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Lazy Test,,"When a method is checked by several test methods using the same fixture. Thus, the tests become meaningful when they are considered together",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Lazy Test,,Several test methods that verify the same production method,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Lazy Test,,"Multiple test methods call the same production method, which may introduce redundancy or inconsistencies among them",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Lazy Test,,Occurs when multiple test methods invoke the same method of the production object,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Lazy Test,,Occurs when several test methods check the same method,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Lazy Test,,This occurs when several test methods check the same method using the same fixture (but for example check the values of different instance variables).,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Lazy Test,,Multiple test methods calling the same production method.,FALSE,TRUE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Lazy Test,,This occurs when several test methods check the same method using the same fixture (but for example check the values of different instance variables),FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3337932.3338815,SoCRATES: Scala radar for test smells,paper,Test Smell,Lazy Test,,"More than one test case with the same fixture that tests the same method. This smell affects test maintainability, as assertions testing the same method should be in the same test case.",FALSE,FALSE,FALSE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Lazy Test,,Occurs when multiple test methods invoke the same method of the production object.,TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Lazy Test,,Occurs when multiple test methods check the same method of production object,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Lazy Test,,"Occurs when multiple test cases invoke the same method of the source code object, which may increase the difficulty in test maintenance",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Lazy Test,,Multiple test methods calling the same production method,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Lazy Test,,Occurs when multiple test methods invoke the same method of the production object,FALSE,FALSE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Likely ineffective Object-Comparison,,Objects comparisons which can never fail,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Likely Ineffective Object-Comparison,,A test that performs a comparison between objects will never fail.,FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Line hitter,,"On the first look tests covers everything and code coverage tools confirms it with 100%, but in reality tests only hit code without any output analyses.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,Line hitter,,"At first glance, the tests cover everything and code coverage tools confirm it with 100%, but in reality the tests merely hit the code, without doing any output analysis.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Literal Pollution,,"When writing tests for the application code it is mostly required also to provide some data to be able to test the functionality. This is mostly done by dening literals in the test code. However an excessive use of literals can cause severe problems:
- Too many literals are distracting and obfuscate the functionality and purpose of a test. This makes a test hard to read and understand. 
- The same or similar test data is often repeated within a test or testsuite. This is often a consequence of simply extending or adding tests without actually designing them. The result is a test-suite that is extremely hard to maintain and refactor. We detected such Duplication in harvesting our case study.",TRUE,TRUE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Litter Bugs,test pollution,"Each test has a side effect that persists between test cases, often resulting in tests that depend on one another. This is often called ""test pollution""",TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Lonely Test,,The test can only be run in a collection of tests (test suite) but not on its own since it depends on the shared fixture of another test in the collection.,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Lonely Test,,Lonely Test is a special case of Interacting Tests in which a test can be run as part of a suite but cannot be run by itself because it depends on something in a Shared Fixture that was created by another test (e.g. Chained Tests (page X)) or by suite-level fixture setup logic (such as a Setup Decorator.),FALSE,TRUE,FALSE,TRUE
https://techbeacon.com/app-dev-testing/7-ways-tidy-your-test-code,Writing good gherkin,webpage,Test Smell,Long class,,"To properly execute your automated test, your code must open your application in a browser, perform the necessary actions on the application, and then verify the resulting state of the application. While these are all needed for your test, these are different responsibilities, and having all of these responsibilities together within a single class is a code smell. This smell makes it difficult to grasp the entirety of what's contained within the class, which can lead to redundancy and maintenance challenges. ",FALSE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.115.3594&rep=rep1&type=pdf,A Refactoring Tool for TTCN-3,thesis,Test Smell,Long Function,Long Method,Long functions are hard to understand and indirection can be better supported by small functions,FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Long Macro Event,Long Keyword,A macro event (or keyword) contains too many actions.,FALSE,FALSE,FALSE,TRUE
https://techbeacon.com/app-dev-testing/7-ways-tidy-your-test-code,Writing good gherkin,webpage,Test Smell,Long method,,"It's where a method or function has too many responsibilities. Many times a method does not start off being too long, but over time it grows and grows, taking on additional responsibilities. This poses an issue when tests want to call into a method to do one thing, but will ultimately have multiple other things executed as well. ",FALSE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.115.3594&rep=rep1&type=pdf,A Refactoring Tool for TTCN-3,thesis,Test Smell,Long Parameter List,,"Long parameter lists are hard to understand, become inconsistent and difficult to use as they are always changed when more data is needed",FALSE,FALSE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Long parameter list,,the number of formal parameters is high,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Long Parameter List,,The parameter list of a keyword or macro event is too long; it is difficult to understand the meaning of each parameter.,FALSE,FALSE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Long Parameter List,,High number of formal parameters.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Long Parameter List,,The number of formal parameters is high,FALSE,FALSE,FALSE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Long Running Tests,,"When the feedback loop of code, test, code gets too long it can encourage bad behavior.",FALSE,FALSE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Long statement block,,"a function, test case, or altstep has a long statement block.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Long Statement Block,,"Long statement block in function, test case or altstep. A long function is more difficult to understand than a short one. Although the use of short functions (i.e. methods) is especially important for modern objectoriented languages, short functions have a certain importance for TTCN-3 as well. Long statement blocks in functions, test cases and altsteps should be decomposed into short functions with meaningful names.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Long Statement Block,,"A function, test case, or altstep has a long statement block",FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Long Test,,A test method is so long that it's testing multiple things.,TRUE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Long Test,,"A Long Test is a test that consists of lot of code and statements. Such tests are mostly (but not necessarily) complex and badly document the purpose of the test and the application code. Furthermore they tend to test too much functionality, maybe even getting eager.",TRUE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Long Test,"Obscure Test, Verbose Test, Complex Test","The test is too long in general and thus, is complicated to understand.",FALSE,FALSE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Long Test,,Tests including too many statements,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Long Test,,A test with many statements.,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6606682,Hunting for smells in natural language tests,paper,Test Smell,Long Test Steps,,A test step is very long,FALSE,TRUE,TRUE,FALSE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Long Test Steps,,"One or many test steps are very long, performing a lot of actions on the system under test.",FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Long Test Steps,,"One or many test steps are very long, performing a lot of actions on the system under test.",FALSE,TRUE,TRUE,TRUE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Long/complex/verbose/obscure test,,It is difficult to understand the test at a glance. The test usually has excessive lines of code.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Lost Test,,The number of tests being executed in a test suite has dropped (or has not increased as much as expected). We may notice this directly if we are paying attention to test counts or we may find a bug that should have been caused by a test that we know exists but upon poking around we discover that the test has been disabled.,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Magic Number,,Occurs when assert statements contain numeric literals,FALSE,FALSE,FALSE,FALSE
https://damorimrg.github.io/practical_testing_book/goodpractices/artifacts.html,Test Artifacts — The Practical Testing Book,webpage,Test Smell,Magic Number,,When the significance of the numeric literals that was passed as parameter in the assertion method is unknowed,TRUE,FALSE,FALSE,TRUE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Magic Number Test,,Occurs when tests present a literal number as a test parameter,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Magic Number Test,,An assertion method that contains a numeric literal as an argument,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Magic Number Test,,Test Method that contains some number without indicating their purpose,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Magic Number Test,,"A test that contains so-called “magic numbers”, which are numbers used in assertions without any explanation where they come from and their value may not be immediately clear from just looking at the test code",FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Magic Number Test,,Assert statements in a test method contains numeric literals as parameters that may not provide their meaning,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Magic Number Test,,An assertion method that contains a numeric literal as an argument,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Magic Number Test,,"This smell occurs when a test method contains unexplained and undocumented numeric literals as parameters or as values to identifiers. These magic values do not sufficiently indicate the meaning/purpose of the number. Hence, they hinder code understandability. Consequently, they should be replaced with constants or  variables, thereby providing a descriptive name for the value.",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Magic Number Test,,An assertion method that contains a numeric literal as an argument.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Magic Number Test,,"Occurs when assert statements in a test case contain numeric literals (i.e., magic numbers) as parameters instead of more descriptive constants or variables",FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3425174.3425212,Refactoring Test Smells: A Perspective from Open-Source Developers,paper,Test Smell,Magic Number Test,,Occurs when the test method contains undocumented numeric literals with no clear meaning (magic values).,TRUE,FALSE,FALSE,TRUE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Magic Number Test,,"Occurs when assert statements in a test method contain numeric literals (i.e., magic numbers) as parameters. Magic numbers do not indicate the meaning/purpose of the number. Hence, they should be replaced with constants or variables, thereby providing a descriptive name for the input.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Magic Number Test,,A test method that contains undocumented numerical values,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Magic Number Test,,"A test method contains unexplained and undocumented numeric literals as parameters or identifiers, which increases maintenance difficulty.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Magic Number Test,,An assertion method that contains a numeric literal as an argument,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Magic Number Test,,"This smell occurs when a test method contains unexplained and undocumented numeric literals as parameters or as values to identifiers. These magic values do not sufficiently indicate the meaning/purpose of the number. Hence, they hinder code understandability. Consequently, they should be replaced with constants or  variables, thereby providing a descriptive name for the value.",TRUE,FALSE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Magic values,,"magic values are literals that are not defined as constants or as part of templates. Numeric literals are called Magic Numbers, string literals are called Magic Strings",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Magic Values,,"Magic Values are literals not defined as constant. Numeric literals are called Magic Numbers, string literals are called Magic Strings.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Magic Values,,A literal is not defined as a TTCN-3 constant,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Making a mockery of design,,where pure functions have to be dependency injected so they can be mocked.,FALSE,FALSE,FALSE,FALSE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Anti-pattern,Manual Assertions,,Manual assertions describes the scenarios where the JUnit assert or fail methods are ignored in favour of other methods confirming program accuracy.,FALSE,FALSE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Manual Event Injection,,"During the execution of the test, a manual action must be performed so that the test can proceed",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Manual Event Injection,,A person must intervene during test execution to perform some manual action before the test can proceed.,FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Manual Fixture Setup,,"In advance of running the test, a manual setup of the test environment must be done",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Manual Fixture Setup,,"A person has to set up the test environment manually before the automated tests can be run. This may take the form of configuring servers, starting server processes or running scripts to set up a Prebuilt Fixture",FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Manual Intervention,"Interactive Test, Manual Testing, Manual Test",The test requires a manual action by the developer.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Manual intervention,,"A test case requires manual changes before the test is run, otherwise the test fails",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Manual Intervention,,A test requires a person to perform some manual action each time it is run.,FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Manual Result Verification,,"The results are manually verified and therefore, the tests even pass if the production code returns wrong results",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Manual Result Verification,,We can run the tests but they almost always pass even when we know that the SUT is not returning the correct results.,FALSE,TRUE,FALSE,TRUE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Many Assertions,,When a test tests way too much its failure is often hard to track down.,FALSE,FALSE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Martini Assertion,,"where we look for the desired outcome anytime, any place, anywhere – often caused by Celery Data and in some ways the opposite of the Equality Sledgehammer. Rather than look at a specific field to see if it’s right, we look for some data in the WHOLE output.",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Max Instance Variables,,Large or oversized xture,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Max Instance Variables,,A test method that has a large fixture,FALSE,FALSE,FALSE,FALSE
https://www.youtube.com/watch?v=VBgySRk0VKY,A testing anti-pattern safari,webpage,Test Smell,Messy Test,,"Tests that contain repeated code, copy&paste, disorganized structure and literal values",TRUE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Middle Man,,A macro component delegates all its tasks to another macro component,FALSE,FALSE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Middle Man,,"A test component (keyword, macro, function) delegates all its tasks to another test component.",FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Middle Man,,"A test component (keyword, macro, function) delegates all its tasks to another test component.",FALSE,TRUE,TRUE,TRUE
https://idp.springer.com/authorize/casa?redirect_uri=https://link.springer.com/article/10.1007/s10664-021-10016-2&casa_token=8C-rVSu9l74AAAAA:2s5rmzBFiH74xHZlTdpZsQCxwqL4cYIbWRH6Bdq1ehTjnxcpOwi8PPkhDrhKpHqjdrQf1_ZXaVRy5BysSQ,"Rotten green tests in Java, Pharo and Python",paper,Test Smell,Missed fail rotten green test,,"Tests where the test engineer passes to an assertion primitive to force the test to fail. Such assertion calls are intended to be executed only if something goes wrong, and not if the test passes.",TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3377812.3382151,RTj: a Java framework for detecting and refactoring rotten green test cases,paper,Test Smell,Missed Fail Rotten Green Test,,"Tests that do not execute one or many assertions, and do not fall into any of the previous Rotten Green categories",TRUE,TRUE,TRUE,TRUE
https://idp.springer.com/authorize/casa?redirect_uri=https://link.springer.com/article/10.1007/s10664-021-10016-2&casa_token=8C-rVSu9l74AAAAA:2s5rmzBFiH74xHZlTdpZsQCxwqL4cYIbWRH6Bdq1ehTjnxcpOwi8PPkhDrhKpHqjdrQf1_ZXaVRy5BysSQ,"Rotten green tests in Java, Pharo and Python",paper,Test Smell,Missed skip rotten green test,,Test methods contain guards to stop their execution early under certain conditions.,TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Missing Assertion Message,,"There are several assertions of the same kind which either have identical assertion methods or lack an assertion message. Thus, if one assertion fails, it is impossible to determine which one it is.",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Missing Assertion Message,,"A test fails. Upon examining the output of the Test Runner, we cannot determine exactly which assertion had failed.",TRUE,TRUE,FALSE,TRUE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Missing Assertions,,"The subject includes behavior which is not asserted by the test, whether implicitly or explicitly.",TRUE,TRUE,FALSE,TRUE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Test Smell,Missing Assertions,,the test method consists of an empty block,TRUE,TRUE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Missing Assertions,,The test lacks any explicit assertions,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Missing Assertions,,The test lacks any explicit assertions,FALSE,TRUE,TRUE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Missing log,,"setverdict is used to set verdict inconc or fail, but without calling log",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Missing Log,,"setverdict is used with verdict inconc or fail, but without calling log. Inconclusive or unsuccessful test verdicts should be logged, because this helps discovering the reasons for the failure. However, this smell should be classified weak compared to other smells.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Missing Log,,setverdict sets the verdict inconc or fail without calling log.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Missing parameterised test,,when you did it the long way round because you didn’t bring in parameterisation,TRUE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Missing test data factory,,where every test has its own way of making the same test example data,TRUE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Missing variable definition,UR data flow anomaly,a variable or out parameter is read before its value has been defined,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Missing Variable Definition,UR data flow anomaly,A variable or out parameter is read before its value has been defined. Access to undefined variables might result in unpredictable behavior.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Missing Variable Definition,,A variable or out parameter is read before a value has been assigned,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Missing verdict,,a test case does not set a verdict.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Missing Verdict,,A test case does not set a verdict. Normally a test case should set a verdict before terminating.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Missing Verdict,,A test case does not set a verdict,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Mistaken identity,,where the name of a test gives a contrary opinion to the meaning of the test,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Mixed Selectors,,"The problem of mixing up all the methods of a test-class is that it is harder to allocate and differentiate accessors, xtures, utilities and test-methods. By putting each type of method into a different method category, especially strictly separating test-methods from other methods we get a better structure of the test-class. A better and cleaner structure helps in understanding the test-suite, the xtures and all the test-methods.",FALSE,TRUE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Mixed Selectors,,Violating common organizational testing conventions by mixing up testing and non-testing methods,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Mixed Selectors,,Violates test conventions by mixing up testing and non-testing methods,FALSE,FALSE,FALSE,FALSE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Anti-pattern,Mixing Production and Test Code,,"Unit testing code should not really be deployed to production environments. Therefore, when packaging the code ready for release, the testing code must be somehow excluded, which can be complex depending upon the naming conventions used",FALSE,FALSE,FALSE,TRUE
https://github.com/mockito/mockito/wiki/How-to-write-good-tests,How to write good tests,webpage,Anti-pattern,Mock everything,,"If everything is mocked, are we really testing the production code? Don't hesitate to not mock!",FALSE,FALSE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Mock Happy,"Mock-Overkill, The Mockery","If one uses too many mock objects that interact with each other, the test will only test the interaction between them instead of the functionality of the production code.",FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Mock Happy,,"A test that needs many mocks to run. As a result, such a test would be quite fragile, resistant to change, and hard to understand.",FALSE,FALSE,FALSE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Mock Happy,,"A test that needs 17 mocks to run can be quite fragile, resistant to change, and hard to understand.",FALSE,FALSE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpaAllest Smell,Mock madness,,"where even near-primitive values like POJOs are being mocked, just because.",FALSE,FALSE,FALSE,FALSE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Mock’em All!,,"When a test overuse all kinds of test double, even when it is not really the best option",TRUE,TRUE,FALSE,TRUE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Mockers Without Borders,,Tests demonstrate little rhyme or reason for whether a given test ought to fake a particular dependency or call through to the real thing.,TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3379597.3387471,Did You Remember To Test Your Tokens?,paper,Test Smell,Mocking a Mocking Framework,,Occurrs when the test case tests the applied mocking framework,FALSE,FALSE,FALSE,FALSE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,Mocking What You Don'T Own,,avoid leakage of libraries into your software (runtime or external); there are alternatives like wrappers and mock servers,FALSE,FALSE,FALSE,FALSE
https://github.com/mockito/mockito/wiki/How-to-write-good-tests,How to write good tests,webpage,Anti-pattern,Mocking What You Don'T Own,,"When mocking an external API the test cannot be used to drive the design, the API belongs to someone else ; this third party can and will change the signature and behaviour of the API.",FALSE,FALSE,FALSE,TRUE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Mockito Any vs Isa,,Misuse of mockito’s matchers classes to type checks,TRUE,TRUE,FALSE,TRUE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Test Smell,Multiple Assertions,,"When a test method contains multiple assertion statements, it is an indication that the method is testing too much",TRUE,TRUE,FALSE,TRUE
https://techbeacon.com/app-dev-testing/7-ways-tidy-your-test-code,Writing good gherkin,webpage,Test Smell,Multiple points of failure,,"Adding assertions within your framework code is a code smell. It is not this code's responsibility to determine the fate of a test. By doing so, it limits the reusability of the framework code for both negative and positive scenarios.",FALSE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Multiple Test Conditions,,A test is trying to apply the same test logic to many sets of input values each with their own corresponding expected result.,TRUE,TRUE,FALSE,TRUE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Multiple tests testing the same or similar things,,"Multiple tests are created that have the same test code, but change the values passed",FALSE,FALSE,FALSE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Mystery Guest,,"This smell occurs when the test uses an external resource, such as a file with test data. If the external file is removed, the test results may fail;",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Mystery Guest,,"A test uses external resources (e.g., file containing test data)",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/2970276.2970340,An empirical investigation into the nature of test smells,article,Test Smell,Mystery Guest,,"This smell arises when a test uses external resources (e.g., a file containing test data), and thus it is not self-contained [42]. Tests containing such a smell are difficult to comprehend and maintain, due to the lack of information to understand them.",FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,Mystery Guest,,A test case that uses external resources,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Mystery Guest,,"A test uses external resources (e.g., file containing test data)",FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Mystery Guest,,A test method containing object instances of files and databases classes,FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Mystery Guest,,"A test uses external resources (e.g., file containing test data)",FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1109/MSR.2019.00072,Assessing diffusion and perception of test smells in scala projects,paper,Test Smell,Mystery Guest,,"A test case that uses external resources that are not managed by a fixture. A drawback of this approach is that the interface to external resources might change over time necessitating an update of the test case, or that those resources might not be available when the test case is run, endangering the deterministic behavior of the test.",TRUE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Mystery Guest,External Data,The test relies on information (from external resources) that are not visible from within the test. This introduces hidden dependencies and the test reader has  difficulties to understand the verified behaviour,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/4021983,Detecting redundant unit tests for AspectJ programs,paper,Test Smell,Mystery Guest,,The user is not able to see the cause and effect between fixture and verification logic because part of it is done outside the test method,FALSE,FALSE,FALSE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Mystery Guest,,"Consumption of external resources by a test such as, using a file which contains test data.",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Mystery Guest,,When a test method uses and depends on external resources,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Mystery Guest,,"A test that uses external resources (e.g., file containing test data)",FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Mystery Guest,,A test method that uses external resources that may cause stability or performance issues,FALSE,FALSE,TRUE,FALSE
https://thoughtbot.com/blog/lets-not,Let’s not,webpage,Test Smell,Mystery Guest,,The test reader is not able to see the cause and effect between fixture and verification logic because part of it is done outside the Test Method.,TRUE,TRUE,FALSE,TRUE
https://thoughtbot.com/blog/mystery-guest,Mystery Guest,webpage,Test Smell,Mystery Guest,,The test reader is not able to see the cause and effect between fixture and verification logic because part of it is done outside the Test Method.,TRUE,TRUE,FALSE,TRUE
http://xunitpatterns.com/Obscure%20Test.html,Obscure Test,webpage,Test Smell,Mystery Guest,,The test reader is not able to see the cause and effect between fixture and verification logic because part of it is done outside the Test Method.,TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/2897010.2897016,On the diffusion of test smells in automatically generated test code: an empirical study,paper,Test Smell,Mystery Guest,,"This smell arises when a test uses external resources (e.g., le containing test data), and thus it is not self contained [50]. Tests containing such smell are diffcult to comprehend and maintain, due to the lack of information to understand them.",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Mystery Guest,,A test method containing object instances of files and databases classes,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Mystery Guest,,Occurs when a test method utilizes external resources (such as a file or database).,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Mystery Guest,,"Occurs when a test method uses external resources (e.g., a file containing test data), and, thus, it is not self-contained. Hence, if this resource is changed, the tests can fail;",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Mystery Guest,,"When a test uses external resources, such as a file containing test data, the test is no longer self contained. Consequently, there is not enough information to understand the tested functionality, making it hard to use that test as documentation.",FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8529832,On the Relation of Test Smells to Software Code Quality,paper,Test Smell,Mystery Guest,,"A test that uses external resources (e.g., file containing test data)",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Mystery Guest,,A test method containing object instances of files and databases classes.,FALSE,TRUE,TRUE,FALSE
https://thoughtbot.com/upcase/videos/testing-antipatterns,Rails Testing Antipatterns,webpage,Test Smell,Mystery Guest,,"An object defined outside your test case that is used within the test case. Mystery guests are similar to magic numbers in that they appear in our code, are clearly important, but their source and or meaning are not clear.",FALSE,FALSE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Mystery Guest,,"When a test uses external resources, such as a file containing test data, the test is no longer self contained",FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9240691,"Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities",paper,Test Smell,Mystery Guest,,"Test case that accesses external resources such as files and databases, so that it is no longer self-contained.",FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121219301487?casa_token=UT0EMFzxTcQAAAAA:L9J82_15tdySkabcIMSHKPx8rVkrltOzcwgme5cIBWgT0txJENY5y-BdUmCYUoGHnoEjZJH-cYc,Scented since the beginning: On the diffuseness of test smells in automatically generated test code,article,Test Smell,Mystery Guest,,"This smell arises when a test uses exter- nal resources ( e.g., file containing test data), and thus it is not self contained",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3337932.3338815,SoCRATES: Scala radar for test smells,paper,Test Smell,Mystery Guest,,"A test case that uses external resources that are not managed by a fixture. A drawback of this approach is that the interface to external resources might change over time necessitating an update of the test case, or that those resources might not be available when the test case is run, endangering the deterministic behaviour of the test.",FALSE,FALSE,FALSE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Mystery Guest,,"Occurs when a test method utilizes external resources (e.g. files, database, etc.). Use of external resources in test methods will result in stability and performance issues. Developers should use mock objects in place of external resources.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Mystery Guest,,"A test that uses external resources, such as a database, that contains test data",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Mystery Guest,,Use of external resources in test commands.,FALSE,FALSE,FALSE,FALSE
https://search.proquest.com/openview/c52d821a4dd6ecb046957d9d6a532ae0/1?pq-origsite=gscholar&cbl=326341,The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems,article,Test Smell,Mystery Guest,,"A test that use external resources (e.g., files or databases).",FALSE,FALSE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Mystery Guest,,"Test code that uses external resources. Tests containing such a smell are difficult to comprehend and maintain, due to the lack of information to understand them",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3472674.3473981,Toward static test flakiness prediction: a feasibility study,paper,Test Smell,Mystery Guest,,"When a test method utilizes external resources (e.g. files, database, etc.).",FALSE,FALSE,TRUE,FALSE
https://dibt.unimol.it/staff/fpalomba/documents/C14.pdf,Towards Automated Tools for Detecting Test Smells: An Empirical Investigation into the Nature of Test Smells,technical paper/manuscript,Test Smell,Mystery Guest,,"occurs when a test case is using an external resource such as a file or database (thus, making the test non self-contained)",FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Mystery Guest,,A test method containing object instances of files and databases classes,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Mystery Guest,,Occurs when a test method utilizes external resources (such as a file or database).,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Mystery guest,,The reader is not able to see the cause and effect between fixture and verification logic because part of it is done outside the test method.,FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121221000364,Why do builds fail?—A conceptual replication study,article,Test Smell,Mystery Guest,,"JUnit classes that use an external resource (e.g., a file or database).",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Name-clashing Import,,An imported element causes a name clash with a declaration in the importing module or another imported element.,TRUE,TRUE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Narcissistic,,The test uses the first person pronoun “I” to refer to its actors and does not uniquely qualify those actors,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Narcissistic,,The test uses the first person pronoun “I” to refer to its actors and does not uniquely qualify those actors,FALSE,TRUE,TRUE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Nested conditional,,a conditional expression is unnecessarily nested.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Nested Conditional,,"Nested conditional expression. Use if and else leg of a conditional only if both paths are part of the normal behavior; if one leg is an unusual condition, use a separate exit point (guard clause) instead.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Nested Conditional,,A conditional expression is unnecessarily nested.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Neverfail Test,,"We may just ""know"" that some piece of functionality is not working but the tests for that functionality are passing nonetheless. When doing test-driven development we have added a test for functionality we have not yet written but we cannot get it to fail.",FALSE,TRUE,FALSE,TRUE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,No Assertions,,Tests that have no assertions and require the manual verification of log outputs,TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,No Assertions,"Lying Test, Assertionless Test, The Line Hitter",The test does not contain any assertions and does nothing else than to execute the production code and raising the code coverage.,FALSE,FALSE,TRUE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,No Assertions,,A test that has no assertions only exists to lie about code coverage.,FALSE,FALSE,FALSE,TRUE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,No clear structure within the test,,"Having no consistent test structure, harming readability",FALSE,TRUE,FALSE,TRUE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,No structure when creating test cases,,Test code is also code and should have a structure to it so that it can be easily read and altered if needed. Not having a structure to test code makes it hard to understand and maintain. A simple structure is to organize the code into the different stages of the testing process.,FALSE,FALSE,FALSE,FALSE
https://www.codementor.io/@mgawinecki/anti-patterns-in-test-automation-101c6vm5jz,Anti-patterns in test automation,webpage,Anti-pattern,No traces left,,"Tests that, despite failing, do not produce any logs or indications of what went wrong",FALSE,FALSE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Noisy Logging,,The test logs the state of the fixtures,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Noisy Logging,,The test logs the state of the fixtures,FALSE,TRUE,TRUE,TRUE
https://semaphoreci.com/blog/2014/01/14/rails-testing-antipatterns-fixtures-and-factories.html,Rails Testing Antipatterns: Fixtures and Factories,webpage,Test Smell,Noisy setup,,When a verbose sequence of low-level records that is difficult to comprehend is displayed in the setup,TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Nondeterministic Test,,The test fails at random even if only one Test Runner is being used.,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Nondeterministic Test,,Test failures occur at random even when only a single Test Runner is running tests.,TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Not Idempotent,Interacting Test With High Dependency,The test alters the states of parts of the environment forever.,FALSE,FALSE,TRUE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Not Idempotent,,Fancy words meaning your test changes the state of something permanently and thereby introduces the possibility of order dependent tests.,FALSE,FALSE,FALSE,TRUE
https://alisterbscott.com/2015/01/20/five-automated-acceptance-test-anti-patterns/,Five automated acceptance test anti-patterns,webpage,Test Smell,Not using page-objects,,"Page objects are just a design pattern to ensure automated UI tests use reusable, modular code. Not using them, eg, writing WebDriver code directly in step definitions, means any changes to your UI will require updates in lots of different places instead of the one ‘page’ class.",TRUE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6569744,Automated Detection of Test Fixture Strategies and Smells,paper,Test Smell,Obscure In-Line Setup,,An in-line setup should consist of only the steps and values essential to understanding the test. Essential but irrelevant steps should be encapsulated into helper methods. An obscure in-line setup covers too much setup functionality within the test method. This can hinder developers in seeing the relevant verification steps of the test.,FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Obscure In-Line Setup,,Occurs when the test case contains too many setup steps,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/6624053,Strategies for avoiding text fixture smells during software evolution,paper,Test Smell,Obscure In-Line Setup,,"An in-line setup should consist of only the steps and variables essential to understanding the test; necessary but irrelevant steps should be encapsulated into helper methods. An obscure in-line setup covers too much setup functionality within the test method, and this can prevent one from seeing the test’s relevant verification steps.",FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Obscure In-line Setup,,A test that has too much setup functionality in the test method,FALSE,FALSE,FALSE,FALSE
https://www2.swc.rwth-aachen.de/docs/teaching/seminar2016/FsSE%20CTRelEng%202016.pdf#page=23,An analysis of information needs to detect test smells,paper,Test Smell,Obscure Test,,Obscure Test is caused when a test is difficult to understand at a glance and thus is not suitable for documentation purposes.,FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/4021983,Detecting redundant unit tests for AspectJ programs,paper,Test Smell,Obscure Test,,Obscure Test is caused when a test is difficult to understand at a glance and thus is not suitable for documentation purposes.,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3379597.3387471,Did You Remember To Test Your Tokens?,paper,Test Smell,Obscure Test,,"This smell describes difficulties with test comprehension. It commonly stems from an “eager"" implementation, where the test verifies too much functionality. For example, instead of providing dedicated test cases, the developers decided to combine similar behaviors (“piggyback”) into one long (“the giant”) test case. This results in higher maintenance costs, difficulties in understanding the test, and precludes achieving the goal to use tests as documentation. It also may hide many more errors, because during test execution, the first failed assertion aborts the test case.",FALSE,TRUE,FALSE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Obscure Test,"Long Test, Complex Test, Verbose Test",It is a trouble understanding what behivor a test is verifying.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Obscure test,,A test case is difficult to understand at a first reading.,FALSE,FALSE,TRUE,FALSE
http://xunitpatterns.com/Obscure%20Test.html,Obscure Test,webpage,Test Smell,Obscure Test,"Long Test, Complex Test, Verbose Test","It is difficult to understand the test at a glance. Automated tests should serve at least two purposes. First, they should act as documentation of how the system under test (SUT) should behave; we call this Tests as Documentation (see Goals of Test Automation on page X). Second, they should be a self-verifying executable specification. These two goals are often contradictory because the level of detailed needed for tests to be executable may make the test so verbose as to be difficult to understand.",TRUE,TRUE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Obscure Test,,"The test behavior is difficult to understand because the test does not clearly state what it is verifying. Typical symptoms are hardcoded values, high cyclomatic complexity and/or function or procedure calls with high number of parameters",FALSE,TRUE,TRUE,TRUE
https://thoughtbot.com/upcase/videos/testing-antipatterns,Rails Testing Antipatterns,webpage,Test Smell,Obscure Test,,Where it is hard to figure out exactly what is being tested,TRUE,FALSE,FALSE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Obscure Test,,"The test behavior is difficult to understand because the test does not clearly state what it is verifying. Typical symptoms are hardcoded values, high cyclomatic complexity and/or function or procedure calls with high number of parameters",FALSE,TRUE,TRUE,TRUE
https://ieeexplore.ieee.org/abstract/document/6862882/,Test code quality and its relation to issue handling performance,article,Test Smell,Obscure Test,,The test is hard to understand,FALSE,TRUE,FALSE,FALSE
https://www.codewithjason.com/test-smell-obscure-test/,Test smell: Obscure Test,webpage,Test Smell,Obscure Test,,"A test that has a lot of noise in it, noise that’s making it hard to discern what the test is actually doing.",TRUE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Obscure Test,,"A common cause of false negative test results (tests that passed when they shouldn't have) is that we have Obscure Tests which are hard to get right especially when we are modifying existing tests that were broken by a change we made. Since automated tests are hard to test, we don't often verify that a modified test still catches all the bugs it was initially designed to trap. As long as we get a green bar we think we are ""good to go"" but we may have created a test that never fails.",FALSE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Obscure Test,,"Obscure Tests (page X) are a major contributor to High Test Maintenance Costs because they take longer to understand each time they are visited. When they do need to be modified, they take more effort to adjust and are much less likely to ""work the first time"" resulting in more debugging of tests. They are also more likely to end up not catching conditions they were intended to and that can lead to Buggy Tests (page X).",FALSE,TRUE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,On the Fly,,The test calculates an expected results during its execution instead of relying on pre-computed values,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,On the Fly,,The test calculates an expected results during its execution instead of relying on pre-computed values,FALSE,TRUE,TRUE,TRUE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Anti-pattern,Only Easy Tests,,"Similar to happy path tests, easy tests concentrate on things that are easy to verify, such as simple property values. However, the real logic of the unit under test is ignored. This is a symptom of an inexperienced developer trying to test complex code.",FALSE,TRUE,FALSE,TRUE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Anti-pattern,Only Happy Path Tests,,"Only the expected behaviour of the system is tested. Valid input data is fed into the system, and the results are checked against the expected correct answer. What is missing in this case is the exceptional conditions.",FALSE,TRUE,FALSE,TRUE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,Optimizing DRY,,Pursuing DRYness by creating variables and functions in tests;,FALSE,TRUE,FALSE,TRUE
https://www.youtube.com/watch?v=VBgySRk0VKY,A testing anti-pattern safari,webpage,Test Smell,Order Dependent Tests,,The tests have to be executed in a certain order due to dependencies between them.,TRUE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Order Dependent Tests,"Chained Tests, Chain Gang",The tests have to be executed in a certain order due to dependencies between them.,FALSE,FALSE,TRUE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Order Dependent Tests,,Tests that need other tests to run before them really screw things up when things get moved around.,FALSE,FALSE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Over exertion assertion,,"where the implementation of an assertion is heavy and in the body of the test, rather than in an assertion library",TRUE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Over refactoring of tests,,where you can’t read them because they’ve been DRYed out to death,TRUE,FALSE,FALSE,FALSE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Over-Checking,,The test performs some assertions that are not relevant for its scope.,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Over-Checking,,The test performs some assertions that are not relevant for its scope.,FALSE,TRUE,TRUE,TRUE
https://www.techwell.com/techwell-insights/2015/09/test-design-automation-anti-patterns,Test design for automation: Anti-patterns,webpage,Test Smell,Over-Checking,,The test performs some assertions that are not relevant for its scope.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Over-eager Helper,,"where there’s a helper method that probes the system and then performs an assertion, rather than return its result for the caller to assert.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Over-specific runs on,,"A behavioural entity (function, test case, or altstep) is declared to run on a component, but uses only elements of this component’s super-component or no elements of the component at all",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Over-specific Runs On,,"A behavioral entity (function, test case or altstep) is declared to run on a component, but uses only elements of this component’s super-component or no elements of the component at all.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Over-specific Runs On,,A behavioural entity runs on a component but uses only elements of the super-component or no component elements at all.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Overcommented Test,,"Overcommented Tests dene too many comments, obfuscating the code and distracting from the purpose of the test.",TRUE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Overcommented Test,,"Since tests are a documentation themselves, comments in the test code are superfluous. Moreover, the understandability of the code can be afflicted by it if there are too many comments.",FALSE,FALSE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Overcommented Test,,Test having too many comments,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Overcommented Test,,A test with numerous comments.,FALSE,FALSE,FALSE,FALSE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Anti-pattern,Overly Complex Tests,,"Unit tests, like production code, should be easily understandable. In general, a programmer must understand the intent of an individual test as fast as possible. If a test is so complicated that you can’t immediately tell if it is correct or not, it makes it very difficult to determine if the cause of a test failure is bad production code or bad test code. Even worse, this allows the possibly of code that incorrectly passes a test.",FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Overly Dry Tests,,Making the DRY principle the top priority can lead to a hardly understandable test code.,FALSE,FALSE,TRUE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Overly Dry Tests,,"DRY (Don't Repeat Yourself) is a good idea, but pulling out all repetition can lead to some very hard to understand tests.",FALSE,FALSE,FALSE,TRUE
https://news.ycombinator.com/item?id=16895784,Hacker News on: Software Testing Anti-patterns,webpage,Anti-pattern,Overly elaborate test code,,"When the test code duplicates the same logic as the code under test, logic which turns out to be incorrect.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Overmocking,,where tests are testing situations that are guaranteed to pass as they’re whitebox tested against perfect mocks that do not indicate anything to do with reality.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Overreferencing,,It is about test-methods referencing many times classes from the application code. The main problem with an Overreferencing Test is that it causes a lot of unnecessary dependencies towards the model code. That distracts from the goal of the test.,TRUE,TRUE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Overreferencing,,Test creating unnecessary dependencies and causing duplication,TRUE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Overreferencing,,A test that causes duplication by creating unnecessary dependencies,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Oversharing on setup,,where every test sets up a lot of shared data which only some tests need,TRUE,FALSE,FALSE,FALSE
https://jasonrudolph.com/blog/testing-anti-patterns-how-to-fail-with-100-test-coverage/,Testing anti-patterns: How to fail with 100% test coverage,webpage,Test Smell,Overspecification,,Tests increasingly serve multiple roles in today’s projects. They help us design APIs through test-driven development. They provide confidence that new changes aren’t breaking existing functionality. They offer an executable specification of the application. But can we ever get to a point where we have too much testing?,TRUE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Overspecified Software,Overcoupled Test,"The test focuses on the structure and the expected behaviour of the software rather than on what it should accomplish. Therefore, the software must be designed in a specific way in order that the test can pass.",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Overspecified Software,Overcoupled Test,A test says too much about how the software should be structured or behave.,FALSE,TRUE,FALSE,TRUE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Overspecified Tests,,Tests that specify too many things that aren’t genuinely related to the scenario being tested.,TRUE,TRUE,FALSE,TRUE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Overuse of abstractions,it’s too DRY,Because test code is documentation it needs to be descriptive and easy to follow. Instead of DRY test code should be DAMP (Descriptive And Meaningful Phrases). Since the goal is to understand the test and the code you are testing some repetition may be necessary.,FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Paranoid,,"A test (and as a result, its subject) covers edge cases that aren't actually reachable by the production application.",TRUE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.159.6145&rep=rep1&type=pdf,Parameterized Test Patterns For Effective Testing with Pex,technical paper/manuscript,Test Smell,Parsed Data,,A test creates structured data by parsing unstructured input and only uses the structured data during the test.,TRUE,TRUE,FALSE,TRUE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Piggybacking on existing tests,,On the other extreme from multiple tests is piggybacking or adding assertions to existing tests to test a distinct or new feature. The more of these you add the less descriptive your test becomes.,FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Plate Spinning,,A test that is at risk of exiting prematurely because it does not properly wait for the results of external calls.,TRUE,FALSE,FALSE,TRUE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Premature Assertions,,"Intermingled with a test's set-up of the data and objects it depends on are assertions which attempt to ensure that set-up was successful. The net effect of this often resembles a ""Arrange-Assert-Act-Assert"" pattern.",TRUE,TRUE,FALSE,TRUE
https://www.youtube.com/watch?v=3Fa69eQ6XgM,Developer test anti-patterns by lasse koskela,webpage,Test Smell,Primitive Assertion,,Assertions that use primitive content to express intent,TRUE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Print Statement,,Occurs when unit tests contain print statements,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Print Statement,,"Print statements in unit tests are redundant as unit tests are executed as part of an automated script and do not affect the failing or passing of test cases. Furthermore, they can increase execution time if the developer calls a long-running method from within the print method (i.e., as a parameter).",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Production Logic in Test,,Some forms of Conditional Test Logic are found in the result verification section of our tests.,TRUE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Proper Organization,,Violating testing conventions by using bad organization of methods,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Proper Organization,,Bad organization of methods,FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Quixotic,,"A test that charts an idealistic path through the subject code, cherry-picking inputs that provide minimum resistance (e.g. in test data setup), which may result in missed test coverage in code that handle negative cases. Notably, this is more likely to occur when those negative cases are also somehow complex, which is precisely when good testing is important!",TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Redundant Assertion,,A test method that contains an assertion statement in which the expected and actual parameters are the same,FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Redundant Assertion,,An extra call to an assert method is made for a condition that is hard coded true.,FALSE,FALSE,TRUE,FALSE
https://arxiv.org/abs/2107.13902,Developers perception on the severity of test smells: an empirical study,technical paper/manuscript,Test Smell,Redundant Assertion,,When the test methods contain assertion statements that are always true or always false,FALSE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Redundant Assertion,,Test method with checks that always have the same response,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Redundant Assertion,,"A test method contains assertions that are either always true or always false, making them useless",FALSE,FALSE,TRUE,FALSE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Test Smell,Redundant Assertion,,extra calls to an assert method where the condition being tested is a hard coded true value.,TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Redundant Assertion,,A test method that contains an assertion statement in which the expected and actual parameters are the same,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Redundant Assertion,,"This smell occurs when test methods contain assertion statements that are either always true or always false. A test is intended to return a binary outcome of whether the intended result is correct or not, and should not return the same output regardless of the input.",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Redundant Assertion,,Occurs when test methods contain assertion statements that are either always true or always false.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Redundant Assertion,,A test method that contains an assertion statement in which the expected and actual parameters are the same.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Redundant Assertion,,"Occurs when a test case contains assertion statements that are either always true or always false, and are therefore unnecessary",FALSE,TRUE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Redundant Assertion,,This smell occurs when test methods contain assertion statements that are either always true or always false. This smell is introduced by developers for debugging purposes and then forgotten.,TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Redundant Assertion,,A test method that has an assertion statement that is permanently true or false,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Redundant Assertion,,A test case may contain assertion statements that are either always true or always false.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Redundant Assertion,,A test method that contains an assertion statement in which the expected and actual parameters are the same,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Redundant Assertion,,"This smell occurs when test methods contain assertion statements that are either always true or always false. A test is intended to return a binary outcome of whether the intended result is correct or not, and should not return the same output regardless of the input.",TRUE,FALSE,TRUE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Redundant Print,,Occurs when test methods contain irrelevant print statements;,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Redundant Print,,A test method that invokes either the print or println or printf or write method of the System class,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Redundant Print,,Test method containing screen print statements,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Redundant Print,,"A test method with print statements, but test cases are executed with little or no human intervention",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Redundant Print,,A test method that invokes either the print or println or printf or write method of the System class,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Redundant Print,,"Print statements in unit tests are redundant as unit tests are executed as part of an automated. Furthermore, they can consume computing resources or increase execution time if the developer calls an intensive/long-running method from within the print method (i.e., as a parameter).",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Redundant Print,,A test method that invokes either the print or println or printf or write method of the System class.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Redundant Print,,Occurs when there is a print statement within the test,FALSE,TRUE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Redundant Print,,Print statements in unit tests are redundant as unit tests are executed as part of an automated process with little to no human intervention. Print statements are possibly used by developers for traceability and debugging purposes and then forgotten.,TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Redundant Print,,A test method that has print statement,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Redundant Print,,A test method that invokes either the print or println or printf or write method of the System class,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Redundant Print,,"Print statements in unit tests are redundant as unit tests are executed as part of an automated. Furthermore, they can consume computing resources or increase execution time if the developer calls an intensive/long-running method from within the print method (i.e., as a parameter).",TRUE,FALSE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Refused Bequest,,The excessive setup is only needed by some tests in its entirety. The other tests either use it partially or do not use it at all.,FALSE,FALSE,TRUE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Refused Bequest,,"A mega setup that some tests ignore, some use, and most rely on but only for a few lines. When any individual test fails it's hard to parse the setup to see what's going on.",FALSE,FALSE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Reinventing the Wheel,,"While Cut and Paste Code Reuse deliberately makes copies of existing code to reduce the effort of writing tests, it is also possible to accidently write the same sequence of statements in different tests.",FALSE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Remote Control Mocking,,"where a class that depends on a service is tested with those service’s complex dependencies mocked, rather than the service itself being mocked.",TRUE,FALSE,FALSE,FALSE
https://www.youtube.com/watch?v=VBgySRk0VKY,A testing anti-pattern safari,webpage,Test Smell,Require External Resources,,Test require external resources but can not guarantee their state and availability,TRUE,TRUE,FALSE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Requires Supervision,,A test is not automatic -- it needs user input to function. Someone has to watch the test and enter data periodically.,FALSE,FALSE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Resource Leakage,,"The test uses finite resources. If the tests do not release them in the end, all of the resources are allocated and tests which need the resources begin to fail with time.",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Resource Leakage,,Tests or the SUT are consuming finite resources,FALSE,TRUE,FALSE,TRUE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Resource Optimism,,"It occurs when the test code contains optimist assumptions about the presence or absence of external resources. The test may return a positive result once, but it may fail for the next times",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Resource Optimism,,A test makes assumptions about the state/existence of external resources,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Resource Optimism,,A test makes assumptions about the state/existence of external resources,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Resource Optimism,,"A test method utilizes an instance of a File class without calling the method exists(), isFile() or notExists() methods of the object",FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Resource Optimism,,A test makes assumptions about the state/existence of external resources,FALSE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Resource Optimism,,The test shows nondeterministic behaviour depending on the place and time it is run since it optimistically speculates on the state and presence or absence of external resources.,FALSE,FALSE,TRUE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Resource Optimism,,"Positive assumptions made by tests about external resources can cause unpredictable test outcomes, may fail or run well.",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Resource Optimism,,Test method that optimistically assumes the state of an external resource as available,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Resource Optimism,,A test that makes optimistic assumptions about the state/existence of external resources,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Resource Optimism,,"A test method assumes that a resource, such as a File, exists",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/2897010.2897016,On the diffusion of test smells in automatically generated test code: an empirical study,paper,Test Smell,Resource Optimism,,"Tests affected by such smell make assumptions about the state or the existence of external resources, providing a non-deterministic result that depends on the state of the resources.",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Resource Optimism,,"A test method utilizes an instance of a File class without calling the method exists(), isFile() or notExists() methods of the object",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Resource Optimism,,"Occurs when a test method makes an optimistic assumption that the external resource (e.g., File), utilized by the test method, exists.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Resource Optimism,,This smell refers to a test method that makes optimistic assumptions about the existence and the state of external resources can cause non-deterministic behavior in a test result;,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Resource Optimism,,Test code that makes optimistic assumptions about the existence (or absence) and state of external resources (such as particular directories or database tables) can cause non-deterministic behavior in test outcomes. Situations where tests run fine at one time and fail miserably the next time are not where you want to find yourself in.,FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8529832,On the Relation of Test Smells to Software Code Quality,paper,Test Smell,Resource Optimism,,A test that makes optimistic assumptions about the state/existence of external resources,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Resource Optimism,,"A test method that utilizes an instance of a File class without calling the exists(), isFile() or notExists() methods of the object.",FALSE,TRUE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Resource Optimism,,Test code that makes optimistic assumptions about the existence (or absence) and state of external resources (such as particular directories or database tables) can cause non-deterministic behavior in test outcomes,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3425174.3425212,Refactoring Test Smells: A Perspective from Open-Source Developers,paper,Test Smell,Resource Optimism,,This smell happens when test methods make optimistic assumptions about the existence or the state of external resources like files and databases.,TRUE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9240691,"Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities",paper,Test Smell,Resource Optimism,,A test that makes optimistic assumptions about the state/existence of external resources,FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121219301487?casa_token=UT0EMFzxTcQAAAAA:L9J82_15tdySkabcIMSHKPx8rVkrltOzcwgme5cIBWgT0txJENY5y-BdUmCYUoGHnoEjZJH-cYc,Scented since the beginning: On the diffuseness of test smells in automatically generated test code,article,Test Smell,Resource Optimism,,"Tests affected by such smell make as- sumptions about the state or the existence of external resources, providing a non-deterministic result that depends on the state of the resources",FALSE,FALSE,FALSE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Resource Optimism,,"This smell occurs when a test method makes an optimistic assumption that the external resource (e.g., File), utilized by the test method, exists.",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Resource Optimism,,A test that make an assumption about the existence of external resources,FALSE,FALSE,FALSE,FALSE
https://search.proquest.com/openview/c52d821a4dd6ecb046957d9d6a532ae0/1?pq-origsite=gscholar&cbl=326341,The Relation of Test-Related Factors to Software Quality: A Case Study on Apache Systems,article,Test Smell,Resource Optimism,,A test that make optimistic assumptions on the existence of external resources.,FALSE,FALSE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Resource Optimism,,"A test case that makes optimistic assumptions about the state/existence of external resources, which may cause flaky test results.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3472674.3473981,Toward static test flakiness prediction: a feasibility study,paper,Test Smell,Resource Optimism,,"When a test method makes an optimistic assumption that the external resource (e.g., File), utilized by the test method, exists.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Resource Optimism,,"A test method utilizes an instance of a File class without calling the method exists(), isFile() or notExists() methods of the object",FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Resource Optimism,,"Occurs when a test method makes an optimistic assumption that the external resource (e.g., File), utilized by the test method, exists.",FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Resource Optimism,,A test that depends on external resources has non-deterministic results depending on when/where it is run.,FALSE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Returning Assertion,,Assertions returning a value (unusual for unit tests),FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Returning Assertion,,A test method that has an assertion and returns a value.,FALSE,FALSE,FALSE,FALSE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Rewriting private methods as public,,This anti-pattern arises when a developer is trying to increase code coverage but is not able to test all of the private methods in a class,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/9678529/,JTDog: a Gradle Plugin for Dynamic Test Smell Detection,paper,Test Smell,Rotten green test,,A passed test that contains unexecuted assertions,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3377812.3382151,RTj: a Java framework for detecting and refactoring rotten green test cases,paper,Test Smell,Rotten Green Test,,A test that passes (is green) but contains assertions that are never executed,TRUE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Rotten Green Test,,Occurs when intended assertions in a test are never executed.,FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Second Class Citizens,,"Test code isn’t as well refactored/structured as production code, containing a lot of duplicated code, making it hard to maintain tests.",FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Second Class Citizens,,"The test code isn’t as well refactored as production code, containing a lot of duplicated code, making it hard to maintain tests",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Second Class Citizens,,"Test code isn't as well refactored as production code, containing a lot of duplicated code, making it hard to maintain tests.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Second guess the calculation,,"where rather than using concrete test data, we use something that needs us to calculate the correct answer ahead of assertion",TRUE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Self Important Test Data,,Test data is more complex than is needed to exercise some behavior in a test.,TRUE,TRUE,FALSE,TRUE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Self-Test,,"Tests that do not compare a result with an expected value, but with the result itself",TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Sensitive Equality,,The toString method is used in assert statements,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/2970276.2970340,An empirical investigation into the nature of test smells,article,Test Smell,Sensitive Equality,,"When an assertion contains an equality check through the use of the toString method, the test is a↵ected by a Sensitive Equality smell. In this case, the failure of a  test case can depend on the details of the string used in the comparison, e.g., commas, quotes, spaces etc.",FALSE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/7890581,An Empirical Study into the Relationship Between Class Features and Test Smells,paper,Test Smell,Sensitive Equality,,The toString method is used in assert statements,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Sensitive Equality,,The toString method is used in assert statements,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Sensitive Equality,,A test method invokes the toString() method of an object,FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Sensitive Equality,,The toString method is used in assert statements,FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1109/MSR.2019.00072,Assessing diffusion and perception of test smells in scala projects,paper,Test Smell,Sensitive Equality,,"A test case with an assertion that compares the state of objects by means of their textual representation, i.e., by means of the result of toString().",TRUE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Sensitive Equality,The Butterfly,"Equality checks depend on toString method, which relies on minor details like commas or quotes. Therefore, any change to the toString method can result in a failure of the test.",FALSE,FALSE,TRUE,FALSE
https://arxiv.org/abs/2107.13902,Developers perception on the severity of test smells: an empirical study,technical paper/manuscript,Test Smell,Sensitive Equality,,It occurs when the test method makes an equality checking using the toString method,FALSE,FALSE,TRUE,TRUE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Sensitive Equality,,"Upon computation of an actual result, it is mapped to string and compared to a string literal, the result may vary as it depends on many irrelevant details (i.e.  commas, quotes, spaces, etc.)",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Sensitive Equality,,Use toString method in a test method to make validations,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/2897010.2897016,On the diffusion of test smells in automatically generated test code: an empirical study,paper,Test Smell,Sensitive Equality,,"When an assertion contains an equality checks through the use of the toString method, the test is affected by a Sensitive Equality smell. In this case, the failure of a test case can depend on the details of the string used in the comparison, e.g., commas, quotes, spaces etc",FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Sensitive Equality,,A test method invokes the toString() method of an object,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Sensitive Equality,,Occurs when the toString method is used within a test method.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Sensitive Equality,,"Occurs in test methods that contain an equality check using the method toString, which depends on details, such as commas and spaces. Thus, when the method for an object is changed, the test can fail;",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Sensitive Equality,,"It is fast and easy to write equality checks using the toString method. A typical way is to compute an actual result,map it to a string, which is then compared to a string literal representing the expected value. Such tests, howevermay depend on many irrelevant details such as commas, quotes, spaces, etc.Whenever the toString method for an object is changed, tests start failing.",FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8529832,On the Relation of Test Smells to Software Code Quality,paper,Test Smell,Sensitive Equality,,A test using the ‘toString’ method directly in assert statements,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Sensitive Equality,,A test method that invokes the toString() method of an object.,FALSE,TRUE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Sensitive Equality,,"It is fast and easy to write equality checks using the toString method. A typical way is to compute an actual result, map it to a string, which is then compared to a string literal representing the expected value. Such tests, however may depend on many irrelevant details such as commas, quotes, spaces, etc. Whenever the toString method for an object is changed, tests start failing",FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3425174.3425212,Refactoring Test Smells: A Perspective from Open-Source Developers,paper,Test Smell,Sensitive Equality,,"van Deursen et al. [18] state the agility and ease to write equality checks using the toString() method, being a frequent alternative to calculate a result value and map it to a sequence to compare to a literal string representing the expected value. However, these tests can depend on many irrelevant details, such as commas,  quotes, and spaces. And whenever the toString() method for an object is changed, all related tests will start to fail.",TRUE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9240691,"Revisiting Test Smells in Automatically Generated Tests: Limitations, Pitfalls, and Opportunities",paper,Test Smell,Sensitive Equality,,When an test checks for equality through the use of the toString method.,TRUE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121219301487?casa_token=UT0EMFzxTcQAAAAA:L9J82_15tdySkabcIMSHKPx8rVkrltOzcwgme5cIBWgT0txJENY5y-BdUmCYUoGHnoEjZJH-cYc,Scented since the beginning: On the diffuseness of test smells in automatically generated test code,article,Test Smell,Sensitive Equality,,"When an assertion contains an equality check through the use of the toString method, the test is affected by a Sensitive Equality smell. In this case, the failure of a test case can depend on the details of the string used in the comparison, e.g., commas, quotes, spaces etc.",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3337932.3338815,SoCRATES: Scala radar for test smells,paper,Test Smell,Sensitive Equality,,"A test case with an assertion that compares the state of objects by means of their textual representation, i.e., by means of the result of toString(). This makes the test vulnerable to small, and irrelevant details (e.g., spaces).",FALSE,FALSE,FALSE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Sensitive Equality,,Occurs when the toString method is used within a test method. Test methods verify objects by invoking the default toString() method of the object and comparing the output against an specific string. Changes to the implementation of toString() might result in failure. The correct approach is to implement a custom method within the object to perform this comparison.,TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Sensitive Equality,,Occurs when an assertion has an equality check by using the toString method.,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Sensitive Equality,,Verification by dumping an object's characteristics to string.,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Sensitive Equality,,A test using the toString method for equality check in assert statements. The test case is sensitive to the implementation of toString,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3472674.3473981,Toward static test flakiness prediction: a feasibility study,paper,Test Smell,Sensitive Equality,,When the toString method is used within a test method.,FALSE,FALSE,TRUE,FALSE
https://dibt.unimol.it/staff/fpalomba/documents/C14.pdf,Towards Automated Tools for Detecting Test Smells: An Empirical Investigation into the Nature of Test Smells,technical paper/manuscript,Test Smell,Sensitive Equality,,"When an assertion contains an equality check through the use of the toString method, the test is affected by a Sensitive Equality smell.",FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Sensitive Equality,,A test method invokes the toString() method of an object,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Sensitive Equality,,Occurs when the toString method is used within a test method.,FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/pii/S0164121221000364,Why do builds fail?—A conceptual replication study,article,Test Smell,Sensitive Equality,,JUnit classes having at least one assert statement invoking a toString method.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Sensitive Equality,,Objects to be verified are converted to strings and compared with an expected string.,FALSE,TRUE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Sensitive Locators,,The test uses element identification selectors that have long chains to identify an element in the user interface. e.g. complex x-pass or CSS selector for web application.,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Sensitive Locators,,The test uses element identification selectors that have long chains to identify an element in the user interface. e.g. complex x-pass or CSS selector for web application.,FALSE,TRUE,TRUE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Share the world,,"where the test sets up all its resources at the start of the fixture, leading to either bleeding of state between tests, or extra work to keep things tidy",FALSE,FALSE,FALSE,FALSE
https://apprize.best/c/unit/8.html,Chapter 8. The pillars of good unit tests,webpage,Test Smell,Shared-state corruption,,Tests sharing in-memory state without rolling back,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Short template,,the body of a template definition is so short that it does not justify the creation of a template declaration.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Short Template,,template definition is very short (in terms of characters or number of fields).,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Short Template,,A template definition is very short,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Shotgun Surgery,,Multiple places need to be modified with a single change.,FALSE,FALSE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Singular Component Variable/Constant/Timer Reference,,"a component variable, constant, or timer is referenced by one single function, test case, or altstep only, although other behavioural entities run on the component as well",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Singular Component Variable/Constant/Timer Reference,,"A component variable, constant or timer is referenced by one single function, test case or altstep only, although other behavioral entities run on the component as well.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Singular Component Variable/Constant/Timer Reference,,"A component variable, constant, or timer is referenced by one single function, test case, or altstep only, although other behaviour runs on the component as well",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Singular Template Reference,,a template definition is referenced only once.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Singular Template Reference,,A template definition is referenced only once.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Singular Template Reference,,A template definition is referenced only once,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3377812.3382151,RTj: a Java framework for detecting and refactoring rotten green test cases,paper,Test Smell,Skip Rotten Green Test,,Contains guards to stop their execution early under certain conditions.,TRUE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Skip-Epidemic,,Failing tests are constantly skipped over.,FALSE,FALSE,TRUE,FALSE
https://www.codementor.io/@mgawinecki/anti-patterns-in-test-automation-101c6vm5jz,Anti-patterns in test automation,webpage,Anti-pattern,Sleeping for arbitrary amount of time,,When a test becomes fragile to network or processing congestion,TRUE,FALSE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Sleepy Test,,A test method that invokes the Thread.sleep() method,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Sleepy Test,,Test method with pauses to wait for an event,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Sleepy Test,,A test which contains thread suspension calls,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Sleepy Test,,"A test that makes a thread to sleep, which can lead to undesirable behavior such as race conditions",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Sleepy Test,,A test method that invokes the Thread.sleep() method,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Sleepy Test,,"Developers introduce this smell when they need to pause execution of statements in a test method for a certain duration (i.e., simulate an external event) and then continuing with execution. Explicitly causing a thread to sleep can lead to unexpected results as the processing time for a task differs when executed in various environments and configurations.",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Sleepy Test,,"Occurs when the execution of statements in a test method needs to be paused for a certain amount of time (e.g., simulating an external event) and, after that, it continues with the execution",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Sleepy Test,,A test method that invokes the Thread.sleep() method.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Sleepy Test,,"Occurs when developers need to pause the execution of statements in a test case for a certain duration (i.e., simulate an external event) and then continue with the execution",FALSE,TRUE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Sleepy Test,,Explicitly causing a thread to sleep can lead to unexpected results as the processing time for a task can differ on different devices. Developers introduce this smell when they need to pause execution of statements in a test method for a certain duration (i.e. simulate an external event) and then continuing with execution.,TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Sleepy Test,,Occurs when a test method has an explicit wait.,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Sleepy Test,,"Occurs when explicitly making a thread to sleep in test cases, which may cause flaky test results.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Sleepy Test,,A test method that invokes the Thread.sleep() method,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Sleepy Test,,"Developers introduce this smell when they need to pause execution of statements in a test method for a certain duration (i.e., simulate an external event) and then continuing with execution. Explicitly causing a thread to sleep can lead to unexpected results as the processing time for a task differs when executed in various environments and configurations.",TRUE,FALSE,TRUE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Sloppy Worker,Wet Floor,The test generates data but it omits dispensing with the data after finishing. This will cause itself and other tests to fail on consecutive runs.,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Slow Component Usage,,A component of the SUT has high latency.,FALSE,TRUE,FALSE,TRUE
https://dzone.com/articles/unit-testing-smells-what-are-your-tests-telling-yo,Unit Testing Smells: What Are Your Tests Telling You?,webpage,Test Smell,Slow Running Tests,,"If you have unit tests that take tens of milliseconds or more to run, you have a smell.",FALSE,TRUE,FALSE,FALSE
https://www.youtube.com/watch?v=VBgySRk0VKY,A testing anti-pattern safari,webpage,Test Smell,Slow Test,,Slow tests are kind of tests which take long enough to run,TRUE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Slow Test,"Long Running Test, The Slow Poke",The test runs too slowly.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Slow test,,The test takes so long that developers avoid to run it every time they make a change,FALSE,FALSE,TRUE,FALSE
http://j.mecs-press.net/ijitcs/ijitcs-v7-n3/IJITCS-V7-N3-8.pdf,Investigating into Automated Test Patterns in Erratic Tests by Considering Complex Objects,article,Test Smell,Slow Test,,"Slow tests are kind of tests which take long enough to run. This explains why when test developers make a change to the SUT, they don't execute tests every time.",FALSE,TRUE,FALSE,FALSE
https://ieeexplore.ieee.org/document/8501942,What We Know About Smells in Software Test Code,technical paper/manuscript,Test Smell,Slow test,,The test takes too long (time) to run.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Slow Test,,The tests take too long to run,FALSE,TRUE,FALSE,TRUE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Sneaky Checking,,The test hides its assertions in actions that are at the wrong level of details.,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Sneaky Checking,,The test hides its assertions in actions that are at the wrong level of details.,FALSE,TRUE,TRUE,TRUE
https://www.techwell.com/techwell-insights/2015/09/test-design-automation-anti-patterns,Test design for automation: Anti-patterns,webpage,Test Smell,Sneaky Checking,,The test hides its assertions in actions that are at the wrong level of details.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,So the Automation Tool Wrote This Crap,,"where the code of the test was ejected out of the guts of a code-generator built from a test GUI. This may not be a real issue, if the code isn’t then modified and updated. However, if this code is actively developed, then de-robotise it.",FALSE,FALSE,FALSE,FALSE
https://www.youtube.com/watch?v=3Fa69eQ6XgM,Developer test anti-patterns by lasse koskela,webpage,Test Smell,Split Logic,,When the test logic is split into several test objects and their specific assertions,TRUE,TRUE,FALSE,FALSE
https://www.youtube.com/watch?v=3Fa69eQ6XgM,Developer test anti-patterns by lasse koskela,webpage,Test Smell,Split Personality,,A test method that attempts to test several behaviors of the tested object.,TRUE,TRUE,FALSE,FALSE
https://orbilu.uni.lu/handle/10993/48254,On the Maintenance of System User Interactive Tests,thesis,Test Smell,Stinky Synchronization,,The test fails to use proper synchronization points with the system under test,FALSE,TRUE,TRUE,TRUE
https://arxiv.org/abs/2111.02317,Smells in System User Interactive Tests,technical paper/manuscript,Test Smell,Stinky Synchronization,,The test fails to use proper synchronization points with the system under test,FALSE,TRUE,TRUE,TRUE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Stinky synchronization syndrome,,The failure to use proper synchronization/wait points in the GUI-based testing of web applications using tools such as Selenium.,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Stop in function,,a function contains a stop statement,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Stop in Function,,"A function contains a stop statement. If possible, functions should not contain any stop statement, because this can prevent the execution of postambles (e.g. code that has to be executed after each test case). Instead, functions should use return values. However, this smell should be classified weak compared to other smells.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Stop in Function,,A function contains a stop statement,FALSE,FALSE,FALSE,FALSE
https://wiki.c2.com/?SubclassToTestAntiPattern,Subclass To Test Anti Pattern,webpage,Anti-pattern,Subclass To Test,,"Need to fake, mock or stub methods in a ClassUnderTest, and/or classes it uses.",FALSE,TRUE,FALSE,TRUE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Success Against All Odds,,"A test that was written to pass first rather than fail first. As an unfortunate side effect, the test case happens to always pass even though the test should fail.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Success Against All Odds,,The tests are written first but they are written in a way that they pass first rather than failing in the first execution.,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,Success Against All Odds,,"A test that was written pass first rather than fail first. As an unfortunate side effect, the test case happens to always pass even though the test should fail.",FALSE,FALSE,FALSE,FALSE
https://medium.com/jameskbride/testing-anti-patterns-b5ffc1612b8b,Testing anti-patterns,webpage,Test Smell,Superfluous Setup Data,,"Occurs when testing queries or filters, in which you only expect to get a subset of the data back. The underlying idea is that, in order to be thorough, “extra” data should be present to show that the query or filter works as required.",TRUE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Surreal,,"A test whose use of test doubles is so confusing, it's hard to tell what the test is even doing at run-time.",TRUE,TRUE,FALSE,TRUE
https://www.codementor.io/@mgawinecki/anti-patterns-in-test-automation-101c6vm5jz,Anti-patterns in test automation,webpage,Anti-pattern,Taking environment state for granted,,"Taking environment state for granted is often over optimistic. Unlike in unit tests, end-to-end setup gives little control over test environment state, particularly when it is shared with other teams. When the test starts failing it might be because of a new bug introduced or because environment is not in a state your test needs.",FALSE,FALSE,FALSE,TRUE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Tangential,,"The subject and its test claim to be focused on something, but the bulk of their complexity is focused on a different (often subordinate) responsibility.",TRUE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Teardown Only Test,,Test-suite only dening teardown (unusual for unit tests),FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Teardown Only Test,,Exists when a test-suite is only specifying teardown,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Test body is somewhere else,,when the test method calls another method entirely with no other implementation in the test method – often a sign of missing parameterised test,TRUE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Test By Number,,"Production code is tested consistently by rote, inadvertently suppressing creativity in the design of both the tests and their subjects.",TRUE,TRUE,FALSE,TRUE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Test cases are concerned with more than one unit of code,,When tests get too big they can have bugs of their own,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/7181438/,Generating refactoring proposals to remove clones from automated system tests,paper,Test Smell,Test Clones,,"Tests contain similar parts (e. g., introduced by copy&paste)",TRUE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/6606682,Hunting for smells in natural language tests,paper,Test Smell,Test Clones,,"Tests contain similar parts (e. g., introduced by copy&paste)",FALSE,TRUE,TRUE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Test Code Duplication,,Occurs when test code has undesired duplication,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Test Code Duplication,,Code clones contained inside the unit tests,FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Test Code Duplication,,Code clones contained inside the unit tests,FALSE,TRUE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Test Code Duplication,,Code clones contained inside the unit tests,FALSE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Test Code Duplication,Second Class Citizen,The test code is duplicated several times. This is either done on purpose by copying and pasting the code or the same code is unintentionally written again.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3379597.3387471,Did You Remember To Test Your Tokens?,paper,Test Smell,Test Code Duplication,,"In this smell, the same test code is repeated many times [26]. Duplicated code impacts test code maintenance [20], which can be a serious issue: if test logic in on code fragments is modified, all duplicates must be identified & modified as well.",FALSE,TRUE,FALSE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Test Code Duplication,,"Replication of the test code many times. The necessity of performing similiar things by various tests in a suite, often results in Test Code Duplication, for instance, tests may need similar fixture setup or result verification logic",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Test Code Duplication,,Identical fragments of test code (clones) appear in a number of test cases,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3425269.3425283,LCCSS: A Similarity Metric for Identifying Similar Test Code,paper,Test Smell,Test Code Duplication,,Repeated test code steps,TRUE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/2897010.2897016,On the diffusion of test smells in automatically generated test code: an empirical study,paper,Test Smell,Test Code Duplication,,"Code duplication is a potentially serious problem that affects the maintainability and the comprehensibility of a software system. In test classes, the most common case in which this smell appears is the duplication of code in the same test class.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Test Code Duplication,,"Test code may contain undesirable duplication. In particular the parts that set up test fixtures are susceptible to this problem. Solutions are similar to those for normal code duplication as described by Fowler [183, p. 76]. The most common case for test code will be duplication of code in the same test class.",FALSE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Test Code Duplication,,Test code may contain undesirable duplication. In particular the parts that set up test fixtures are susceptible to this problem.,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3425174.3425212,Refactoring Test Smells: A Perspective from Open-Source Developers,paper,Test Smell,Test Code Duplication,,This test smell normally identifies classes that contain test methods with repeated test code steps.,TRUE,FALSE,FALSE,TRUE
https://damorimrg.github.io/practical_testing_book/goodpractices/artifacts.html,Test Artifacts — The Practical Testing Book,webpage,Test Smell,Test Code Duplication,,When several tests in a suite needs to be setup or do similar computations,TRUE,FALSE,FALSE,TRUE
https://ieeexplore.ieee.org/abstract/document/6862882/,Test code quality and its relation to issue handling performance,article,Test Smell,Test Code Duplication,,Occurs when copy-paste is used as a way to reuse test logic.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Test Code Duplication,,Occurs when code clones contained inside the test,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Test Code Duplication,,The same test code is repeated many times.,TRUE,TRUE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Test Dependency in Production,,Production executables depend on test executables.,FALSE,TRUE,FALSE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Test Envy,,The test tests another class instead of the one it is supposed to test.,FALSE,FALSE,TRUE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Test Envy,,A test that is really testing some other class than the one it is supposed to. A common example of this is testing model validations in the controller when they should be tested in the model test,FALSE,FALSE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Test Hook,,"Conditional logic within the SUT determines whether the ""real"" code or test-specific logic is run.",TRUE,TRUE,FALSE,TRUE
https://thoughtbot.com/upcase/videos/testing-antipatterns,Rails Testing Antipatterns,webpage,Test Smell,Test Hooks,,having specific methods or branches in your production code for testing.,TRUE,FALSE,FALSE,TRUE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Test Logic in Production Code,,"Logic, that should be exercised only during tests, contained by the production code",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.5555/1768961.1768982,Inspecting Automated Test Code: A Preliminary Study,paper,Test Smell,Test Logic in Production Code,,Production code contains logic that should rather be included into test code,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Test Logic in Production Code,,The code that is put into production contains logic that should be exercised only during tests.,FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/6569744,Automated Detection of Test Fixture Strategies and Smells,paper,Test Smell,Test Maverick,,"A test method is a maverick when the class comprising the test method contains an implicit setup, but the test method is completely independent from the implicit setup procedure. The setup procedure will be executed before the test method is executed, but it is not needed. Also, understanding the effect-cause relationship between setup and test method can be hampered. Discovering that test methods are unrelated from the implicit setup can be time consuming.",FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Test Maverick,,"If the test suite has a fixture with setup, but a test case in this suite does not use this setup, this test case is a maverick (outlier). The setup procedure will be executed before the test case is executed, but it is not needed",FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/6624053,Strategies for avoiding text fixture smells during software evolution,paper,Test Smell,Test Maverick,,"A test method is a maverick when the class providing the test method contains an implicit setup, but the test method is completely independent from the implicit setup procedure.",FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Test Maverick,,"Exists when a test class has a test method with an implicit setup; however, the test methods are independent",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Test Pollution,,Test that introduces dependencies such as reading/writing a shared resource,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Test Redundancy,,Occurs when the removal of a test does not impact the effectiveness of the test suite,FALSE,FALSE,FALSE,FALSE
https://arxiv.org/abs/2003.05613,A survey on test practitioners' awareness of test smells,paper,Test Smell,Test Run War,,It occurs when a test passes only when it is performed isolated and fails when it is performed with another test at the same time.,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/document/6405253,An empirical analysis of the distribution of unit test smells and their impact on software maintenance,paper,Test Smell,Test Run War,,"A test allocates resources also used by others also used by others (e.g., tmp files)",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/abstract/document/8847402/,An exploratory study of the relationship between software test smells and fault-proneness,article,Test Smell,Test Run War,,"A test allocates resources also used by others also used by others (e.g., tmp files)",FALSE,TRUE,TRUE,FALSE
https://link.springer.com/article/10.1007/s10664-014-9313-0,Are test smells really harmful? An empirical study,article,Test Smell,Test Run War,,"A test allocates resources also used by others also used by others (e.g., tmp files)",FALSE,TRUE,TRUE,TRUE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Test Run War,,The test begins to fail when several developers run it simultaneously due to its dependence on a shared resource.,FALSE,FALSE,TRUE,FALSE
https://lutpub.lut.fi/handle/10024/158751,Enhancing developers’ awareness on test suites’ quality with test smell summaries,thesis,Test Smell,Test Run War,,"Due to resource interference, the results are fine as long as one programmer runs it and test fails when other programmers run it.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/chapter/10.1007/978-3-540-76440-3_8,On the interplay between software testing and evolution and its effect on program comprehension,article,Test Smell,Test Run War,,Such wars arise when the tests run fine as long as you are the only one testing but fail when more programmers run them. This is most likely caused by resource  interference: some tests in your suite allocate resources such as temporary files that are also used by others.,FALSE,TRUE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.19.5499&rep=rep1&type=pdf,Refactoring Test Code,paper,Test Smell,Test Run War,,Such wars arise when the tests run fine as long as you are the only one testing but fail when more programmers run them,FALSE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Test Run War,,A test that fails when more than one programmer runs them.,FALSE,FALSE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Test Run War,,Test failures occur at random when several people are running tests simultaneously.,TRUE,TRUE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Test setup is somewhere else,,"where the test method just does the assertions, not the given/when part; this can be acceptable in the case of several tests on a single shared expensive resource setup, but seldom is at other times",TRUE,FALSE,FALSE,FALSE
https://github.com/mockito/mockito/wiki/How-to-write-good-tests,How to write good tests,webpage,Test Smell,Test tautology,,Generally speaking one does not want to duplicate the logic between tests and code. So replicating a regexp or something else in the test is not an option.,TRUE,FALSE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Test-Class Name,,Test-class having meaningless name,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Test-Class Name,,A test that has a class with a meaningless name.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Test-Method Category Name,,A test method has a meaningless name,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Test-MethodCategory Name,,Method categories having a meaningless name,FALSE,FALSE,TRUE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,Test-per-Method,,"Although a one-to-one relationship between test and production classes is a reasonable starting point, a one-to-one relationship between test and production method is almost always a bad idea",FALSE,FALSE,FALSE,FALSE
https://culturedperl.com/test-class-hierarchy-is-an-antipattern-391c6ef1e491,Test::Class Hierarchy Is an Antipattern,webpage,Test Smell,Test::class Hierarchy,,When test classes are not independent and test methods are inherited,TRUE,FALSE,FALSE,FALSE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,Testing business rules through UI,,"business rules should be tested regardless of the UI being used. Of course, end-to-end testing is an exception",FALSE,FALSE,FALSE,FALSE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Testing for a specific bug,,Sometimes you need to reproduce a bug so a new test case is created for reproducing that bug. Most times developers are less descriptive in naming these tests calling them something like “testForBugXYZ”,FALSE,FALSE,FALSE,FALSE
http://blog.codepipes.com/testing/software-testing-antipatterns.html,Software Testing Anti-patterns,webpage,Anti-pattern,Testing internal implementation,,Related to tests that are tightly coupled to internal implementation,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3379597.3387471,Did You Remember To Test Your Tokens?,paper,Test Smell,Testing the Authentication Framework,,"When the test literally compares the generated message digest with a string constant to see if both are identical and they are provided by a 3rd party library, whose maintainers are responsible to properly test the code and not the developer.",FALSE,TRUE,FALSE,FALSE
https://jakescruggs.blogspot.com/2009/04/smells-of-testing-signs-your-tests-are.html,Smells of Testing (signs your tests are bad),webpage,Test Smell,Testing the Framework,,If you're using a framework you pretty much have to assume it works. Testing it along with your other tests only clutters things up.,FALSE,FALSE,FALSE,TRUE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Testing The Internal Monologue,,Where the writer of the test has been so focused on the lines of code in their implementation that they haven’t sought ways to observe the behaviour of the system from the outside.,TRUE,FALSE,FALSE,FALSE
https://dzone.com/articles/unit-testing-smells-what-are-your-tests-telling-yo,Unit Testing Smells: What Are Your Tests Telling You?,webpage,Test Smell,Tests Are Difficult to Write,,"If you have an exorbitantly difficult time writing tests, even as a newbie, you should take a critical look at the code you're trying to test. It usually indicates excessive coupling.",FALSE,TRUE,FALSE,FALSE
https://www.codementor.io/@mgawinecki/anti-patterns-in-test-automation-101c6vm5jz,Anti-patterns in test automation,webpage,Anti-pattern,Tests cluttered with business logic,,Tests that mix details of system business logic with steps of test scenario are hard to read and maintain.,FALSE,FALSE,FALSE,TRUE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Tests depend on something outside of the test suite,,occur when there is something the test needs to be able to run but it is not mocked either because it wasn’t missed or is not possible to mock,FALSE,FALSE,FALSE,FALSE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,Tests require too much intimate knowledge of the code to run,,"Tests only need to know about the methods they are testing, and even then only the interface or what is going in and coming out of them not specific implementation details. This particular anti-pattern or set of them comes from attempts to get 100% code coverage.",FALSE,FALSE,FALSE,FALSE
https://www.youtube.com/watch?v=VBgySRk0VKY,A testing anti-pattern safari,lecture/presentation video,Anti-pattern,Tests that Can't Fail,,TDD tests that pass rather than failing in the first execution.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Testy testy test test,,"where the name of a test contains the name test, which is hardly surprising, as it’s a test, in a test fixture that’s probably annotated with an annotation/attribute called test",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The Bandwidth Demander,,"a test that cannot be successfully run when the system’s running a little slowly, perhaps it has internal timing issues that are set to thresholds that are too demanding of the build process",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Butterfly,,"You have to test something which contains data that changes all the time, like a structure which contains the current date, and there is no way to nail the result down to a fixed value. The ugly part is that you don't care about this value at all. It just makes your test more complicated without adding any value.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Conjoined Twins,,"Tests that people are calling ""Unit Tests"" but are really integration tests since they are not isolated from dependencies (file configuration, databases, services, other in other words the parts not being tested in your tests that people got lazy and did not isolate) and fail due to dependencies that should have been stubbed or mocked.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Conjoined Twins,,Tests that are called unit tests but are really integration tests since there is no isolation between the system-under-test and the tests,FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Cuckoo,"Inappropriately Shared Fixture, The Mother Hen",Several test cases in the test fixture do not even use or need the setup/teardown shared code. Partly due to developer inertia to create a new test fixture… easier to just add one or more test cases to the pile.,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Cuckoo,,"The unit test belongs to a test case with several other tests and shares the setup with them. However, it disposes of parts or all of the setup and builds its own setup.",FALSE,FALSE,TRUE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Cuckoo,,"A unit test which sits in a test case with several others, and enjoys the same (potentially lengthy) setup process as the other tests in the test case, but then discards some or all of the artifacts from the setup and creates its own.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Cuckoo,Stranger,This is a test method that sits in the same unit test but doesn’t really belong there,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Dead Tree,Process Compliance Backdoor,A stub was made but the corresponding test has never been written.,FALSE,FALSE,TRUE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Test Smell,The Dead Tree,Process Compliance Backdoor,"A test which where a stub was created, but the test wasn't actually written.",TRUE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Dodger,,"A unit test which has lots of tests for minor (and presumably easy to test) side effects, but never tests the core desired behavior. Sometimes you may find this in database access related tests, where a method is called, then the test selects from the database and runs assertions against the result.",FALSE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Dodger,,"A unit test which has lots of tests for minor (and presumably easy to test) side effects, but never tests the core desired behavior. Sometimes you may find this in database access related tests, where a method is called, then the test selects from the database and runs assertions against the result.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Dodger,,"A unit test which has lots of tests for minor (and presumably easy to test) side effects, but never tests the core desired behavior. Sometimes you may find this in database access related tests, where a method is called, then the test selects from the database and runs assertions against the result.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Enumerator,,"A unit test where each test case method name is only an enumeration, i.e. test1, test2, test3. As a result, the intention of the test case is unclear, and the only way to be sure is to read the test case code and pray for clarity.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Enumerator,,"The names of the test methods are only an enumeration. For example, test1, test2 etc.",FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Enumerator,,"A unit test with each test case method name is only an enumeration, i.e. test1, test2, test3. As a result, the intention of the test case is unclear, and the only way to be sure is to read the test case code and pray for clarity.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Enumerator,Test With No Name,"Unit tests where each test case method name is only an enumeration, e.g. test1, test2, test3. As a result, the intention of the test case is unclear, and the only way to be sure is to read the test case code and pray for clarity.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Environmental Vandal,,"A 'unit' test which for various 'requirements' starts spilling out into its environment, using and setting environment variables / ports. Running two of these tests simultaneously will cause 'unavailable port' exceptions etc.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The First and Last Rites,Oops I Forgot the Setup,"where there’s some ritual/boilerplate at the start and end of most test bodies, suggesting a lack of common setup/teardown code",TRUE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Flickering Test,,"A test which just occasionally fails, and is generally due to race conditions within the test. Typically occurs when testing something that is asynchronous. Possibly a superset of the Wait and See and The Sleeper anti-patterns.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Flickering Test,,"A test which just occasionally fails, not at specific times, and is generally due to race conditions within the test. Typically occurs when testing something that is asynchronous, such as JMS.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Forty Foot Pole Test,,"Afraid of getting too close to the class they are trying to test, these tests act at a distance, separated by countless layers of abstraction and thousands of lines of code from the logic they are checking. As such they are extremely brittle, and susceptible to all sorts of side-effects that happen on the epic journey to and from the class interest.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Forty Foot Pole Test,,"Afraid of getting too close to the class they are trying to test, these tests act at a distance, separated by countless layers of abstraction and thousands of lines of code from the logic they are checking. As such they are extremely brittle, and susceptible to all sorts of side-effects that happen on the epic journey to and from the class of interest.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Forty Foot Pole Test,,"Afraid of getting too close to the class they are trying to test, these tests act at a distance, separated by countless layers of abstraction and thousands of lines of code from the logic they are checking.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Free Ride,Piggyback,"Rather than write a new test case method to test another feature or functionality, a new assertion rides along in an existing test case.",FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,The Free Ride,Piggyback,"Rather than writing a new test case method to test another/distinct feature/functionality, a new assertion (and its corresponding actions, i.e., the Act steps from the Arrange-Act-Assert pattern) rides along in an existing test case",FALSE,FALSE,FALSE,FALSE
https://matheus.ro/2018/04/30/tdd-antipatterns-the-free-ride-piggyback/,TDD Anti-patterns: The Free Ride / Piggyback,webpage,Test Smell,The Free Ride,Piggyback,When an extra assertion is added in an existing test to cover a new scenario case,TRUE,TRUE,FALSE,TRUE
https://semaphoreci.com/blog/2014/06/24/tdd-antipatterns-the-free-ride.html,Tdd antipatterns: The free ride,webpage,Test Smell,The Free Ride,Piggyback,"rather than write a new test case method to test another/distinct feature/functionality, a new assertion rides along in an existing test case.",TRUE,TRUE,FALSE,TRUE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Free Ride,,"Rather than write a new test case method to test another feature or functionality, a new assertion rides along in an existing test case.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Free Ride,Piggyback,"Rather than write a new test case method to test another/distinct feature/functionality, a new assertion (and its corresponding actions i.e. Act steps from AAA) rides along in an existing test case.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Free Ride,Piggyback,"Rather than write a new test case method to test another feature or functionality, a new assertion rides along in an existing test case.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Giant,,"A unit test that, although it is validly testing the object under test, can span thousands of lines and contain many test cases. This can be an indicator that the system under test is a God Object.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Giant,,The unit test is huge and contains many test methods although it tests only one object.,FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,The Giant,,"a unit test that, although it is validly testing the object under test, can span thousands of lines and con- tain many test cases",FALSE,FALSE,FALSE,FALSE
https://www.codurance.com/publications/tdd-anti-patterns-chapter-1,TDD anti patterns - Chapter 1,webpage,Test Smell,The giant,,Many assertions in a single test case,TRUE,FALSE,FALSE,FALSE
https://marabesi.com/tdd/2021/08/28/tdd-anti-patterns.html,"TDD anti-patterns - the liar, excessive setup, the giant, slow poke",webpage,Test Smell,The giant,,Many assertions in a single test case,TRUE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Giant,,"A unit test that, although it is validly testing the object under test, can span thousands of lines and contain many many test cases. This can be an indicator that the system under tests is a God Object",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Giant,,"A unit test that, although it is validly testing the object under test, can span thousands of lines and contain many many test cases. This can be an indicator that the system under tests is a God Object",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Giant,,"A unit test that, although it is validly testing the object under test, can span thousands of lines and contain many many test cases. This can be an indicator that the system-under-test is a God Object.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Greedy Catcher,,"A unit test which catches exceptions and swallows the stack trace, sometimes replacing it with a less informative failure message, but sometimes even just logging (c.f. Loudmouth) and letting the test pass.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Greedy Catcher,,"The unit test catches an exception and either hides the stack trace or substitutes it with a failure message that has less documentation value. In the end, the test will  pass because of this.",FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Greedy Catcher,,"A unit test which catches exceptions and swallows the stack trace, sometimes replacing it with a less informative failure message, but sometimes even just logging (c.f. Loudmouth) and letting the test pass.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Greedy Catcher,,"A unit test which catches exceptions and swallows the stack trace, sometimes replacing it with a less informative failure message, but sometimes even just logging (cf. Loudmouth) and letting the test pass.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The Inhuman Centipede,,"where a test can only function in sequence with those around it. While there are some situations where this is an expected/necessary evil, it’s a terrible default.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Inspector,,"A unit test that violates encapsulation in an effort to achieve 100% code coverage, but knows so much about what is going on in the object that any attempt to refactor will break the existing test and require any change to be reflected in the unit test.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Inspector,,Encapsulation is disregarded by reading private fields or an extension of the class to access protected fields. The aim is to achieve better code coverage.,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Inspector,,"A unit test that violates encapsulation in an effort to achieve 100% code coverage, but knows so much about what is going on in the object that any attempt to refactor will break the existing test and require any change to be reflected in the unit test.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Inspector,,"A unit test that violates encapsulation in an effort to achieve 100% code coverage, but knows so much about what is going on in the object that any attempt to refactor will break the existing test and require any change to be reflected in the unit test.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Inspector,,"A unit test that violates encapsulation in an effort to achieve 100% code coverage, but knows so much about what is going on in the object that any attempt to refactor will break the existing test and require any change to be reflected in the unit test.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The Leaky Cauldron,,"similar to Identity Dodgems this is a test which is either sensitive to some state caused by other tests, or which creates a mess that breaks other tests",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Liar,,"An entire unit test that passes all of the test cases it has and appears valid, but upon closer inspection it is discovered that it doesn’t really test the intended target at all.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Liar,,The unit test passes but it does not verify the functionality of the object it should really test.,FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,The Liar,,the test passes against all odds,FALSE,FALSE,FALSE,FALSE
https://www.codurance.com/publications/tdd-anti-patterns-chapter-1,TDD anti patterns - Chapter 1,webpage,Test Smell,The liar,,Testing asynchronous code becomes tricky as it is based on a future value that you might receive or might not.,TRUE,FALSE,FALSE,FALSE
https://marabesi.com/tdd/2021/08/28/tdd-anti-patterns.html,"TDD anti-patterns - the liar, excessive setup, the giant, slow poke",webpage,Test Smell,The liar,,Testing asynchronous code becomes tricky as it is based on a future value that you might receive or might not.,TRUE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Liar,,"An entire unit test that passes all of the test cases it has and appears valid, but upon closer inspection it is discovered that it doesn’t really test the intended target at all.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Liar,"Evergreen Tests, Success Against All Odds","A test doesn’t validate any behaviour and passes in every scenario. Any new bug introduced in the code will never be discovered by this test. It was probably created after the implementation was finished, so the author of this test couldn’t know whether the test actually tests something.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Local Hero,,"A test case that is dependent on something specific to the development environment it was written on in order to run. The result is the test passes on development boxes, but fails when someone attempts to run it elsewhere.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Local Hero,,"The test relies on features that are specific to the development environment. Thus, it cannot be run in another environment.",FALSE,FALSE,TRUE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,The Local Hero,,The test is dependent on something specific to the develop- ment environment it was written on in order to run,FALSE,FALSE,FALSE,FALSE
https://semaphoreci.com/blog/2014/07/10/tdd-antipatterns-local-hero.html,Tdd antipatterns: Local hero,webpage,Anti-pattern,The Local Hero,,"A test case that is dependent on something specific to the development environment it was written on in order to run. The result is the test passes on development boxes, but fails when someone attempts to run it elsewhere.",FALSE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Local Hero,,"A test case that is dependent on something specific to the development environment it was written on in order to run. The result is the test passes on development boxes, but fails when someone attempts to run it elsewhere.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Local Hero,,"A test case that is dependent on something specific to the development environment it was written on in order to run. The result is the test passes on development boxes, but fails when someone attempts to run it elsewhere.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Local Hero,"Wait and See, Environmental Vandal","A test case that is dependent on something specific to the development environment it was written on, in order to run. The result is that the test passes on development boxes, but fails when someone attempts to run it elsewhere.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Loudmouth,,"A unit test (or test suite) that clutters up the console with diagnostic messages, logging messages, and other miscellaneous chatter, even when tests are passing. Sometimes during test creation there was a desire to manually see output, but even though it’s no longer needed, it was left behind.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Loudmouth,Transcripting Test,The test writes output in the console or in a global stream.,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Loudmouth,,"A unit test (or test suite) that clutters up the console with diagnostic messages, logging messages, and other miscellaneous chatter, even when tests are passing. Sometimes during test creation there was a desire to manually see output, but even though it’s no longer needed, it was left behind.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Loudmouth,,"A unit test (or test suite) that clutters up the console with diagnostic messages, logging, and other miscellaneous chatter, even when tests are passing.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Mockery,,"A unit test contains so many mocks, stubs and/or fakes that the system under test isn’t even being tested at all, instead data returned from mocks is what is being tested.",FALSE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Mockery,,"Sometimes mocking can be good, and handy. But sometimes developers can lose themselves and in their effort to mock out what isn’t being tested. In this case, a unit test contains so many mocks, stubs, and/or fakes that the system under test isn’t even being tested at all, instead data returned from mocks is what is being tested.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Mockery,,"Sometimes mocking can be good, and handy. But sometimes developers can lose themselves and in their effort to mock out what isn’t being tested. In this case, a unit test contains so many mocks, stubs, and/or fakes that the system under test isn’t even being tested at all, instead data returned from mocks is what is being tested.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Mockery,,"Sometimes mocking can be good, and handy. But sometimes developers can lose themselves in their effort to mock out what isn’t being tested. In this case, a unit test contains so many mocks, stubs, and/or fakes that the system under test isn’t even being tested at all, instead data returned from mocks is what is being tested.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Mother Hen,,The setup does more than any of the tests need.,FALSE,FALSE,TRUE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Mother Hen,,A common setup which does far more than the actual test cases need. For example creating all sorts of complex data structures populated with apparently important and unique values when the tests only assert for presence or absence of something.,FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Nitpicker,,"A unit test which compares a complete output when it’s really only interested in a small part of it, so the test has to continually be kept in line with otherwise unimportant details.",FALSE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Nitpicker,,"A unit test which compares a complete output when it’s really only interested in small parts of it, so the test has to continually be kept in line with otherwise unimportant details. Endemic in web application testing.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Nitpicker,,"A unit test which compares a complete output when it’s really only interested in small parts of it, so the test has to continually be kept in line with otherwise unimportant details.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The One,Silver Bullet,"A combination of several patterns, particularly The Free Ride and The Giant, a unit test that contains only one test method which tests the entire set of functionality an object has. A common indicator is that the test method name is often the same as the unit test name, and contains multiple lines of setup and assertions.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The One,The Test It All,"This smell is a combination of the test smells ‘The Free Ride’ and ‘The Giant’. It is a unit test that consists of only one test method which, in addition, tests the whole functionality of an object.",FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The One,,"A combination of several patterns, particularly TheFreeRide and TheGiant, a unit test that contains only one test method which tests the entire set of functionality an object has. A common indicator is that the test method is often the same as the unit test name, and contains multiple lines of setup and assertions.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Operating System Evangelist,,"A unit test that relies on a specific operating system environment to be in place in order to work. A good example would be a test case that uses the newline sequence for Windows in an assertion, only to break when run on Linux.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Operating System Evangelist,,The unit test can only be run on a specific operating system because it depends on the environment of the operating system.,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Operating System Evangelist,,"A unit test that relies on a specific operation system environment to be in place in order to work. A good example would be a test case that uses the newline sequence for windows in an assertion, only to break when ran on Linux.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The painful clean-up,,"where every test needs to build or clean up an expensive resource, like a database, as the separation of tests is weak, or the test is too large",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The Parasite,,"a test which should be written stand-alone, but depends on the running of a previous test",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Peeping Tom,The Uninvited Guest,"A test that, due to the shared resources, can see the result data of another test, and may cause the test to fail even though the system under test is perfectly valid. This has been seen commonly in Fitnesse, where the use of static member variables to hold collections aren’t properly cleaned after test execution, often popping up unexpectedly in other test runs.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Peeping Tom,The Uninvited Guests,A test gains insight into the results of other tests because of shared resources.,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Peeping Tom,The Uninvited Guests,"A test that, due to shared resources, can see the result data of another test, and may cause the test to fail even though the system under test is perfectly valid. This has been seen commonly in fitnesse, where the use of static member variables to hold collections aren’t properly cleaned after test execution, often popping up unexpectedly in other test runs.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Secret Catcher,,"A test that at first glance appears to be doing no testing due to the absence of assertions, but as they say, “the devil is in the details.” The test is really relying on an exception to be thrown when a mishap occurs, and is expecting the testing framework to capture the exception and report it to the user as a failure.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Secret Catcher,The Silent Catcher,The test contains no assertions but the test needs an exception to be thrown and to be reported by the testing framework.,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Secret Catcher,,"A test that at first glance appears to be doing no testing due to the absence of assertions, but as they say, “the devil’s in the details.” The test is really relying on an exception to be thrown when a mishap occurs, and is expecting the testing framework to capture the exception and report it to the user as a failure.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Test Smell,The Secret Catcher,,"A test that at first glance appears to be doing no testing, due to absence of assertions. But ""The devil is in the details"".. the test is really relying on an exception to be thrown and expecting the testing framework to capture the exception and report it to the user as a failure.",TRUE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Secret Catcher,,"A test that at first glance appears to be doing no testing due to the absence of assertions, but as they say, “the devil is in the details.” The test is really relying on an exception to be thrown when a mishap occurs, and is expecting the testing framework to capture the exception and report it to the user as a failure.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Sequencer,,A unit test that depends on items in an unordered list appearing in the same order during assertions.,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Sequencer,,The unit test relies on items in an unordered list to be in the same order during the assertion.,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Sequencer,,A unit test that depends on items in an unordered list appearing in the same order during assertions.,FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Sequencer,,A unit test that depends on items in an unordered list appearing in the same order during assertions.,FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Silent Catcher,,"A test that passes if an exception is thrown, even if the exception that actually occurs is one that is different from the one the developer intended.",FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,The Silent Catcher,,"A test that passes if an ex- ception is thrown, even if the exception that actually occurs is one that is different than the one the developer intended",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Test Smell,The Silent Catcher,,A test that passes if an exception is thrown.. even if the exception that actually occurs is one that is different than the one the developer intended.,TRUE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Sleeper,Mount Vesuvius,"A test that is destined to fail at some specific time and date in the future. This is often caused by incorrect bounds checking when testing code which uses a Date or Calendar object. Sometimes, the test may fail if run at a very specific time of day, such as midnight.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Sleeper,Mount Vesuvius,The test is designed in a way that it will certainly fail at some point due to Date and Calendar objects whose bounds are checked incorrectly,FALSE,FALSE,TRUE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Sleeper,Mount Vesuvius,"A test that is destined to FAIL at some specific time and date in the future. This often is caused by incorrect bounds checking when testing code which uses a Date or Calendar object. Sometimes, the test may fail if run at a very specific time of day, such as midnight.",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Slow Poke,,"A unit test that runs incredibly slow. When developer kick it off, they have time to go to the bathroom, grab a smoke, or worse, go home for the day.",FALSE,FALSE,FALSE,FALSE
https://www.codurance.com/publications/tdd-anti-patterns-chapter-1,TDD anti patterns - Chapter 1,webpage,Test Smell,The slow poke,,"Usually, it puts the test suite to execution and takes longer to finish and give the developer feedback.",TRUE,FALSE,FALSE,FALSE
https://marabesi.com/tdd/2021/08/28/tdd-anti-patterns.html,"TDD anti-patterns - the liar, excessive setup, the giant, slow poke",webpage,Test Smell,The slow poke,,"Usually, it puts the test suite to execution and takes longer to finish and give the developer feedback.",TRUE,FALSE,FALSE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Slow Poke,,"A unit test that runs incredibly slow. When developers kick it off, they have time to go to the bathroom, grab a smoke, or worse, kick the test off before they go home at the end of the day.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Slow Poke,,"A unit test that runs incredibly slow. When developers kick it off, they have time to go to the bathroom, grab a smoke, or worse, kick the test off before they go home at the end of the day.",FALSE,FALSE,FALSE,FALSE
https://www.yegor256.com/2018/12/11/unit-testing-anti-patterns.html,"Unit Testing Anti-Patterns, Full List",webpage,Anti-pattern,The Slow Poke,,"A unit test that runs incredibly slow. When developers kick it off, they have time to go to the bathroom, grab a smoke, or worse, kick the test off before they go home at the end of the day.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The Soloist,,a test that can only be run successfully when no other tests are running,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The Stepford Fields,,"where (too) many of the fields in test contain the same value, making it hard to spot when a calculation is reading a value from the wrong field, because it works on the test data; this also makes load testing near a cache pretty meaningless",TRUE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Stranger,Distant relative,"A test case that doesn’t even belong in the unit test it is part of. It’s really testing a separate object, most likely an object that is used by the object under test, but the test case has gone and tested that object directly without relying on the output from the object under test making use of that object for its own behavior.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Stranger,The Distant Relative,The test case does not belong to the unit test in which it is. It tests another object that was probably used by the tested object,FALSE,FALSE,TRUE,FALSE
https://bryanwilhite.github.io/the-funky-knowledge-base/entry/kb2076072213/,Test-Driven Development: TDD Anti-Patterns,webpage,Anti-pattern,The Stranger,The Distant Relative,"A test case that doesn’t even belong in the unit test it is part of. it’s really testing a separate object, most likely an object that is used by the object under test, but the test case has gone and tested that object directly without relying on the output from the object under test making use of that object for its own behavior. Also known as TheDistantRelative",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The telltale heart,,where the production code is repeatedly calculating and returning values that are only used at test time.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,The Temporal Tip Toe,,"a test that’s using timing to coordinate concurrent events, and only succeeding by good luck – ideally we should use locks and observable events to coordinate any concurrent tests, rather than hope to get our timings just right",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Test It All,,Tests that break the Single Responsibility Principle.,FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Test With No Name,,"The test that gets added to reproduce a specific bug in the bug tracker and whose author thinks does not warrant a name of its own. Instead of enhancing an existing, lacking test, a new test is created called TestForBug123.",FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,The Test With No Name,,"To reproduce a bug in the code a test method is added and named after the bug. For example, testForBUG1. Later, the developer needs to find the bug in the bug in order to understand the intent of the test method",FALSE,FALSE,TRUE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Test With No Name,,"The test that gets added to reproduce a specific bug in the bug tracker and whose author thinks does not warrant a name of its own. Instead of enhancing an existing, lacking test, a new test is created called testForBUG123. Two years later, when that test fails, you may need to first try and find BUG-123 in your bug tracker to figure out the test's intent.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,The Turing Test,,"A testcase automagically generated by some expensive tool that has many, many asserts gleaned from the class under test using some too-clever-by-half data flow analysis. Lulls developers into a false sense of confidence that their code is well tested, absolving them from the responsibility of designing and maintaining high quality tests. If the machine can write the tests for you, why can't it pull its finger out and write the app itself!",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,The Ugly Mirror,,"Test code that looks exactly like the code under test. Example, a SUT that formats a string tested by code that formats the expected string result in the exact same manner.",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/10781050/java-code-duplication-in-classes-and-their-junit-test-cases,Java: code duplication in classes and their junit test cases,webpage,Anti-pattern,The Ugly Mirror,,"When the code to traverse the fields remains the same in test case and CUT, and is currently duplicated. If the CUT has a bug, most likely it will be copied to the test case, essentially verifying that a bug is still there.",FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,The ugly mirror,Tautological tests,occurs when the test code looks exactly like the code under test.,FALSE,FALSE,FALSE,FALSE
https://jasonrudolph.com/blog/testing-anti-patterns-how-to-fail-with-100-test-coverage/,Testing anti-patterns: How to fail with 100% test coverage,webpage,Test Smell,The ugly mirror,,"When you occasionally find yourself staring at a spec that looks exactly like the code under test, there’s surprisingly little win left to enjoy.",TRUE,TRUE,FALSE,TRUE
https://jasonrudolph.com/blog/2008/07/30/testing-anti-patterns-the-ugly-mirror/,Testing anti-patterns: The ugly mirror,webpage,Test Smell,The ugly mirror,,When you occasionally find yourself staring at a spec that looks exactly like the code under test,TRUE,FALSE,FALSE,FALSE
https://completedeveloperpodcast.com/anti-patterns-in-unit-testing/,Anti-Patterns In Unit Testing,webpage,Anti-pattern,There is too much setup to run the test cases,,Tests require an excessive amount of setup just to be able to run. This may be in the Arrange stage of the individual tests or in a setup method that runs before the tests. There can be hundreds of lines of code in some cases where there is too much setup needed. This makes it almost impossible to understand what is being tested because of all the extra in the setup.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Time Bomb Data,,"when testing with dates or times, and the choice of test data leads either to a test that starts to fail in the future, because the current date has changed to a point where the test data is wrong, or where the full range of relevant date variations is not covered, leading to a bug in the production code on certain days",FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,Time Bombs,,"Tests that fail due to ever-so-slightly different time values, during certain days of the week or month, or when a long-running time-sensitive test straddles two hours, days, weeks, months, or years and the code can't handle it.",TRUE,TRUE,FALSE,TRUE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Time Bombs,,"Because of poor date management, the test will fail erratically on certain dates (e.g., weekend days)",FALSE,FALSE,FALSE,FALSE
https://www.youtube.com/watch?v=VBgySRk0VKY,A testing anti-pattern safari,webpage,Test Smell,Time Sensitive Test,,Tests that only pass depending on the time of the day they are executed,TRUE,TRUE,FALSE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Too Many Tests,,There are so many tests that they are bound to take a long time to run regardless of how fast they execute.,FALSE,TRUE,FALSE,TRUE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Transcripting Test,,"A Transcripting Test is writing information to the console or a global stream, for example the Transcript in Smalltalk, while it is running.",TRUE,TRUE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Transcripting Test,,Test writing and logging to the console,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Transcripting Test,,A test that is printing and logging to the console,FALSE,FALSE,FALSE,FALSE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,Treating test code as a second class citizen,,test code is your safety net so take good care of it; most good code practices are transversal to any source code (e.g. avoid globals),FALSE,FALSE,FALSE,FALSE
http://blog.codepipes.com/testing/software-testing-antipatterns.html,Software Testing Anti-patterns,webpage,Anti-pattern,Treating test code as a second class citizen,,"Tests with huge code duplication, hardcoded variables, copy-paste segments and several other inefficiencies that would be considered inexcusable if found on the main code.",FALSE,TRUE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Two for the price of one,,sometimes a sign of missing parameterised tests – where a single test case is testing two use cases with the same set up,TRUE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Unclassied MethodCategory,,Methods not being organized by any method-category,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Unclassified Method Category,,A test method that is not organized by a method category.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Under-the-carpet Assertion,,Some assertions put into comments,FALSE,FALSE,TRUE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.9594,Assessing test quality ‐ TestLint,thesis,Test Smell,Under-the-carpet Failing Assertion,,"A test having the smell Under-the-carpet failing Assertion is a test that returns a successful test-result, but contains hidden assertions. A hidden assertion is an assertion that is put into comments, is not executed when the test runs, and which would actually throw an Error or Failure if the comment were removed.",TRUE,TRUE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Under-the-carpet failing Assertion,,Failing assertions put into comments,TRUE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Under-the-carpet Failing Assertion,,A test method that has failing assertions in the comments.,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Under-the-carpet Failing Assertion,,A test that has assertions in the comments,FALSE,FALSE,FALSE,FALSE
https://jasonrudolph.com/blog/testing-anti-patterns-how-to-fail-with-100-test-coverage/,Testing anti-patterns: How to fail with 100% test coverage,webpage,Test Smell,Underspecification,,"While it’s clearly possible for a test suite to do too much, it’s far more common for it to do too little.",TRUE,TRUE,FALSE,TRUE
https://dl.acm.org/doi/10.1145/3387940.3392189,An Exploratory Study on the Refactoring of Unit Test Files in Android Applications,paper,Test Smell,Unknown Test,,A test method that does not contain a single assertion statement and @Test(expected) annotation parameter,FALSE,TRUE,FALSE,TRUE
https://arxiv.org/abs/2107.13902,Developers perception on the severity of test smells: an empirical study,technical paper/manuscript,Test Smell,Unknown Test,,When a test method does not contain assertions. An assertion statement describes an expected condition for a test method,FALSE,FALSE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Unknown Test,,Test method without assertion,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3482909.3482915,Investigating Test Smells in JavaScript Test Code,paper,Test Smell,Unknown Test,,"A test method that does not contain assertions, so all executions will pass unless they raise an exception",FALSE,FALSE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9463091,"On the Distribution of ""Simple Stupid Bugs"" in Unit Test Files: An Exploratory Study",paper,Test Smell,Unknown Test,,A test method that does not contain a single assertion statement and @Test(expected) annotation parameter,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.5555/3370272.3370293,On the distribution of test smells in open source Android applications: an exploratory study,paper,Test Smell,Unknown Test,,"An assertion statement describes an expected condition for a test method. By examining the assertion statement, it is possible to understand the purpose of the test. However, It is possible for a test method to be written without an assertion statement, in such an instance JUnit will show the test method as passing if the  statements within the test method did not result in a thrown exception when executed.",TRUE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Unknown Test,,"Occurs when a test method is written without an assertion statement, which makes it difficult to understand the purpose of the test method",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Unknown Test,,A test method that does not contain a single assertion statement and @Test(expected) annotation parameter.,FALSE,TRUE,TRUE,FALSE
https://ieeexplore.ieee.org/document/9678615/,PyNose: A Test Smell Detector For Python,paper,Test Smell,Unknown Test,,Occurs when the test case has no assertion in it,FALSE,TRUE,TRUE,FALSE
https://testsmells.org/,Software Unit Test Smells,webpage,Test Smell,Unknown Test,,"An assertion statement is used to declare an expected boolean condition for a test method. By examining the assertion statement it is possible to understand the purpose of the test method. However, It is possible for a test method to written sans an assertion statement, in such an instance JUnit will show the test method as passing if the statements within the test method did not result in an exception, when executed. New developers to the project will find it difficult in understanding the purpose of such test methods (more so if the name of the test method is not descriptive enough).",TRUE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Unknown Test,,A test method without an assertion statement and non-descriptive name,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10664-021-09969-1,The secret life of test smells-an empirical study on test smell evolution and maintenance,article,Test Smell,Unknown Test,,A test method is written without an assertion statement.,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3368089.3417921,tsDetect: an open source test smells detection tool,paper,Test Smell,Unknown Test,,A test method that does not contain a single assertion statement and @Test(expected) annotation parameter,FALSE,FALSE,FALSE,FALSE
https://www.proquest.com/openview/17433ac63caf619abb410e441e6557f0/1?pq-origsite=gscholar&cbl=18750,What the Smell? An Empirical Investigation on the Distribution and Severity of Test Smells in Open Source Android Applications,thesis,Test Smell,Unknown Test,,"An assertion statement describes an expected condition for a test method. By examining the assertion statement, it is possible to understand the purpose of the test. However, It is possible for a test method to be written without an assertion statement, in such an instance JUnit will show the test method as passing if the  statements within the test method did not result in a thrown exception when executed.",TRUE,FALSE,TRUE,FALSE
https://mattarcherblog.wordpress.com/2010/11/29/how-test-automation-with-selenium-or-watir-can-fail/,How test automation with selenium can fail,webpage,Test Smell,Unnecessary Navigation,,"When the test has actions, taken for granted, not related to the things we want to check",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Unreachable default,,analt statement contains an else branch while a default is active.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Unreachable Default,,"An alt statement contains an else branch while a default is active. The else branch of an alt statement is taken if no other branch is applicable. If a default is active at the same time, its branches come after all branches of the alt statement. Hence the default altstep can never be executed if an else branch is present.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Unreachable Default,,An alt statement contains an else branch while a default is active.,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Unrepeatable Test,,The test changes its behaviour after its first execution. The two possible scenarios for this test smell are Fail-Pass-Pass and Pass-Fail-Fail,FALSE,FALSE,TRUE,FALSE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Unrepeatable Test,,A test behaves differently the first time it is run than how it behaves on subsequent test runs.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Unrestricted imports,,a module imports more from another module than needed,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Unrestricted Imports,,A module imports more from another module than needed.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Unrestricted Imports,,A module imports more than needed,FALSE,FALSE,FALSE,FALSE
https://ieeexplore.ieee.org/abstract/document/6299294,Bad smells and refactoring methods for GUI test script,paper,Test Smell,Unsuitable Naming,,"A keyword, macro component, macro event, or primitive component is not properly named, making the script difficult to understand.",FALSE,FALSE,FALSE,TRUE
https://books.google.com.br/books?hl=pt-BR&lr=&id=-izOiCEIABQC&oi=fnd&pg=PT19&dq=%22test+code%22+AND+(%22test*+smell*%22+OR+antipattern*+OR+%22poor+quality%22)&ots=YL71coYZkx&sig=s3U1TNqypvSAzSilSbex5lnHonk#v=onepage&q=%22test%20code%22%20AND%20(%22test*%20smell*%22%20OR%20antipattern*%20OR%20%22poor%20quality%22)&f=false,xUnit test patterns: Refactoring test code,book,Test Smell,Untestable Test Code,,The body of a Test Method is obscure enough or contains enough Conditional Test Logic to cause us to wonder whether the test is correct.,FALSE,TRUE,FALSE,TRUE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Unused definition,,a definition is never referenced,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Unused Definition,,Unused code should be removed. Note that only local definitions can be removed safely because they cannot be accessed from outside the defining unit. For global definitions there might exist references in modules which have not been considered.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Unused Definition,,A definition is never referenced,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Unused imports,,an import from another module is never used,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Unused Imports,,An import from another module is never used.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Unused Imports,,An import from another module is never used,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Unused Inputs,,Inputs that are controlled by the test,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Unused parameter,,"a parameter is never used within the declaring unit. For in-parameters, the parameter is never read, for out-parameters never defined, for inout-parameters never accessed at all",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Unused Parameter,,"A parameter is never used within the declaring unit. For in-parameters, the parameter is never read, for out-parameters never defined, for inout-parameters never accessed at all.",TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Unused Parameter,,"A parameter is never used within the declaring unit: in-parameters are never read, out-parameters are never assigned, inoutparameters are never accessed at all",FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Unused Shared-Fixture Variables,,Parts of the xture that are never used,FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Unused Shared-Fixture Variables,,Occurs when a piece of the fixture is never used.,FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Unused variable definition,DU data flow anomaly,a defined variable or in parameter is not read before it becomes undefined.,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Unused Variable Definition,DU data flow anomaly,A defined variable or in parameter is not read before it becomes undefined.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Unused Variable Definition,,An assigned variable or in-parameter is not read before it becomes undefined,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.108.3631&rep=rep1&type=pdf,Rule-based Assessment of Test Quality,article,Test Smell,Unusual Test Order,,Tests calling each other explicitly (unusual for unit tests),FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Unusual Test Order,,A test that is calling other tests explicitly,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Unworldly test data,,"where the test data is in a different style to real-world data e.g. time processing based on epoch milliseconds near 0, rather than on sensible timestamps that would be used in the real world",FALSE,FALSE,FALSE,FALSE
http://kaczanowscy.pl/books/bad_tests_good_tests.html,"Bad tests, good tests",book,Test Smell,Use Smart Values,,Tests pass when the scenario they test is not really fulfilled,TRUE,TRUE,FALSE,TRUE
https://blogs.sap.com/2013/02/14/abap-assertion-anti-patterns/,Abap assertion anti-patterns,webpage,Anti-pattern,Using Assertions as a Substitute for all Class-Based Exceptions,,"Though the line between when to use assertions instead of class-based exceptions can be blurry at times, I think a general rule of thumb here would be to use class-based exceptions in any situation where there is a chance of recovery. ",FALSE,FALSE,FALSE,FALSE
https://blogs.sap.com/2013/02/14/abap-assertion-anti-patterns/,Abap assertion anti-patterns,webpage,Anti-pattern,Using Assertions as a Substitute for all Defensive Programming Techniques,,"When developers get carried away with assertions, assuming that they are an across-the-board replacement for defensive programming techniques.",FALSE,FALSE,FALSE,FALSE
https://alisterbscott.com/2015/01/20/five-automated-acceptance-test-anti-patterns/,Five automated acceptance test anti-patterns,webpage,Test Smell,Using complicated x-path or CSS selectors,,"Using element identification selectors that have long chains from the DOM in them leads to fragile tests, as any change to that chain in the DOM will break your tests.",TRUE,FALSE,FALSE,FALSE
https://semaphoreci.com/blog/2014/01/14/rails-testing-antipatterns-fixtures-and-factories.html,Rails Testing Antipatterns: Fixtures and Factories,webpage,Test Smell,Using fixtures,,When a test uses fixtures to prepare and reuse test data on Rails,TRUE,TRUE,FALSE,TRUE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,Using the word “and” when describing a test,,"this hints that you should split the test in two, each asserting/verifying different things",FALSE,FALSE,FALSE,FALSE
https://exubero.com/junit/anti-patterns/,JUnit Anti-patterns,webpage,Test Smell,Using the Wrong Assert,,"There are a large number of different methods beginning with assert defined in the Assert class. Each of these methods has slightly different arguments and semantics about what they are asserting. However, many programmers seem to stick with a single assertion method: assertTrue, and then force the argument of this method into the required boolean expression.",TRUE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/6569744,Automated Detection of Test Fixture Strategies and Smells,paper,Test Smell,Vague Header Setup,,"A vague header setup smell occurs when fields are initialized in the header of a class, but not in implicit setup. We consider this a smell as the behavior of the code is not explicitly defined, and depends on the field modifier (static or member), as well as on the implementation of the test framework. Further, field declarations are not restricted to the header of a class, but can occur anywhere within the class. Vague header setups hamper code comprehension and maintainability.",FALSE,TRUE,FALSE,TRUE
https://ieeexplore.ieee.org/document/6624053,Strategies for avoiding text fixture smells during software evolution,paper,Test Smell,Vague Header Setup,,"A vague header setup smell occurs when fields are solely initialized in the header of a class. We consider this a smell as the behavior of the code is not explicitly defined and depends on the field modifier (static or member) as well as on the implementation of the test framework. Vague header setups might hamper code comprehension and maintainability, as fields can be placed anywhere in the class. Further, in many test frameworks exception messages are more expressive for fields initialized in the setup.",FALSE,TRUE,TRUE,TRUE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Vague Header Setup,,A field that is initialized in the class header but not explicitly defined in code.,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Verbless and Noun-full,,"when a test is named after the concept, but not after the intended behaviour it verifies – behaviour would normally use verbs",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477066,Handling Test Smells in Python: Results from a Mixed-Method Study,paper,Test Smell,Verbose Test,,Test method with many lines of code,FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3379597.3387453,Investigating Severity Thresholds for Test Smells,paper,Test Smell,Verbose Test,,A test that is too long and hard to understand,FALSE,TRUE,FALSE,FALSE
https://dl.acm.org/doi/10.1145/3350768.3350775,On the influence of Test Smells on Test Coverage,paper,Test Smell,Verbose Test,,"Occurs when the tests use a lot of code to do what they need to do. In other words, the test code is not clean and simple.",FALSE,FALSE,FALSE,FALSE
https://dl.acm.org/doi/abs/10.1145/3482909.3482916,On the use of test smells for prediction of flaky tests,paper,Test Smell,Verbose Test,,A test that is too long and hard to understand,FALSE,TRUE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3474624.3477070,Smart prediction for refactorings in the software test code,paper,Test Smell,Verbose Test,,"A test method with more than 30 lines. It may indicate that the method has several responsibilities, impacting the test method maintenance.",FALSE,FALSE,TRUE,FALSE
https://dl.acm.org/doi/10.1145/3463274.3463335,Test Smell Detection Tools: A Systematic Mapping Study,paper,Test Smell,Verbose Test,,Test code that is complex and not simple or clean.,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.649.6409&rep=rep1&type=pdf,TestQ: Exploring Structural and Maintenance Characteristics of Unit Test Suites,paper,Test Smell,Verbose Test,,Long test command bodies,FALSE,FALSE,FALSE,FALSE
https://medium.com/swlh/anti-patterns-of-automated-software-testing-b396283a4cb6,Anti-patterns of automated testing,webpage,Anti-pattern,Very similar test cases,,Copy-pasting many similar chunks of test code to add new test cases;,FALSE,TRUE,FALSE,TRUE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Wait and See,,A test that runs some setup code and the needs to “wait” a specific amount of time before it can “see” if the code under test functioned as expected. A test method that uses Sleep() or equivalent is most certainly a “Wait and See” test.,FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Wait and See,,"A test that runs some set up code and then needs to 'wait' a specific amount of time before it can 'see' if the code under test functioned as expected. A testMethod that uses Thread.sleep() or equivalent is most certainly a ""Wait and See"" test.",FALSE,FALSE,FALSE,FALSE
https://link.springer.com/article/10.1007/s10009-008-0075-0,An approach to quality engineering of TTCN-3 test specifications,article,Test Smell,Wasted variable definition,DD data flow anomaly,a variable is defined and defined again before it is read,FALSE,FALSE,FALSE,FALSE
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.144.6997&rep=rep1&type=pdf,Pattern-based Smell Detection in TTCN-3 Test Suites,thesis,Test Smell,Wasted Variable Definition,DD data flow anomaly,A variable is defined and defined again before it is read.,TRUE,TRUE,FALSE,TRUE
https://link.springer.com/chapter/10.1007/978-3-540-73066-8_16,Utilising Code Smells to Detect Quality Problems in TTCN-3 Test Suites,paper,Test Smell,Wasted Variable Definition,,A variable is assigned and assigned again before it is read,FALSE,FALSE,FALSE,FALSE
https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.696.5180&rep=rep1&type=pdf,Categorising Test Smells,thesis,Test Smell,Web-Browsing Test,,To be run the test needs to establish a connection to the internet.,FALSE,FALSE,TRUE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,"Well, My Setup Works",,"a test does not share enough of the setup code used in production, so the test setup can deviate from the production code meaningfully, or at best duplicates production code unnecessarily",FALSE,FALSE,FALSE,FALSE
https://digitaltapestry.net/testify/manual/AntiPatterns.html,Anti-Patterns - Digital Tapestry,webpage,Anti-pattern,Wet Floor,,"A test that fails to clean up after itself, leaving data persisted somewhere that causes another test, or the same test on subsequent runs, to fail.",FALSE,FALSE,FALSE,FALSE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,Wet Floor,"Sloppy worker, Generous leftovers","the test creates data that is persisted somewhere, but the test does not clean up when fin- ished. This causes tests (the same test, or possibly other tests) to fail on subsequent test runs",FALSE,FALSE,FALSE,FALSE
https://stackoverflow.com/questions/333682/unit-testing-anti-patterns-catalogue,Unit testing Anti-patterns catalogue,webpage,Anti-pattern,Wet Floor,,"The test creates data that is persisted somewhere, but the test does not clean up when finished. This causes tests (the same test, or possibly other tests) to fail on subsequent test runs.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,What are we Testing?,,"where the test data, or the way we produce it, is not self-explanatory for the use case. This is the general case of many of the below smells, but also includes how test data is represented in the code.",FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Wheel of fortune,,where random values in the test can lead to error – see also It Passed Yesterday,FALSE,FALSE,FALSE,FALSE
https://codingcraftsman.wordpress.com/2018/09/27/test-smells/,Test Smells - The Coding Craftsman,webpage,Test Smell,Where Does This One Go?,,"similar to the Curdled Test Fixture, this is caused by many tests having the same entry point into the software, even though they represent different use cases. It can be a symptom of using integration-level tests to test low-level things, or weakly defining the rules for each test fixture.",FALSE,FALSE,FALSE,FALSE
https://github.com/testdouble/test-smells,A workbook repository of example test smells and what to do about them,webpage,Test Smell,X-Ray Specs,,"A test that accesses or edits private, internal state of the subject that it shouldn't logically be privy to.",TRUE,TRUE,FALSE,TRUE
https://www.sciencedirect.com/science/article/abs/pii/S0164121217303060,Smells in software test code: A survey of knowledge in industry and academia,article,Test Smell,X-Ray Specs,,The test is routinely exploiting its ability to access private variables on the subject to do its assertions (when the prudent thing to do would be to design a public API so that the behavior of the sub- ject could be asserted without looking at its internal state),FALSE,FALSE,FALSE,FALSE
https://dzone.com/articles/unit-testing-smells-what-are-your-tests-telling-yo,Unit Testing Smells: What Are Your Tests Telling You?,webpage,Test Smell,You Do Weird Things to Get at the Code Under Test,,The use of reflection schemes to invoke and test private methods.,FALSE,TRUE,FALSE,FALSE