The document compares JUnit and TestNG, two popular testing frameworks for the Java programming language, emphasizing their design goals, features, and functionalities. It discusses various concepts such as suites, fixtures, assertions, parameterization, and listeners, providing an overview of their differences and capabilities. Additionally, it includes resources for further exploration of both frameworks and related libraries.

1. TestNg vs. JUnit
Speaker: Andrey Oleynik
Date: 26/12/2016

2. About me
Andrey Oleynik
• About 9 years of work in Quality
Assurance area
• Senior QA Automation Engineer
• PhD, Theoretical physics
2

3. TestNG vs. JUnit, what do you think?
3

4. Agenda
• JUnit
• TestNG
• Suites
• Fixtures
• Assertions
• Soft Assertions
• Hamcrest
• Ignore
• Timeout
• Exception
• Parameterization
• Grouping
• Dependencies
• Listeners
• Reporters
• Parallelization
4

5. • JUnit is a unit testing framework for the Java
programming language. JUnit has been
important in the development of test-driven
development, and is one of a family of unit
testing frameworks which is collectively
known as xUnit that originated with SUnit.
5

6. • TestNG is a testing framework for the Java
programming language created by Cédric
Beust and inspired by JUnit and NUnit. The
design goal of TestNG is to cover a wider
range of test categories: unit, functional, end-
to-end, integration, etc., with more powerful
and easy-to-use functionalities.
6

7. JUnit Suites
7

8. TestNG Suites (testing.xml)
8

9. JUnit Fixtures
• @BeforeClass setUpClass (static)
• @Before setUp
• @Test test1()
• @After tearDown
• @Before setUp
• @Test test2()
• @After tearDown
• @AfterClass tearDownClass (static)
9

10. TestNG Fixtures
• @BeforeMethod
• @AfterMethod
• @BeforeClass
• @AfterClass
• @BeforeTest
• @AfterTest
• @BeforeGroups
• @AfterGroups
• @BeforeSuite
• @AfterSuite
10

11. JUnit Asserts
• assertEquals
• assertTrue
• assertFalse
• assertNull
• assertNotNull
• assertThat
• assertArrayEquals
• assertSame
• fail
11

12. JUnit Asserts
• assertEquals(java.lang.Object expected, java.lang.Object actual)
• assertEquals(java.lang.String message, java.lang.Object
expected, java.lang.Object actual)
• fail()
• fail(java.lang.String message)
• …
12

13. TestNG Asserts
• assertEquals
• assertEqualsNoOrder
• assertFalse
• assertNotEquals
• assertNotNull
• assertNotSame
• assertNull
• assertSame
• assertThrows
• assertTrue
• expectThrows
• fail
13

14. TestNG Asserts
• assertEquals(java.lang.Object actual, java.lang.Object expected)
• assertEquals(java.lang.Object actual, java.lang.Object expected,
java.lang.String message )
• fail()
• fail(java.lang.String message)
• fail(java.lang.String message, java.lang.Throwable realCause)
• …
14

15. TestNG Soft Asserts
15

16. JUnit Soft Asserts
16

17. JUnit Hamcrest
17

18. TestNG Hamcrest
18

19. JUnit (Timeout, Ignoring)
• Timeout for tests
• Ignoring tests
19

20. TestNG timeOut
• Timeout for particular tests
• Timeout for suites
20

21. TestNG test Ignoring
• Ignore a test
• Throw SkipException
• Exclude test
21

22. JUnit exception testing
22

23. JUnit exception testing (with @Rule)
23

24. TestNG exception testing
24

25. JUnit parameterization
25

26. JUnit parameterization
26

27. TestNG parameterization
27

28. TestNG parameterization
28
• @Parameters
• @DataProvider

29. JUnit parameterization (JUnitParams)
29

30. JUnit parameterization (junit-dataprovider)
30

31. JUnit parameterization (junit-dataprovider)
31

32. JUnit categories
32

33. TestNG groups
33
• Groups of Methods
• Groups of Classes
• Group of Groups

34. JUnit dependencies
34

35. TestNG dependencies
35
• dependsOnMethods
• dependsOnGroups

36. JUnit RunListener
36

37. TestNG listeners
37
ITestListener
• onStart
• onTestSuccess
• onTestFailure
• onTestSkipped
• onTestFailedButWithinSucces
sPercentage
IInvokedMethodListener
• beforeInvocation
• afterInvocation

38. TestNG listeners (how to include)
38

39. TestNG listeners
39
IExecutionListener
onExecutionStart()
onExecutionFinish()
ISuiteListener
onStart
onFinish
IReporter
generateReport

40. JUnit parallelization
40

41. TestNG parallelization
41
Maven plugin
The suite tag has parallel and
thread-count attributes
@Test has threadPoolSise
attribute

42. More details about JUnit
• Official Website: http://junit.org/junit4/
• Assert: http://junit.org/junit4/javadoc/latest/org/junit/Assert.html
• Junit Wiki on GitHub: https://github.com/junit-team/junit4/wiki
• JUnit Tutorial (Mkyong.com) http://www.mkyong.com/tutorials/junit-tutorials/
• RunListener:
http://junit.sourceforge.net/javadoc/org/junit/runner/notification/RunListener.html
• How to implement RunListener a JUnit Listener example:
http://memorynotfound.com/add-junit-listener-example/
42

43. More details about some additional libs
• AssertJ http://joel-costigliola.github.io/assertj/index.html
• Hamcrest http://hamcrest.org/JavaHamcrest/
• The Benefits of Using assertThat over other Assert Methods in Unit Tests
https://objectpartners.com/2013/09/18/the-benefits-of-using-assertthat-over-other-assert-
methods-in-unit-tests/
• Hamcrest matchers tutorial https://www.javacodegeeks.com/2015/11/hamcrest-matchers-
tutorial.html
• JUnitParams: https://github.com/Pragmatists/JUnitParams
• junit-dataprovider: https://github.com/TNG/junit-dataprovider
43

44. More details about TestNG
• Official Website: http://testng.org/doc/documentation-main.html
• Assert: http://testng.org/javadocs/org/testng/Assert.html
• ITestListener: http://testng.org/javadocs/org/testng/ITestListener.html
• IInvokedMethodListener:
http://testng.org/javadocs/org/testng/IInvokedMethodListener.html
• TestNG Listeners Example: https://examples.javacodegeeks.com/enterprise-
java/testng/testng-listeners-example/
• TestNG Tutorial (Mkyong.com) http://www.mkyong.com/tutorials/testng-tutorials/
44

45. Questions

46. Thank you!