Selenium tests written using Junit are not running in order

Question

I executed some selenium scripts, but they are not running properly. Execution is taking the scripts randomly and start execution. I want to execute the scripts as per script order. Please tell me a solution for this.

For example the scripts' order is:

1. Loginpage (1)
2. Dashboard (2)
3. firstlink (3)
4. secondlink (4)
5. thirdlink (5)

Execution order:

1. firstlink (3)
2. Dashboard (2)
3. secondlink (4)
4. loginpage (1)
5. thirdlink (5)

How to execute these scripts in the proper order?

Answer 1

Two parts to this answer: First, to answer the question, there are many test runners. Some of them by default will run in a particular order, it may be the order they appear in code, or alphabetically, or some other order. There is often a way to tell the test runner to execute them in a particular order by providing some additional command line parameters, or altering the config. From your screenshot you're using junit, junit actually does not have a way to force the order of execution, see this for details: https://stackoverflow.com/questions/3693626/how-to-run-test-methods-in-specific-order-in-junit4

The second part is not directly answering the question, but is important and is also discussed in the linked answer from stackoverflow. You should avoid having tests that need to be run in a specific order. What if you want to execute only the last test, or debug the last test? Do you have to wait for all of the other tests to execute? What if one of the tests early in the chain fails, likely all of the rest of the tests will fail as well. What happens when you get a large suite of tests and you want to execute them in parallel? It is typically a best practice to have individual tests self contained and not relying on other other tests for the reasons outlined above.

Answer 2

There is no default provisioning in JUnit to do this the way you want. By using MethodSorters.NAME_ASCENDING you can ensure order by naming tests in alphabetical order as showed in other answer. Alternatively, you can create your own OrderedRunner and an annotation to fix this type of ordering.

public class OrderedRunner extends BlockJUnit4ClassRunner
{

  public OrderedRunner(Class klass) throws InitializationError
  {
    super(klass);
  }

  @
  Override
  protected List computeTestMethods()
  {
    List list = super.computeTestMethods();
    List copy = new ArrayList(list);
    Collections.sort(copy, new Comparator()
    {
      public int compare(FrameworkMethod o1, FrameworkMethod o2)
      {
        SeleniumMethodOrder order1 = o1.getMethod()
          .getAnnotation(SeleniumMethodOrder.class);
        SeleniumMethodOrder order2 = o2.getMethod()
          .getAnnotation(SeleniumMethodOrder.class);
        if(order1.order() == order2.order())
        {
          return 0;
        }
        else if(order1.order() > order2.order())
        {
          return 1;
        }
        else
        {
          return -1;
        }
      }
    });
    return copy;
  }
}

This makes use of an annotation that is created as below

@java.lang.annotation.Target(value = {java.lang.annotation.ElementType.METHOD})
@ java.lang.annotation.Retention(value = java.lang.annotation.RetentionPolicy.RUNTIME)
public@ interface SeleniumMethodOrder
{
  public abstract int order() default 1;
}

Now you can write tests as shown below and provide order for them...

@RunWith(OrderedRunner.class)

public class StorageServiceWdTest extends WebDriverTestBase {


    @Test
    @SeleniumMethodOrder(order = 1)
    public void testDeleteFile() {
        logger.info("adding file");
    }


    @Test
    @SeleniumMethodOrder(order = 2)
    public void testAddFile() {
        logger.info("adding file");
    }

    @Test
    @SeleniumMethodOrder(order = 3)
    public void testMoveFile() {
        logger.info("moving file");
    }
}

This will ensure that the tests will always run the given order parameter of SeleniumMethodOrder annotation.

Source: http://neopatel.blogspot.in/2013/06/junit4-custom-method-order-or-custom.html

Answer 3

There is a new method you could use which is the @FixMethodOrder(MethodSorters.NAME_ASCENDING) and place this outside of your class, e.g.

@FixMethodOrder(MethodSorters.NAME_ASCENDING)

public class HowDoIRunMyTestsInOrderIWant {
public static ChromeDriver chrome;

@BeforeClass
public static void launchBrowser(){
some code goes in here

    }

@Test
public void aLogIn(){
your code = chrome.findElement.blahblah
}
@Test
public void bAnotherTest(){
some code in here
}

So by naming them in an alphabetical order they will run as you wish.

Hope it helps you.