Selecting the similar cells in Excel using Sikuli

Question

I am automating a webpage using Selenium but there is one scenario where after clicking on a button, it opens up an Excel sheet. I need to enter a value in the cell of the Excel sheet. I am using Sikuli (in Eclipse) to do that but the header name of the cell is not unique. (Please refer the screenshot)

I am trying to enter the value in the cell highlighted in red box.

I tried the below code (in Eclipse) but it is clicking the wrong cell.

Screen s = new Screen();    
Pattern p = new Pattern("images/Cell.png");
s.find(p);
s.click(p);

Cell.png is as below:

Answer 1

After your code get executed it will click on some point in the Excel sheet. Then use keyboard key pressing to navigate to the correct cell. Then enter the values .

Answer 2

You can use Python scripting to solve this and use the findall method of the Region object. This gives you a list of all matching images and then you can click/fill only the second occurrence.

Answer 3

For the reference I am giving the 3rd option That I tried and worked for me in addition to the 2 answers given by @timfredo & @chathuD.

I included the nearby cells to make the Cell.png unique. refer the screenshot below.

Previously Cell.png was as follows:

To make Cell.png unique I changed it to the below:

Now to click on the desired cell I used the following code.

Screen s = new Screen();    
Pattern p = new Pattern("images/Cell.png");

/*This will highlight the selected area for 3 seconds.*/
s.find(p).below(25).right(-200).left(5).highlight(3);

s.find(p).below(25).right(-200).left(5).click();