Rather than argue over the definition of staging, consider asking (1) what goals your staging environment needs achieve and (2) whether the approach you described meets those goals.
Random people on the Internet can't answer those questions for you; you and your organization need to decide them for yourself.
Before anything, I would recommend you to think about an important point:
What is the main purpose behind your test?
Try to define your SLO/SLIs first (KPIs).
For example if the KPI is "throughput", then you need to think about what should be your scaling policy and allow Autoscaling to do the Adding/Removing instance job for you.
Obviously you can ...
Improving quality through automation in AWS
There are many opportunities for adding value and improving quality by using automation within the AWS ecosystem. This continues the quality software path from Manual Testing to Automated Scripts to Infrastructure As Code. Automation in AWS provides rich new areas of learning and practice for an automation ...
I think you got your base assumption wrong, DevOps is not a silo skill and profession that you either have or not, belong to or don't.
Knowing how to use AWS cloud, Docker, Kubernates or Google cloud is something you will use as a test engineer even before you start developing automation.
Is it mandatory ? obviously not, but you and your career will greatly ...
It looks like you need to perform a stress test
Example steps I would take:
Assess which network protocol(s) is(are) in scope, i.e. how the streaming is implemented
Choose a load testing tool which support this(these) protocol(s)
Implement test scenario by replicating the network footprint of the real user using a real browser (or an application) listening ...
Nowadays it is more around DevOps and would recommend that you work out on the following:
Cloud Practitioner: Best one for a starter course
Architect Associate: Good for a QA or Test resource
Developer Associate: Gives you good in-depth knowledge on how to manage services and link up the integrations
Security Specialty: Once you have finished the above ...
SikuliX automates anything you see on the screen of your desktop computer running Windows, Mac or some Linux/Unix. It uses image recognition powered by OpenCV to identify and control GUI components. This is handy in cases when there is no easy access to a GUI's internals or the source code of the application or web page you want to act on.
This is really easy if the use of the AWS JDK is an option for you. I tried many hours to generate my own signature for REST API access to AWS. After I discovered the AWS JDK it was a matter of minutes. All can be done with a few lines of groovy script code within ReadyAPI/SoapUI NG.
Download, install, configure AWS CLI. (why this? If you configure ...
All AWS API requests has to be signed, the signature needs to be calculated on your side, you cannot extract it from the previous response, you need to generate it.
Check out Signing AWS API Requests for more details.
In JMeter you can use JSR223 PreProcessor to create the request signature according to the above algorithm and use the value as the ...
I would say it very much depends on your test purposes.
If you want to test the performance of your application, then you need to define some SLO/SLIs with the help of your product people. Only then you would know on what type of machines, what should be expected.
If it is a functional test, I go with a small instances to save money and if I see it is ...
I found the solution to this myself. For anyone who's having the same issue:
What I did wrong was I used driver = new ChromeDriver(options); in my code instead of driver = new RemoteWebDriver(new URL("http://my.aws.ip:4444/wd/hub"), options);
After making this change, I downloaded selenium-server-standalone.jar to in EC2.
Then, before starting the ...
To track the delivery status of text messages sent via AWS SNS, you can use Delivery status logging feature which will log delivery status as success/failure. You can view logs in CloudWatch.
For detailed steps on how to configure, refer to https://aws.amazon.com/premiumsupport/knowledge-center/monitor-sns-texts-cloudwatch/
You can save 90% of the time if you just use testRigor instead of Appium. It runs in the cloud and all you need to do to kickoff new tests is just to upload (via UI or API) a new version of your app.
Disclaimer: I'm a co-founder of testRigor.
From your question I see that you want to make a smoke test on a production system. Testing on production could be very risky in some scenarios. So there are few questions that you should analyze:
Do you change the state of the system accessed only with specific
user or they will be available to all prod users? If the data is
available to prod users for me ...
I like to answers questions with questions during interviews.
My first response would be that the question "How to test AWS?" is very broad.
My first question would be: Which part of AWS should I test?
As of 2020, AWS comprises more than 175 products and services
including computing, storage, networking, database, analytics,
application services, ...
I did a Cost-Benefit-Analysis a few years ago (so take it with a grain of salt) and found
AWS Device Farm - Worked really well for Android but didn't screen record iOS runs and the remote control mode was really laggy.
Xamarin Cloud - Worked well but was expensive and instrumenting was a chore. I don't recall a remote control mode.
TestObject - Had ...
There are two issues you need to think about;
You are running on headless mode, so there should be no visible Chrome window. You may need to disable it.
If the Jenkins initiated the job; you can see the Chrome window, only if you VNC with Jenkins user, not another account/user.
Selenium allows us to take screenshots of the browser viewport, even if the browser is running in headless mode.
We can use that functionality to generate a video recording.
After all, a video is just a set of frames.
Taking a screenshot with Selenium is easy:
Source - Liviu Lupei
The article continues on ...
You can generate this SRP_A value using suitable JSR223 Test Element and Groovy language.
Here is example code you can use as it is or as a reference:
Unfortunately the 'answer' is that you need to learn a lot more.
You have been given an assignment that will likely require several hundred hours of study for someone not familiar with those products. Be aware of this.
The steps I would consider taking:
Get your free for a year aws account
Learn how to use aws lambda - videos, books, classroom, labs, etc....
Since you are running selenium, I am guessing you are using python for your scripts. If that is the case then boto3 is the way to go. https://boto3.readthedocs.io/en/latest/guide/ec2-example-managing-instances.html
With this you can easily check the current state and start it if it is off.
You will need to set up aws sdk keys http://docs.aws.amazon.com/...
For a streaming application image-based testing (e.g. Sikuli) is probably the only way you can test it with automation. This as the probably only the image is send to the view and the mouse and keyboard clicks. There are a couple of tools that can do this.
I would do your full regression testing like this. It might be a lot of maintenance on the tests, as ...
Most of your questions are answered in the AWS device farm FAQ:
Q: My app makes use of location services. Can I specify the physical
location of the device?
Yes, you can supply latitude and longitude coordinates that will be
used to override a device’s GPS.
Q: Can I make phone calls or send SMS from the devices?
No, devices do not have ...
We are not telepathic enough to guess why exactly your script works on one machine and doesn't work on another. The reason is something different, where "something" could be:
external files used in i.e. CSV Data Set Config
application unavailability from one of the locations
Okay, so I really was stuck and I couldn't figure it out; so I decided to try something different.
I disabled the docker image holding my Jenkins instance and instead loaded up my Apache2 Web server and installed Jenkins via:
sudo apt-get install jenkins
This immediately set up jenkins with a user on the AWS Ubuntu install.
I found out that, while on ...