Device and browser tests
AWS Device Farm tests mobile and web applications on physical phones and tablets hosted by AWS. It also runsA specific app build and set of tests to execute on a set of devices. SeleniumA testing framework that uses scripts to control a browser and simulate user interactions. tests on hosted desktop browsers. Selenium is a framework for scripts that control a browser and simulate user actions.
How it works
- For automated mobile testing, upload the app and tests. Select a device poolA collection of devices that usually share characteristics such as platform or model., a collection of devices with shared characteristics.
- A run combines a specific app build, tests and devices. It contains jobsA request to test one app against one device., each testing one app on one device.
- Device Farm executes tests in parallel on available devices and produces a report with results, logs, screenshots and test artifactsA record such as a log or recording produced during a test.. Video recording can be enabled for a run.
- For interactive debugging, use remote access to a physical device in a browser. Alternatively, run local AppiumAn open-source tool for automating native and mobile web applications. tests against a managed endpoint. Appium is a tool for automating native and mobile web applications.
Exam cues
- If the question says test an app on physical mobile devices in parallel, think Device Farm automated testing, because it runs uploaded tests on managed devices.
- If the question says reproduce a mobile issue manually on a specific device, think Device Farm remote access, because it provides interactive access.
- If the question says run Selenium tests across desktop browsers, think Device Farm desktop browser testing, because it hosts browser instances and records videos and logs.
- If the question says test Android or iOS without writing scripts, think the Device Farm built-in fuzz testA test that sends random user interface events to a device and reports the results., because it sends random user interface events and reports results.
Remember
- Device Farm is available in US West (Oregon),
us-west-2. - Uploaded apps and files are retained for 30 days; run results, logs and screenshots are retained for 400 days.
- The console’s default per-device job timeout is 150 minutes.
- Service-side test execution can be used from an automated software release pipeline.
- Supported mobile frameworks include Appium and Android Instrumentation for Android, and Appium, XCTest and XCTest UI for iOS.
Trap: A Device Farm job tests one app on one device. A run can contain multiple jobs and devices.
From the AWS docs (18)
- AWS Device Farm tests Android, iOS and web apps on real physical phones and tablets hosted by AWS.
- Device Farm is available in the US West (Oregon) Region, us-west-2.
- Remote access allows interactive use of a device in a browser or local Appium testing through a managed endpoint.
- Device Farm runs uploaded app tests on multiple devices in parallel in a managed test environment.
- Automated test reports include results, logs, screenshots and test artifacts.
- A run combines a specific app build, test set and device set and contains one or more jobs.
- A job tests one app against one device.
- A device pool is a collection of devices that typically share characteristics such as platform, manufacturer or model.
- Device Farm desktop browser testing runs Selenium tests on AWS-hosted desktop browsers in parallel and produces videos and Selenium logs.
- Device Farm offers a built-in fuzz test for Android and iOS that does not require the user to write test scripts.
- The Device Farm built-in fuzz test sends random user interface events to devices and reports results.
- Selenium is a testing framework that uses scripts to control a web browser and simulate user interaction.
- Device Farm supports Appium and Android Instrumentation for Android tests, and Appium, XCTest and XCTest UI for iOS tests.
- Appium is an open-source tool for automating native and mobile web applications.
- Device Farm stores uploaded apps and files for 30 days and run results, logs and screenshots for 400 days.
- The Device Farm console defaults the per-device job timeout to 150 minutes.
- The Device Farm console offers an option to enable video recording during a test run.
- Service-side execution can be used to run Device Farm tests from a CI/CD pipeline.
Flashcards
Nothing to review here right now. Pick other topics or another filter.
·
All 8 cards as a list
What does AWS Device Farm provide for mobile application testing?
Testing on AWS-hosted physical phones and tablets, including automated tests and interactive remote access.
A team needs to run Selenium tests on multiple desktop browsers in parallel. Which AWS Device Farm feature fits?
Device Farm desktop browser testing. It also produces videos and Selenium logs.
A release pipeline needs automated tests for an app on multiple physical mobile devices. How can AWS Device Farm help?
Run Device Farm tests from the pipeline using service-side execution. Tests can run in parallel on managed devices.
How can AWS Device Farm help a team inspect the outcome of automated mobile app tests?
It provides test reports with results, logs, screenshots and artifacts.
Can AWS Device Farm test an Android or iOS app without a user-written test script?
Yes. Its built-in fuzz test does not require one.
A team wants to test an Android app on several physical devices at once without managing the devices. Which AWS service fits?
AWS Device Farm runs uploaded tests in parallel on managed physical devices.
A team needs automated Selenium tests across hosted desktop browsers. Which AWS service supports this?
AWS Device Farm runs Selenium tests in parallel on hosted desktop browsers.
A team wants to test an iOS app without writing test scripts. Which AWS Device Farm test can it use?
Use the built-in fuzz test. It sends random user interface events and reports the results.