What is Automated Testing?

Automated Testing is a comprehensive testing methodology that includes both field and laboratory based testing.  Rather than performing time consuming, inefficient manual testing, automated testing solutions integrate carrier test scripts with test automation technology. Automated testing of device features, functionalities, and capabilities result in considerable cost benefits for device manufacturers, test vendors and carriers.

Organizations such as GCF, CCF, CTIA, CDG etc. have developed test plans which utilize both lab and live modes of testing. Lab testing can test scenarios such as E911 call processing, System Acquisition, and Roaming (domestic and international) which cannot be either fully or economically tested by field testing alone. Lab based testing provides an accurate benchmark for field testing and provides an insight about how the device will perform.


What are the advantages of Automated System Acquisition Testing in a lab environment?
A test plan that includes both automated lab testing and field testing can provide the following benefits:

• System acquisition testing that reduces roaming errors by 5% can result in a savings of $92 million based on a U.S. industry wide cost of $1.8 billion dollars
• On a per model basis, launching handset into the market 1 week earlier, results in a savings of $1 million per handset. A company launching 25 new handsets a year can realize of over $25 million in savings per year.
• Carriers have reduced field testing to a single round based on pre testing in the lab. This can result in a savings of $1,000,000 per year.
• Proof of comprehensive testing for E911 call processing has been used as a successful affirmative defense during civil suits.

Automated System Acquisition lab testing has been proven to provide a cost effective method of device testing.

• A large U.S. carrier improved system determination testing from 12 tests in 6 hours to 50 tests in 3 hours via unmanned automated testing.
• In the same testing lab, testing workload has expanded by more than a factor of 10 times without additional test personnel through the use of automation.

The controlled and consistent nature of lab based testing can be advantageous in providing specific testing conditions that may or may not be available in the live environment .Conditions that may be transient in the field can be reproduced to not only allow for initial testing, but also provide an environment in which a failure can be reproduced for root cause analysis. Lab testing also allows testing when access to a live network is not possible. All of these factors can expedite the acceptance of a device and bring it to market faster resulting in increased revenues.

With a comprehensive test program that includes both lab and field testing, device performance can be fully vetted and verified. This results in providing the customer with a properly functioning device and service at the lowest possible cost.