As the TAE, you are working with the organisation's Test Manager to decide which external metrics and which internal metrics should be gathered for the new TAS.

Which of the following represents the BEST internal metric that would help measure the quality of the TAS and the number of problems associated with the TAS?

Which of the following CORRECTLY describes how automation SHOULD be applied to confirmation testing?

If you are tracking the frequency that a test automation code reports a defect that is not really a defect, what metric are you gathering?

You are evaluating several test modelling tools and are wanting to automatically generate test cases within the tool where many different combinations of input data are created.

You are then wanting to export the test cases into a csv file which can then be read by a functional test execution tool using a data-driven or keyword-driven scripting method.

You have investigated several tools and there is only one tool that provides all the necessary features defined by your team with the exception of the export facility. It does not provide an export into either .xls or .csv formats.

What would be the BEST next step regarding the selection of this tool?

You have been asked to determine a TAS for a new release of a SUT, test should be automated wherever. The new release will consist of 5 new interfaces and an amendment to 3 existing interfaces. The new and amended interface will be deliver incrementally in 3 sprints, each lasting 2 weeks.

What would be the BEST Test Automation Solution (TAS) design in this scenario?

When if the BEST time for automation to consider legal and/or standard requirements for a SUT?

You are using a gTAA to create a TAS for a project. The TAS is aimed at automatically and executing test cases based on a use-case

Modeling approaching that uses UML as a modeling language. All the interaction between TAS and SUT will only be at the API and GUI level.

Which of the following components of the gTAA would you EXCLUDE from the TAS?

When the SUT provides interfaces that can then be used to perform actions on the SUT, what is this called?

SELECT ONE OPTION

Which of the following statements does NOT describe good practice for maintaining the TAS?

Consider a TAS that uses a keyword-driven framework. The SUT is a web application and there is a large set of keywords available for writing the automated tests that relate to highly specific user actions linked directly to the GUI of the SUT. The automated test written with the keywords are statically analyzed by a custom tool which highlight’s repeated instances of identical sequence of keywords. The waiting mechanism implemented by the TAS for a webpage load is based on a synchronous sampling within a given timeout. The TAS allows checking a webpage load every seconds until a timeout value

You are testing a major enhancement to an air traffic control user interface. You have use of a sophisticated pre-production test environment, created specifically for large scale automated regression, performance and security testing. The window for regression testing is limited and

must successfully conclude, with no major regressions remaining, before the non-functional testing starts.

You have been using the same version of the TAS for the last few releases, each time completing the automated regression test suite in a single overnight run. However, due to the latest enhancements for the SUT, you believe there is a risk that the test suite may no longer complete

overnight and therefore delay performance and security testing.

Which option would be the BEST and MOST cost-efficient approach to mitigate this risk?

New features have been added for the current release of a SUT.

Which action would NOT be appropriate for the TAE to perform when evaluating the impact on the TAS?

Which of the following describes how a test execution report is likely to be used?

Consider a TAS that is going to be deployed for the first time. The TAS requires share resources and run it its own test environment. The infrastructure for the TAS has been created along with maintenance procedures. It is very unlikely the TAS will be required to work in other target

Environments. There is a high-risk that when the TAS is deployed in its own test environment, a number of existing application will no longer work because of conflicts with the existing shared resources.

Which of the following activities would you expect to be MOST effective at mitigating the risk associated with the first deployment of the TAS?

A regression test suite consist of 500 test cases which are all executed manually. The business case for a pilot project is based on the adoption of test automation using a commercial tool that will reduce the execution time by a factor of 90% for 100% of the tests in the regression test suite. The pilot project lasted one month ( as planned) and you are currently its results. At the end of the pilot project, 40% of the regression tests have been automated and their execution time has been reduce by 60%.

Which of the following statements is TRUE in this scenario?

A TAS uses a commercial test automation tool and the default logs generated by the inconsistent formats such as different types of messages (pass/fail steps, screenshots, warnings, etc.) To solve this issue some custom logging functions have been created from the test scripts, making it possible to log the different types of messages with the same format. However, this may cause a problem due to excessive size of the logs which can make it difficult to find the required information. Assume that all the default logs will be disabled when running the automated tests and that some tests will not generate excessively sized logs.

Which of the following represents the BEST suggestion for implementing the custom logging functions?

A defect in a SUT has been resolved and validated by an automated defect re-test in the current release of the software. This retest has now been added to the automated regression test suite.

Which statement BEST describes a reason why this defect could re-occur in future releases?

What are the four horizontal layers of the gTAA?

You are currently designing the TAA of a TAS. You have been asked to adopt an approach for automatically generating and executing test cases from a model that defines the SUT. The SUT is a state-based and event-driven that is described by a finite-state machine and exposes its functionality via an API. The behavior of the SUT depends on hardware and communication links that can be unreliable.

Which of the following aspects is MOST important when designing the TAA in this scenario?

Which of the following attributes should NOT be included in a test execution report associated with a suite of automated tests?

Your functional regression test automation suite ran successfully for the first two sprints and no failures were encountered during the runs. The automation suite records the status of each test case as either 'pass' or 'fail' and has excellent recovery capability built in.

For the third sprint, the TAS log reported several test cases with a status of 'fail'. You investigated each test case and found that most failures were due to a defect in one of the keyword scripts, rather than in the SUT. For those where the failure was in the SUT, defect reports were raised but several were returned by the developers asking for more information to enable them to reproduce the problem.

Which additional log items SHOULD you add to the TAS that would BEST improve failure analysis and defect reporting for future sprints?

a) Dynamic measurement information about the SUT.

b) A status of TAS error’, in additional to pass' and 'fail', for each test case.

c) Use of a colour coding scheme so that 'pass’ is in red and fail' is in green.

d) A counter to determine how many times each test case has been executed.

e) System configuration information including software/firmware and operating system versions.

f) A copy of the source code for all Keyword scripts executed.

If model-based testing has been selected for the overall test automation approach for a project, how does that influence the layers of the TAA?

Consider a TAS deployed into production. The SUT is a web application and the test suite consists of a set of automated regression tests developed via GUI. A keyword-driven framework has been adopted for automating the regression tests. The tests are based on identification at low-levels of the web page components (e.g class indexes, tab sequence indexes and coordinates) in the next planned release the SUT will be subject to significant corrective maintenance (bug-fixes) and evolution (new features) Maintenance costs to update the test scripts should be as low as possible and the scripts must be highly reusable.

Which of the following statements is most likely to be TRUE?

You are the TAE for an Agile project which has six sprints for the current release. Sprint five is underway and the automated regression suite is due to start later today.

You have re-examined the results from the automated regression runs for the past four sprints. You notice that two test cases both reported a pass for sprints 1 and 4 but a fail for sprints 2 and 3. The failures have gone undetected and are therefore unexplained. Both test cases are closely coupled with other tests in the suite.

What course of action SHOULD you take?