ISTQB CTAL TM 2012

1.

TM-1.2.1 (K4) Analyze the test needs for a system in order to plan test activities and work products that will achieve the test objectives Question: You are the Test Manager working on a project developing a tourist information mobile application. The project recently switched to an agile process and test driven development. Each development cycle lasts 15 days, with daily builds beginning at day 7. After day 10, no new features are allowed to be added. The development team is composed of very experienced team members, who are proud of their work, but not tolerant of the testing team. The requirements are written down as coarse grained user stories like the following one: US 03-30: Search nearest matching hotel As a casual user at an unfamiliar location I want to get information on the nearest hotel matching my financial and comfort profile best. Priority: High; Estimate: 7 (out of 10) The software depends on existing web services, which are stubbed during development . Unit testing is done by developers, while system and user acceptance testing is the testing team’ s responsibility. System test in earlier development cycles was often blocked due to severe failures of newly developed features. Analysis shows that many of these failures could have been found during unit test. Analysis of issues found during production show that 30% of performance problems were due to unreliable web services delivered by 3rd party suppliers. Primary test objectives are to mitigate the perceived performance risks and to increase the confidence that no failures with high severity will occur in user stories with priority >= High. Moreover, upper management demanded for closer cooperation of testers and developers. Which THREE of the following test activities and/or work products will achieve the test objectives best.

A.

Automated performance testing of user stories with priority >= High done by testers during system test with test execution starting on day 10
B.

Joint informal reviews of unit tests done by developers and testers before day 10
C.

Identification of external web services and enforcement of service level agreements (SLAs) with service provider done by project management and test management
D.

Performance tests for user stories with priority = Very High done by developers during unit test before day no.10
E.

Metrics suite for unit testing defined by and reported to test management at day 7
F.

Integration test level plan defined by test manager before each development cycle and handed over to developers on day 10
G.

Approval of detailed design specifications by inspections done by the test team before day 7, when the daily builds begin

Correct Answer(s)
A. Automated performance testing of user stories with priority >= High done by testers during system test with test execution starting on day 10
B. Joint informal reviews of unit tests done by developers and testers before day 10
C. Identification of external web services and enforcement of service level agreements (SLAs) with service provider done by project management and test management

Explanation
Correct: Performance. tests have to be conducted; system not stable before day 10.
Correct: To reduce blocking failures after unit test and to improve communication between developer and tester.
Correct: 30% of performance issues are reported in relationship to web services . These (or some of them) may be due to undefined SLA.
Incorrect: Performance. tests are OK, but the 30% issues will only be found on system level with real services used.
Incorrect: Unit testing is under the hood of development.
Incorrect: There is no integration test level.
Incorrect: TDD starts with unit test case design; in agile processes normally there are no detailed design specifications.

Rate this question:

2.

TM-1.3.1 (K3) Use traceability to check completeness and consistency of defined test conditions with respect to the test objectives, test strategy, and test plan Question: You are the Test Manager working on a project developing a tourist information mobile application. The project recently switched to an agile process and test driven development. Each development cycle lasts 15 days, with daily builds beginning at day 7. After day 10, no new features are allowed to be added. The development team is composed of very experienced team members, who are proud of their work, but not tolerant of the testing team. The requirements are written down as coarse grained user stories like the following one: US 03-30: Search nearest matching hotel As a casual user at an unfamiliar location I want to get information on the nearest hotel matching my financial and comfort profile best. Priority: High; Estimate: 7 (out of 10) The software depends on existing web services, which are stubbed during development . Unit testing is done by developers, while system and user acceptance testing is the testing team’ s responsibility. System test in earlier development cycles was often blocked due to severe failures of newly developed features. Analysis shows that many of these failures could have been found during unit test. Analysis of issues found during production show that 30% of performance problems were due to unreliable web services delivered by 3rd party suppliers. Primary test objectives are to mitigate the perceived performance risks and to increase the confidence that no failures with high severity will occur in user stories with priority >= High. Moreover, upper management demanded for closer cooperation of testers and developers. The following exit criteria for acceptance testing have been specified: AC 1: Software response time <= 3 sec for up to 1,000 simultaneous requests of user stories with priority = Very High AC 2: Software response time <= 1 0 sec for up to 10,000 simultaneous requests of user stories with priority >= High AC 3: No severe failure in system and user acceptance test of user stories with priority >= High AC 4: All user stories covered by at least one user acceptance test case In the test strategy, equivalence partitioning is required for the system and acceptance testing of user stories with priority >= High. For this development cycle, the following user stories were selected and implemented: (P = Priority; E = Estimated Effort) US 02-10: Play video for selected hotel (P: Medium; E: 4) US 02-20: Play background music (P: Low; E: 2) US 03-20: Search for five nearest hotels (P: Very High; E: 4) US 03-30: Search for nearest matching hotel (P: High; E: 7) Test analysis for system testing has just begun and the following test conditions have been identified: TC 02-10-1: Play video, use all supported formats TC 03-20-1: List 5 nearest hotels, use equivalence partitioning for location TC 03-30-1: List nearest matching hotel, use equivalence partitioning for user profile and location TC PE-xx-1: Performance tests for up to 10,000 simultaneous requests of user story US 03-30 TC PE-xx-2: Performance tests for up to 1,000 simultaneous requests of user story US 03-20 What is the MINIMUM number of test conditions that must be added to fulfill all exit criteria in this cycle?

A.

2
B.

1
C.

3
D.

4

Correct Answer
A. 2

Explanation
Performance tests with maximum allowed response time 10 sec for up to 10,000 simultaneous requests of user story US 03-20 are missing

A test condition for user story US 02-20 is missing.

Rate this question:

3.

TM-1.3.2 (K2) Explain the factors that might affect the level of detail at which test conditions may be specified and the advantages and disadvantages for specifying test conditions at a detailed level Question: Which TWO of the following factors indicate most that detailed test conditions should be specified for system testing?

A.

Test basis is of low quality
B.

Test design and test execution is outsourced
C.

Test basis is changing frequently
D.

Domain experts are available for consultation during test design
E.

Test conditions are used for management milestone presentations

Correct Answer(s)
A. Test basis is of low quality
B. Test design and test execution is outsourced

Explanation
Correct: specifying detailed test conditions could act in place of a poor test basis and contribute to defect prevention.
Correct: questions at test design to refine coarse grained test conditions would be expensive to answer.
Incorrect: Detailed test conditions would be hard to maintain.
Incorrect: questions at test design to refine coarse grained test conditions could be answered by domain experts.
Incorrect: Management doesn't general require that level of detail.

Rate this question:

4.

TM-1.4.1 (K3) Use traceability to check completeness and consistency of designed test cases with respect to the defined test conditions Question: Scenario 1: Assume that you are working for an ambitious start-up. They are creating a system that will provide customized loyalty and rewards programs for small- and medium-sized companies selling to customers on the Web. These companies enroll themselves on the system’s web store. This allows the companies to create customized buttons, to be placed on their websites, that let customers enroll in the companies’ loyalty and rewards program. Each subsequent purchase earns points, and both companies and their customers can manage the program; for example, to determine the number of points required to receive a free product or service. Your employer’s marketing staff is heavily promoting the system, offering aggressive discounts on the first year’s fees to sign up inaugural companies. The marketing materials state that the service will be highly reliable and extremely fast for companies and their customers. At this time, the requirements are complete, and development of the software has just begun. The current schedule will allow companies and their customers to start enrolling in three months. Your employer intends to use cloud computing resources to host this service, and to have no hardware resources other than ordinary office computers for its developers, testers, and other engineers and managers. Industry-standard web-based application software components will be used to build the system. Consider the following risk item that was identified during the quality risk analysis process: Customized enrollment buttons for a company’s website are not assigned the correct URL for that company’s loyalty program. Assume that you have used traceability to determine the logical test cases that cover this risk item. Which of the following is a positive logical test that is complete, is correct, and covers this risk item?

A.

Click on company enrollment button; verify that you go to that company’s enrollment page.
B.

Click on company enrollment button; verify that you go to our home page.
C.

Click rapidly on company enrollment button to see what happens.
D.

Click on URL for our home page; check that home page displays.

Correct Answer
A. Click on company enrollment button; verify that you go to that company’s enrollment page.

Explanation
Correct: has the input to occur, the correct expected result per the scenario, and relates to the risk item.
Incorrect: has the wrong expected result and so it incorrect.
Incorrect: might cover this risk item, but it is a negative test and also does not contain an expected result; it’s a good exploratory negative test for this risk item, though.
Incorrect: is a perfectly goo d positive logical test, but does not cover the risk item.

Rate this question:

5.

TM-1.5.1 (K3) Use risks, prioritization, test environment and data dependencies, and constraints to develop a test execution schedule which is complete and consistent with respect to the test objectives, test strategy, and test plan Question: Scenario 1: Assume that you are working for an ambitious start-up. They are creating a system that will provide customized loyalty and rewards programs for small- and medium-sized companies selling to customers on the Web. These companies enroll themselves on the system’s web store. This allows the companies to create customized buttons, to be placed on their websites, that let customers enroll in the companies’ loyalty and rewards program. Each subsequent purchase earns points, and both companies and their customers can manage the program; for example, to determine the number of points required to receive a free product or service. Your employer’s marketing staff is heavily promoting the system, offering aggressive discounts on the first year’s fees to sign up inaugural companies. The marketing materials state that the service will be highly reliable and extremely fast for companies and their customers. At this time, the requirements are complete, and development of the software has just begun. The current schedule will allow companies and their customers to start enrolling in three months. Your employer intends to use cloud computing resources to host this service, and to have no hardware resources other than ordinary office computers for its developers, testers, and other engineers and managers. Industry-standard web-based application software components will be used to build the system. You are following a risk-based testing strategy, where likelihood and impact are both assessed on a five-point scale ranging from very low to very high. Consider the following risk item that was identified during the quality risk analysis process: Customized enrollment buttons for a company’s website are not assigned the correct URL for that company’s loyalty program. Assume that technical project stakeholders have assessed the likelihood of this risk at a medium level. Given only the information above, which of the following statements is certainly true?

A.

This risk item should be assessed as a very high impact level risk.
B.

The test cases associated with this risk item must be run first in the test execution period.
C.

The test cases associated with this risk item must be run toward the middle of the test execution period.
D.

A large number of test cases should be associated with this risk item, based on impact.

Correct Answer
A. This risk item should be assessed as a very high impact level risk.

Explanation
Correct: this risk relates to the core functionality of the application.
Incorrect: tests with very high impact and higher likelihood should run before this test.
Incorrect: is not certainly true because we don’t know how this risk item relates to other risk items.
Incorrect: is not certainly true because we don’t know how effort allocation is determined based on combined impact and likelihood.

Rate this question:

6.

TM-1.6.1 (K3) Use traceability to monitor test progress for completeness and consistency with the test objectives, test strategy, and test plan Question: In a given company, testing is expected to follow a risk-based testing strategy. Assume the project is currently in test execution. For the following tests, the values given represent the test identifier, the risk level, the identifier for the requirement covered by the test, and the current test status, respectively. Test ID Risk Level Requirement ID Status 02.007 Very high 09.003 Fail 02.010 High 09.003 Ready to run 02.019 Very low 09.020 Pass Which TWO of the following statements are true?

A.

The test team might not be following the test strategy, since test 02.010 is higher risk than 02.019.
B.

If the test plan calls for running at least one test for each requirement as early as possible, the test sequencing might be correct.
C.

The test sequencing is certainly incorrect, since test 02.010 is higher risk than 02.019.
D.

The test manager should stop test execution while evaluating all problems that exist with test sequencing.
E.

Running test 02.019 was a waste of time, because it did not find any defects.

Correct Answer(s)
A. The test team might not be following the test strategy, since test 02.010 is higher risk than 02.019.
B. If the test plan calls for running at least one test for each requirement as early as possible, the test sequencing might be correct.

Explanation
Correct: higher-risk tests precede lower-risk tests in risk-based testing strategies.
Correct: 02.019 covers a different requirement than 02.010.
Incorrect: the situation in option B, or perhaps simply blockage of tests, can explain running tests out of risk order.
Incorrect: while evaluating problems with test sequencing makes sense, there is no need to stop running tests while doing so.
Incorrect: finding defects is not the only objective of testing.

Rate this question:

7.

TM-1.7.1 (K2) Explain the importance of accurate and timely information collection during the test process to support accurate reporting and evaluation against exit criteria Question: Which TWO of the following metrics are best suited to be included in a test progress report for unit test execution?

A.

Planned versus actual coverage achieved
B.

Planned versus actual defects reported
C.

Defect detection percentage (DDP) of unit test
D.

Number of test conditions identified
E.

Unit test time vs. integration test time

Correct Answer(s)
A. Planned versus actual coverage achieved
B. Planned versus actual defects reported

Explanation
Defect detection percentage (DDP) of unit test could not be measured timely.
Number of test conditions identified related to test analysis progress.
Unit test time vs. integration test time could not be measured timely.

Rate this question:

8.

TM-1.8.1 (K2) Summarize the four groups of test closure activities Question: Which ONE of the following is an accurate summary of the test closure activity “test completion check”?

A.

Test completion check ensures that all test work is concluded as planned
B.

Test completion check ensures that all important lessons learned are documented
C.

Test completion check ensures that all test work products are stored in the configuration management system
D.

Test completion check ensures that plans are established to ensure that good practices can be repeated

Correct Answer
A. Test completion check ensures that all test work is concluded as planned

Explanation
Correct: per syllabus section 1.3

Rate this question:

9.

TM-1.8.2 (K3) Implement a project retrospective to evaluate processes and discover areas to improve Question: Scenario 1: Assume that you are working for an ambitious start-up. They are creating a system that will provide customized loyalty and rewards programs for small- and medium-sized businesses selling to customers on the web. These companies enroll themselves on the system’s web store. This allows the companies to create customized buttons, to be placed on their websites, that let customers to enroll in the companies’ loyalty and rewards program. Each subsequent purchase earns points, and both companies and their customers can manage the program; for example, to determine the number of points required to receive a free product or service. Your employer’s marketing staff is heavily promoting the system, offering aggressive discounts on the first year’s fees to sign up inaugural companies. The marketing materials state that the service will be highly reliable and extremely fast for companies and their customers. At this time, the requirements are complete, and development of the software has just begun. The current schedule will allow companies and their customers to enroll starting in three months. Your employer intends to use cloud computing resources to host this service, and to have no hardware resources other than ordinary office computers for its developers, testers, and other engineers and managers. Industry-standard web-based application software components will be used to build the system. Assume that the project has completed the initial release, and the system has been in use by companies and their customers for a month now. Your team used a blended risk-based, requirements-based, and reactive testing strategy. In the quality risk analysis, button customization was assessed as the lowest-risk area, while enrollment was assessed as the highest-risk area. You are implementing a retrospective for the testing work. Which THREE of the following areas should be considered in this retrospective?

A.

Identifying enrollment problems that are affecting companies or their customers.
B.

Comparing actual tests completed against the estimated number of tests for enrollment, button customization, and point management.
C.

Evaluating whether significant problems have been reported by users in button customization.
D.

Delivering the known defects and failed tests to the system support team.
E.

Deciding if the project plan included all relevant project risks that affected delivery to early-adopter companies.
F.

Determining the level of detail required for enrollment, customization and point management test cases.
G.

Measuring the coverage of the enrollment requirements and reporting that to project and business stakeholders.

Correct Answer(s)
A. Identifying enrollment problems that are affecting companies or their customers.
B. Comparing actual tests completed against the estimated number of tests for enrollment, button customization, and point management.
C. Evaluating whether significant problems have been reported by users in button customization.

Explanation
Correct: enrollment is a key requirement area, and test retrospectives should check whether defects were missed in such areas under a requirements-based test strategy.
Correct: under-estimation of the effort required to test the major functional area s of the product should be checked in a retrospective.
Correct: we want to analyze defect information to evaluate whether the quality risk analysis was correct in a retrospective.
Incorrect: while this is part of test closure, it is not part of the retrospective.
Incorrect: while a good issue to consider in a retrospective, it is a project-wide issue, not a test-related issue.
Incorrect: this is supposed to happen during implementation.
Incorrect: this is part of test control.

Rate this question:

10.

TM-2.2.1 (K4) Analyze the stakeholders, circumstances, and needs of a software project or program, including the software development lifecycle model, and identify the optimal test activities Question: Scenario 2: Assume that you are managing the testing of a mature application. This application is an online dating service that allows users: to enter a profile of themselves; to meet people who would be a good match for them; to arrange social events with those people; and, to block people they don’t want to contact them. Consider the following groups of individuals: I. Users of the application who are searching for dates II. Managers and shareholders of the company III. Married couples who used the application to find their mate IV. Employees of government agencies Consider the following list of test activities. a. Testing the affinity of matches proposed by the application b. Testing the ability of the application to charge users correctly c. Testing the ability of the application to comply with local tax regulations Based only on the information given here, which of the following statements correctly matches current stakeholders with one or more their testing interest?

A.

I – a, b; II – a, b, c; IV – c
B.

I – a, b; II – a, b, c; III – b; IV – c
C.

I – a, b; II – a, b, c; IV – a, c
D.

I – a, b, c; II – a, b, c; IV – c

Correct Answer
A. I – a, b; II – a, b, c; IV – c

Explanation
Correct: users care about receiving the service they are paying for, at the agreed price; managers and stakeholders must care about all three types of tests, so that they have satisfied customers, a profitable company, and legal compliance; government agents care about compliance with the rules; and, married couples are not current stakeholders.
Incorrect: married customers are not current customers (unless they are cheating on their spouse) and thus shouldn't really care if invoicing is working correctly.
Incorrect: government employees wouldn't really care about how well the matching works, except for those employees who are users of the application (which has nothing to do with being an employee of a government agency).
Incorrect: the users really don’t have much concern about whether the company is paying the proper taxes, as long as the user is being charged properly.

Rate this question:

11.

TM-2.2.2 (K2) Understand how software development lifecycle activities and work products affect testing, and how testing affects software development lifecycle activities and work products Question: Which of the following statements correctly reflects the way project management work products affect testing?

A.

Constraints in the project plan may constrain testing.
B.

The test manager should work with the project manager to develop the project schedule.
C.

The tests should completely cover the requirements specification.
D.

The test manager should work with the technical support manager during test closure.

Correct Answer
A. Constraints in the project plan may constrain testing.

Explanation
Correct: the test plan must be consistent with the larger project plan.
Incorrect: "The test manager should work with the project manager to develop the project schedule." is a true statement, but is about how testing affects a project management work product, not how a project management work product affects testing.
Incorrect: requirements are not a project management work product and, in addition, this statement is only true when following a requirements-based testing strategy.
Incorrect: "The test manager should work with the technical support manager during test closure." is a true statement as well, but not about project management affecting testing, but rather testing affecting technical support

Rate this question:

12.

TM-2.2.3 (K2) Explain ways to manage the test management issues associated with experience-based testing and non-functional testing Question: Which ONE of the following statements describes an appropriate approach to managing non-functional testing?

A.

Non-functional test implementation activities that take longer than a single iteration should be handled outside of the iterations
B.

The test manager shall delegate the non-functional test planning to the technical test analysts working on the project
C.

Non-functional testing should be prioritized to follow functional testing and based on perceived risks
D.

Non-functional risks should be mitigated during early levels of testing or even during development

Correct Answer
A. Non-functional test implementation activities that take longer than a single iteration should be handled outside of the iterations

Explanation
Correct: From the syllabus.

Incorrect: Only some test planning can be delegated to both TAs and TTAs.

Incorrect: All non-functional testing does not have to follow functional testing (but it should be based on perceived risks).

Incorrect: Some non-functional risks may be mitigated early, but some may be mitigated later
in the life cycle.

Rate this question:

13.

TM-2.3.1 Explain the different ways that risk-based testing responds to risks Question: Which ONE of the following statements BEST describes how risk-based testing responds to risks?

A.

The test team designs, implements, and executes tests to mitigate quality risks
B.

When tests find defects they increase the quality of the system under test
C.

Functional testing addresses product risks, while non-functional testing addresses quality risks
D.

The test manager determines which test levels to apply based on project risks

Correct Answer
A. The test team designs, implements, and executes tests to mitigate quality risks

Explanation
Correct: From syllabus
Incorrect: Testing measures quality – it does not improve it (subsequent debugging would do).
Incorrect: There is no correlation between risk types (although these are both the same risk type) and functional/non-functional testing.
Incorrect: Project risks do help determine which test levels, but so do product risks.

Rate this question:

14.

TM-2.3.2 (K2) Explain, giving examples, different techniques for product risk analysis Question: Which of the following statements are examples of different techniques for analyzing the risks to product quality?

A.

PRAM, PRiSMa, FMEA, and FTA
B.

Risk identification, risk assessment, risk mitigation, and risk management
C.

Expert interviews, independent assessments, use of risk templates, and project retrospectives
D.

Personnel and training issues among the business analysts, designers, and programmers

Correct Answer
A. PRAM, PRiSMa, FMEA, and FTA

Explanation
Correct: PRAM, PRiSMa, FMEA, and FTA as these are four of the eight different techniques given in the syllabus.
Incorrect: Risk identification, risk assessment, risk mitigation, and risk management are the four activities in risk-based testing.
Incorrect: Expert interviews, independent assessments, use of risk templates, and project retrospectives are techniques for risk identification, which is only part of the analysis process.
Incorrect: Personnel and training issues among the business analysts, designers, and programmers is one of the factors influencing the likelihood of a risk item.

Rate this question:

15.

TM-2.3.3 (K4) Analyze, identify, and assess product quality risks, summarizing the risks and their assessed level of risk based on key project stakeholder perspectives. Question: Scenario 1: Assume that you are working for an ambitious start-up. They are creating a system that will provide customized loyalty and rewards programs for small- and medium-sized companies selling to customers on the Web. These companies enroll themselves on the system’s web store. This allows the companies to create customized buttons, to be placed on their websites, that let customers enroll in the companies’ loyalty and rewards program. Each subsequent purchase earns points, and both companies and their customers can manage the program; for example, to determine the number of points required to receive a free product or service. Your employer’s marketing staff are heavily promoting the system, offering aggressive discounts on the first year’s fees to sign up inaugural companies. The marketing materials state that the service will be highly reliable and extremely fast for companies and their customers. At this time, the requirements are complete, and development of the software has just begun. The current schedule will allow companies and their customers to start enrolling in three months Your employer intends to use cloud computing resources to host this service, and to have no hardware resources other than ordinary office computers for its developers, testers, and other engineers and managers. Industry-standard web-based application software components will be used to build the system. Which THREE of the following are product quality risks for this system?

A.

The system has excessive downtime due to memory leaks.
B.

The loyalty points calculated are incorrect.
C.

Customers cannot enroll in company loyalty programs.
D.

The start-up runs out of money before testing starts.
E.

The requirements for the system are incorrect.
F.

Cloud computing resources are not available quickly enough to support project schedules.
G.

Overly aggressive discounts result in a liquidity crisis for the company during the first year.

Correct Answer(s)
A. The system has excessive downtime due to memory leaks.
B. The loyalty points calculated are incorrect.
C. Customers cannot enroll in company loyalty programs.

Explanation
Correct: The system has excessive downtime due to memory leaks. we are promising high reliability and reliability is a quality characteristic.
Correct: The loyalty points calculated are incorrect. calculating loyalty points is a function of the system and functional accuracy is a quality sub-characteristic.
Correct: Customers cannot enroll in company loyalty programs. enrolling in company loyalty programs is a function of the system and functional accuracy is a quality sub-characteristic.
Incorrect: The start-up runs out of money before testing starts is a project risk (and a very real one for any start-up).
Incorrect: Cloud computing resources are not available quickly enough to support project schedules is a project risk, and requires the candidate to make the subtle distinction between the immediate potential effects of the risk (widespread collateral damage to the project) from the various consequences should the risk become an outcome (which includes various quality-related problems).
Incorrect: Overly aggressive discounts result in a liquidity crisis for the company during the first year is a project risk, not a quality risk, and it’s also of vanishingly small likelihood given the amazing range of options available in the cloud computing retail market.

Incorrect: is definitely a risk, but it’s not related to the quality of the system, but rather due to the discounts being offered; specifically, it’s an operational risk that can arise after release.

Rate this question:

16.

TM-2-3.4 (K2) Describe how identified product quality risks can be mitigated and managed, appropriate to their assessed level of risk, throughout the lifecycle and the testing process Question: Which ONE of the following statements is the LEAST appropriate description of how identified product quality risks should be mitigated and managed?

A.

The choice of regulatory standard to be followed should be influenced by the perceived level of risk.
B.

Tests should be designed, implemented and executed in order to address perceived risks.
C.

The effort associated with developing and executing tests should be proportional to the level of perceived risk.
D.

The priority of the development and execution of tests should be based on the perceived level of risk.

Correct Answer
A. The choice of regulatory standard to be followed should be influenced by the perceived level of risk.

Explanation
We always want test effectiveness (e.g. ability to detect defects) to be high no matter what level of risk is being mitigated.

Rate this question:

17.

TM 2.3.5 - (K2) Give examples of different options for test selection, test prioritization and effort allocation Question: Which ONE of the following is NOT a practical technique for test prioritization and effort allocation?

A.

Individual testers decide what to test based on their discovery of defects within the test basis
B.

Ambiguity reviews identify and eliminate ambiguities in the requirements
C.

Test condition analysis involves a close reading of prioritized requirements to identify the test conditions to cover
D.

Cause-effect graphing identifies a test set that achieves 100% functional coverage of the test basis.

Correct Answer
A. Individual testers decide what to test based on their discovery of defects within the test basis

Explanation
We do not want to leave all prioritization and effort allocation to individual testers, and also discovery of defects can only occur after testing (and so some prioritization and effort allocation) has already started.

Rate this question:

18.

TM-2.4.1 (K4) Analyze given samples of test policies and test strategies, and create master test plans, level test plans, and other test work products that are complete and consistent with these documents Question: Scenario 2: Assume that you are managing the testing of a mature application. This application is an online dating service that allows users: to enter a profile of themselves; to meet people who would be a good match for them; to arrange social events with those people; and, to block people they don’t want to contact them. Assume that the test policy defines the following mission for the test organization, in priority order: 1. Find defects 2. Reduce risk 3. Build confidence Assume further that your manager has defined the highest priority test process improvement for the test organization in the coming year to be achieving maximum possible automation of the regression tests for the application. Which of the following statements is correct?

A.

The application and the test process improvement are aligned, but the mission statement is misaligned with the application and test process improvement.
B.

The application and the mission statement are aligned, but the test process improvement is misaligned with the application and the mission statement.
C.

The application, the mission statement, and the test process improvement are all aligned.
D.

The application, the mission statement, and the test process improvement are all misaligned with each other.

Correct Answer
A. The application and the test process improvement are aligned, but the mission statement is misaligned with the application and test process improvement.

Explanation
for a mature application, the main mission of testing is really building confidence that the application continues to work properly. Automated regression testing helps achieve that efficiently, so the test process improvement and the application are aligned. While the idea of automating the regression testing For this mature application is a good one, automation does not tend to find many defects. So, the mission statement is not aligned with the test process improvement, or with the real test needs of a mature application.

Rate this question:

19.

TM-2.2.4 (K4) For a given project, analyze project risks and select appropriate risk management options (i.e., mitigation, contingency, transference, and/or acceptance) Question: Scenario 1: Assume that you are working for an ambitious start-up. They are creating a system that will provide customized loyalty and rewards programs for small- and medium-sized businesses selling to customers on the web. These companies enroll themselves on the system’s web store. This allows the companies to create customized buttons, to be placed on their websites, that let customers to enroll in the companies’ loyalty and rewards program. Each subsequent purchase earns points, and both companies and their customers can manage the program; for example, to determine the number of points required to receive a free product or service. Your employer’s marketing staff is heavily promoting the system, offering aggressive discounts on the first year’s fees to sign up inaugural companies. The marketing materials state that the service will be highly reliable and extremely fast for companies and their customers. At this time, the requirements are complete, and development of the software has just begun. The current schedule will allow companies and their customers to enroll starting in three months. Your employer intends to use cloud computing resources to host this service, and to have no hardware resources other than ordinary office computers for its developers, testers, and other engineers and managers. Industry-standard web-based application software components will be used to build the system. Assume that you are writing a master test plan for this project, and are currently working on the project risks section of the plan. Which of the following topics should NOT be addressed in this section of the test plan?

A.

Resignation of senior marketing staff prior to introduction of the service.
B.

Inability to provision a test environment by the planned test execution start date.
C.

Inability to locate sufficient skilled and certified testers, especially senior testers.
D.

Insufficient resources to acquire suitable number of virtual users for load testing.

Correct Answer
A. Resignation of senior marketing staff prior to introduction of the service.

Explanation
Correct: Resignation of senior marketing staff prior to introduction of the service. While this is a significant project risk, it is not a test related project risk. What the test team needs from the marketing team—the requirements— are already complete.
Incorrect: Inability to provision a test environment by the planned test execution start date. problems with test environment readiness are classic test-related project risks.
Incorrect: Inability to locate sufficient skilled and certified testers, especially senior testers. problems with test staff availability and qualification are classic test-related project risks.
Incorrect: Insufficient resources to acquire suitable number of virtual users for load testing. problems with tool readiness are classic test-related project risks.

Rate this question:

20.

TM-2.4.3 (K2) Describe, giving examples, how test strategies affect test activities Question: Consider the following test strategies I. Analytical test strategy II. Methodical test strategy III. Process-compliant test strategy IV. Consultative test strategy Consider the following examples of test activities. 1. Testing a user-provided list of Internet browsers 2. Defining acceptance criteria for a user story 3. Executing the highest-risk tests as early as possible 4. Clicking through all the navigational links on a web page Which of the following correctly matches test strategies with an example of a test activity appropriate for that strategy?

A.

I-3; II-4; III-2; IV-1.
B.

I-1; II-2; III-3; IV-4.
C.

I-4; II-3; III-2; IV-1.
D.

I-3; II-2; III-4; IV-1.

Correct Answer
A. I-3; II-4; III-2; IV-1.

Explanation
Because analytical risk based testing includes risk-based test prioritization, methodical testing follows a checklist (which in this example includes traversing links on a site), process-compliant testing can include Agile process compliance, and consultative testing involves being externally-directed.

All others are all incorrect because at least two of these examples are mismatched.

Rate this question:

21.

TM-2.4.4 (K3) Define documentation norms and templates for test work products that will fit organization, lifecycle, and project needs, adapting available templates from standards bodies where applicable Question: Scenario 3 Assume you are a test manager on a project which is following an Agile lifecycle. The testing strategy is a blend of risk-based testing, process-compliant testing, and reactive testing. Developers are following known Agile best practices, including automated unit testing and continuous integration. You are defining guidelines for documenting various test work products. Which of the following statements is true?

A.

You may tailor a set of templates from various sources, including the IEEE 829 standard.
B.

You should follow the IEEE 829 standard, since you are following a process-compliant test strategy.
C.

You should follow the IEEE 829 standard, because it was designed for use in any industry.
D.

You may omit documentation of test work altogether, except for defect reports.

Correct Answer
A. You may tailor a set of templates from various sources, including the IEEE 829 standard.

Explanation
Correct: You may tailor a set of templates from various sources, including the IEEE 829 standard. Agile lifecycles emphasize lightweight documentation.
Incorrect: You should follow the IEEE 829 standard, since you are following a process-compliant test strategy. the process being compliant with in this case is Agile methodology, not IEEE 829.
Incorrect: You should follow the IEEE 829 standard, because it was designed for use in any industry. IEEE 829 is documentation-heavy and thus incompatible with Agile philosophies on documentation and with reactive test strategies.
Incorrect: You may omit documentation of test work altogether, except for defect reports. even reactive test shave charters and even Agile lifecycles have acceptance criteria.

Rate this question:

22.

TM-2.5.1 (K3) For a given project, create an estimate for all test process activities, using all applicable estimation techniques Question: Scenario 3 Assume you are a test manager on a project which is following an Agile lifecycle. The testing strategy is a blend of risk-based testing, process-compliant testing, and reactive testing. Developers are following known Agile best practices, including automated unit testing and continuous integration. You are estimating the system test effort required for a particular iteration by your test team. Which THREE of the following statements correctly describe how you should carry out estimation in this scenario?

A.

Consider the average effort required per identified risk in past iterations.
B.

Allocate time-boxed test sessions for each identified test charter.
C.

Participate in agile team estimation sessions for this iteration.
D.

Estimate only effort for test execution and test closure.
E.

Estimate that most defects will be found during system test execution.
F.

Include effort to create detailed test work product documentation.
G.

Assume that system tests can reuse unit test data and environments.

Correct Answer(s)
A. Consider the average effort required per identified risk in past iterations.
B. Allocate time-boxed test sessions for each identified test charter.
C. Participate in agile team estimation sessions for this iteration.

Explanation
Correct: Consider the average effort required per identified risk in past iterations. considering historic averages for estimation is one recognized estimation technique.
Correct: Allocate time-boxed test sessions for each identified test charter. this is a common technique for managing experience-based testing, and has estimation implications.
Correct: Participate in agile team estimation sessions for this iteration. testers participate as members of Agile teams, including in estimation.
Incorrect: Estimate only effort for test execution and test closure. test estimation should include all activities in the test process.
Incorrect: Estimate that most defects will be found during system test execution. as cited in the syllabus, developers following known Agile best practices will remove as many as half the defects prior to system testing.
Incorrect: Include effort to create detailed test work product documentation. Agile methods es chew highly-detailed documentation, including test documentation.
Incorrect: Assume that system tests can reuse unit test data and environments. there is nothing in the scenario to make this re-use necessary or likely.

Rate this question:

23.

TM-2.5.2 (K2) Understand and give examples of factors which may influence test estimates Question: Which ONE of the following will most probably influence the duration, but not the effort of the testing activities?

A.

Time to repair defects found during testing
B.

Maturity of the test process
C.

Required level of detail of test conditions
D.

Required quality of the system

Correct Answer
A. Time to repair defects found during testing

Explanation
Correct: defect repair time may delay testing but do not require test effort.
Incorrect: Even mature test processes could last long, if effort is high.
Incorrect: Detailed test conditions demand effort.
Incorrect: High quality systems demand more testing effort.

Rate this question:

24.

TM-2.6.1 (K2) Describe and compare typical testing related metrics Question: Which one of the following statements about testing metrics usage is TRUE?

A.

Confirmation and regression test status is used to monitor the progress of testing.
B.

Trends in the lag time from defect reporting to resolution is used to reward the developers.
C.

Number of test conditions identified is used to monitor the quality of testing.
D.

Planned versus actual hours to develop testware is used to minimize regression testing.

Correct Answer
A. Confirmation and regression test status is used to monitor the progress of testing.

Explanation
Correct: that is one of the test progress monitoring metrics. All are test metrics but used for a different thing.
Incorrect: Trends in the lag time from defect reporting to resolution is used to reward the developers refers to dangerous use of that metric.
Incorrect: Number of test conditions identified is used to monitor the quality of testing is really monitoring progress of test analysis.
Incorrect: Planned versus actual hours to develop testware is used to minimize regression testing is a metric to monitor progress of planning and control

Rate this question:

25.

TM-2.6.2 (K2) Compare the different dimensions of test progress monitoring Question: Which one of the following alternatives is best to monitor test progress?

A.

Combined usage of coverage, confidence, risk, test and defect metrics.
B.

Estimation of code coverage by measuring the number of executed tests.
C.

Combined usage of coverage, product, people, test and defect metrics.
D.

Combined usage of product, people and project metrics

Correct Answer
A. Combined usage of coverage, confidence, risk, test and defect metrics.

Explanation
Correct: it mentions three of the five main dimensions of test progress metrics.
Incorrect: Estimation of code coverage by measuring the number of executed tests combines wrong coverage to number of executed tests.
Incorrect: Combined usage of coverage, product, people, test and defect metrics includes people category, which is unlikely to be used for test progress monitoring; also, people and product are not listed in the five main dimensions of test progress metrics.
Incorrect: Combined usage of product , people and project metrics includes people category, which is unlikely to be used for test progress monitoring.

Rate this question:

26.

TM-2.6.3 (K4) Analyze and report test results in terms of the residual risk, defect status, test execution status, test coverage status, and confidence to provide insight and recommendations that enable project stakeholders to make release decisions Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for a minimum of two years, but mostly a lot longer. New tests are developed by the most experienced testers using in-house custom test scripts. Variations of tests and the regression test sets are run by the rest of the team. The company management require s monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. Your company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule. The business unit manager of your software business unit has asked you to propose how to improve the testing of the project, e.g. by introducing better metrics or tools. The manager has quickly collected product risk list from user representatives and thinks the tests don’t cover all the risks. Which one of the following alternatives would you recommend to be done?

A.

Analyze residual risks based on tester confidence to see if enough test coverage is reached.
B.

Add more tests to better cover the functionalities.
C.

Derive risk and confidence status from tester opinions about developer capabilities.
D.

Include confidence rating into measures.

Correct Answer
A. Analyze residual risks based on tester confidence to see if enough test coverage is reached.

Explanation
Correct: it combines using more different dimensions of test progress monitoring and starts looking into the probably real reason of test coverage versus effort spent leading to remaining product risks.
Incorrect: Add more tests to better cover the functionality is all right but no analysis involved, shouldn't work on intuition only.
Incorrect: Derive risk and confidence status from tester opinions about developer capabilities focuses wrongly on capabilities.
Incorrect: Include confidence rating into measures is all right on its own but it doesn't utilize the risk information.

Rate this question:

27.

TM-2.7.1 (K2) Give examples for each of the four categories determining the cost of quality Question: Consider the following categories of quality costs: a. Costs of prevention. b. Costs of detection. c. Costs of internal failure. d. Costs of external failure. Consider the following examples of quality costs: 1. Performing a quality risk analysis 2. Training business analysts in requirements engineering. 3. Customers complain about poor performance. 4. Long lag time from defect reporting to resolution during testing increase defect management inefficiency. Which of the following correctly matches each category with an example?

A.

A-2; b-1; c-4; d-3
B.

A-1; b-2; c-3; d-4.
C.

A-1; b-2; c-4; d-3
D.

A-2; b-1; c-3; d-4

Correct Answer
A. A-2; b-1; c-4; d-3

Explanation
Training the BAs is a cost of prevention because it helps write higher-quality requirements

Quality risk analysis is a detection cost because you’d incur this cost even if you found no defects

Any defect-related cost of quality incurred during testing and prior to release is a cost of internal failure, even avoidable costs

Customer complaints is a cost of external failure because these customer complaints result in decreased future sales.

Rate this question:

28.

TM-2.7.2 (K3) Estimate the value of testing based on cost of quality, along with other quantitative and qualitative considerations, and communicate the estimated value to testing stakeholders Question: Scenario 2: Assume that you are managing the testing of a mature application. This application is an online dating service that allows users: to enter a profile of themselves; to meet people who would b e a good match for them; to arrange social events with those people; and, to block people they don’t want to contact them. Assume that you have calculated the following costs of quality: • Average cost of detection: $ 150 • Average cost of internal failure: $250 • Average cost of external failure: $5,000 The average costs of detection and internal failure are calculated using the number of bugs found prior to release, while the average costs of external failure is calculated using the number of bugs found after release. Which of the following statements is correct?

A.

Each bug found by testing offers the organization an average $4,600 savings in cost of quality
B.

The total cost of quality, including cost of prevention, for this dating application is $5,400.
C.

Cost of quality cannot be used to calculate the value of testing for this or any other organization.
D.

Each bug found by testing offers the organization a potential $5,400 savings in cost of quality

Correct Answer
A. Each bug found by testing offers the organization an average $4,600 savings in cost of quality

Explanation
Correct: $5,000 – ($150 + $250) = $4,600.
Incorrect: The total cost of quality, including cost of prevention, for this dating application is $5,400 you can’t add averages to calculate a total, and besides you weren't given the cost of prevention.

Incorrect: cost of quality can be used to calculate the value of any quality-relate d activity, and is so used in industries around the world.
Incorrect: Each bug found by testing o offers the organization a potential $5,400 savings in cost of quality you have to subtract the average costs of detection and internal failure associated with testing to calculate the net potential savings, rather than adding those costs.

Rate this question:

29.

TM-2.8.1 (K2) Understand the factors required for successful use of distributed, outsourced, and insourced test team staffing strategies Question: Assume that you are working for an ambitious start-up. They are creating a system that will provide customized loyalty and rewards programs for small- and medium-sized companies selling to customers on the Web. These companies enroll themselves on the system’s web store. This allows the companies to create customized buttons, to be placed on their websites, that let customers enroll in the companies’ loyalty and rewards program. Each subsequent purchase earns points, and both companies and their customers can manage the program; for example, to determine the number of points required to receive a free product or service. Your employer’s marketing staff is heavily promoting the system, offering aggressive discounts on the first year’s fees to sign up inaugural companies. The marketing materials state that the service will be highly reliable and extremely fast for companies and their customers. At this time, the requirements are complete, and development of the software has just begun. The current schedule will allow companies and their customers to start enrolling in three months. Your employer intends to use cloud computing resources to host this service, and to have no hardware resources other than ordinary office computers for its developers, testers, and other engineers and managers. Industry-standard web-based application software components will be used to build the system. In order to reduce testing cost by limiting the number of employees in the test team, senior management has decided to engage an outsource testing services firm to handle some of the testing. While the actual testing work will be done in Malaysia, this firm will put a person on-site to directly coordinate the work, communicate test results, and be in twice-daily contact with the offshore test team. Which of the following factors of success for distributed and outsourced testing is addressed in this plan?

A.

Defined ways in which communication should occur.
B.

Division of the testing work based on qualifications.
C.

Well-defined mission and tasks for on-site and offshore test teams.
D.

Establishment of trust across the project team members.

Correct Answer
A. Defined ways in which communication should occur.

Explanation
Correct: an onsite person will act as the channel of communication.
Incorrect: Division of the testing work based on qualifications there is no indication that any factor other than cost was used to select the outsource testing services firm.
Incorrect: Well-defined mission and tasks for on-site and offshore test teams there is no clear division of work between the teams
Incorrect: Establishment of trust across the project team members the decision about the use of this offshore team was imposed top-down, corroding trust from the very start.

Rate this question:

30.

TM 2.9.1 - (K2) Summarize sources and uses of standards for software testing Which ONE of the following BEST describes a software standard that provides guidance on test coverage criteria to be achieved?

A.

US Federal Aviation Administration’s DO-178B
B.

ISTQB syllabi and glossary
C.

CMMI software process improvement framework
D.

Prince 2 project management framework

Correct Answer
A. US Federal Aviation Administration’s DO-178B

Explanation
Correct: From syllabus.
Incorrect: ISTQB syllabi and glossary. Not a standard – does not provide guidance on test coverage criteria.
Incorrect: CMMI software process improvement framework. A generic process improvement model – does not provide guidance on test coverage criteria.
Incorrect: Prince 2 project management framework. A generic project management framework – does not provide guidance on test coverage criteria.

Rate this question:

31.

TM-3.2.1 (K2) Understand the key characteristics of management reviews and audits Question: As a test manager, you are participating in a meeting with other members of the project management team. The agenda of the meeting is to discuss whether the project can begin acceptance testing based on the system test exit criteria, the acceptance test entry criteria, and other business considerations. Which of the following statements is true?

A.

The meeting is a management review, because the project management team is evaluating the situation and determining the next steps.
B.

The meeting is an audit, because the project management team is checking compliance against defined criteria by checking evidence.
C.

The meeting is a management review, because the project management team is checking to ensure that progress is being made on the project.
D.

The meeting is an audit, because the project management team is going to issue a pass/fail assessment against the criteria.

Correct Answer
A. The meeting is a management review, because the project management team is evaluating the situation and determining the next steps.

Explanation
Correct: we are using the criteria to assess status and, based on that assessment, to decide future actions, which are actions that the syllabus says belong in a management review.
Incorrect: The meeting is an audit, because the project management team is checking compliance against defined criteria by checking evidence, while we are indeed checking against defined criteria, there is no independent evaluation of compliance (the checking is being done by the project team) and there's no indication that "evidence" is being checked.
Incorrect: The meeting is a management review, because the project management team is checking to ensure that progress is being made on the project, while the statement is in a sense true, it misses the element of decision-making by management peers, which is the key reason that this is a management review rather than an audit.
Incorrect: The meeting is an audit, because the project management team is going to issue a pass/fail assessment against the criteria, while a pass/fail assessment of the criteria might well occur, as with B, there is no independent evaluation of compliance.

Rate this question:

32.

TM 3.3.1 (K4) Analyze a project to select the appropriate review type, and to define a plan for conducting reviews, in order to ensure proper execution, follow up, and accountability Question: Scenario 1: Assume that you are working for an ambitious start-up. They are creating a system that will provide customized loyalty and rewards programs for small- and medium-sized companies selling to customers on the Web. These companies enroll themselves on the system’s web store. This allows the companies to create customized buttons, to be placed on their websites, that let customers enroll in the companies’ loyalty and rewards program. Each subsequent purchase earns points, and both companies and their customers can manage the program; for example, to determine the number of points required to receive a free product or service. Your employer’s marketing staff is heavily promoting the system, offering aggressive discounts on the first year’s fees to sign up inaugural companies. The marketing materials state that the service will be highly reliable and extremely fast for companies and their customers. At this time, the requirements are complete, and development of the software has just begun. The current schedule will allow companies and their customers to start enrolling in three months. Your employer intends to use cloud computing resources to host this service, and to have no hardware resources other than ordinary office computers for its developers, testers, and other engineers and managers. Industry-standard web-based application software components will be used to build the system. Assume that you have been asked by the senior management team to plan for reviews as part of this project. They want a very lightweight process that nonetheless provides for some early defect detection as well as building consensus and understanding across the team. Which of the following answers describes the BEST option in this situation?

A.

You should plan for informal reviews, with appropriate participants, for all appropriate work products.
B.

You should plan for inspections of requirements, design, and code reviews.
C.

You should plan for informal reviews of the quality risk analysis, tests, and test plan.
D.

You should convince management that someone other than the test manager should plan the reviews.

Correct Answer
A. You should plan for informal reviews, with appropriate participants, for all appropriate work products.

Explanation
Correct: informal reviews are a lightweight approach that will achieve the benefits.
Incorrect: You should plan for inspections of requirements, design, and code reviews, management wants a lightweight process, and because the requirements (and possibly the design) are already complete.
Incorrect: You should plan for informal reviews of the quality risk analysis, tests, and test plan. is not as good an answer as because it specifically includes only test work products.
Incorrect: You should convince management that someone other than the test manager should plan the reviews, reviews can be planned and managed by various participants on a project, including the test manager.

Rate this question:

33.

TM 3.3.2 (K2) Understand the factors, skills, and time required for participation in reviews. Question: Scenario 1: Assume that you are working for an ambitious start-up. They are creating a system that will provide customized loyalty and rewards programs for small- and medium-sized companies selling to customers on the Web. These companies enroll themselves on the system’s web store. This allows the companies to create customized buttons, to be placed on their websites, that let customers enroll in the companies’ loyalty and rewards program. Each subsequent purchase earns points, and both companies and their customers can manage the program; for example, to determine the number of points required to receive a free product or service. Your employer’s marketing staff is heavily promoting the system, offering aggressive discounts on the first year’s fees to sign up inaugural companies. The marketing materials state that the service will be highly reliable and extremely fast for companies and their customers. At this time, the requirements are complete, and development of the software has just begun. The current schedule will allow companies and their customers to start enrolling in three months. Your employer intends to use cloud computing resources to host this service, and to have no hardware resources other than ordinary office computers for its developers, testers, and other engineers and managers. Industry-standard web-based application software components will be used to build the system. Assume that you have been asked by the senior management team to manage reviews as part of this project. You are selecting participants for a review of the identified quality risk items. Consider the following attributes needed to participate effectively in a review: I. Technical skills II. Suitable personality traits III. Procedural knowledge IV. Business knowledge Consider the following summary description of an individual who might participate in a review: 1. Past testing of financial applications 2. Development of simple web applications 3. Experienced participant in reviews 4. Detail-oriented 5. Understanding of cloud computing Which of the following correctly matches the attributes with this individual's details?

A.

I-2; I-5; II-4; III-3; IV-1
B.

I-1; I-2; II-4; III-3; IV-5
C.

I-4; II-2; II-3; III-5; IV-1
D.

I-2; II-3; III-4; III-1; IV-5

Correct Answer
A. I-2; I-5; II-4; III-3; IV-1

Explanation
Correct: Web development and understanding of cloud computing relate to the technical elements of the project. Attention to detail is a personality trait needed in any review participant.
Having participated in reviews gives the individual knowledge of the review procedure. Financial applications manage balances, which is relevant to managing loyalty point balances.

Other answers are all incorrect because of one or more mismatches.

Rate this question:

34.

TM-3.4.1 (K3) Define process and product metrics to be used in reviews Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for two years, but mostly a lot longer. New tests are developed by the most experienced test analysts as in-house custom test scripts. Variations of tests and the regression test sets are run by the rest of the team. The company management requires monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. Your company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule. Your manager thinks that the project might find some defects more efficiently by having testers review the business requirements.Which THREE of the following metrics would be used best to prove this point during review trial?

A.

Number of defects found in dynamic testing
B.

Dynamic test coverage
C.

Review and dynamic testing hours
D.

Number of defects found in reviews
E.

Number of severe defects in dynamic testing
F.

Test execution status
G.

Review results of hardware and software business units

Correct Answer(s)
A. Number of defects found in dynamic testing
C. Review and dynamic testing hours
D. Number of defects found in reviews

Explanation
Correct: because with these you can calculate the total time spent in reviews and dynamic testing and the number of found defects in both, and then compare those numbers to dynamic testing numbers only.
Incorrect: Dynamic test coverage. It is not relevant to efficiency calculations.
Incorrect: Number of severe defects in dynamic testing. As it is specifically mentioned in scenario, you might be drawn to this. Not relevant to count only severe defects though.
Incorrect: Test execution status. As it is specifically mentioned in scenario, you might be drawn to this. Not relevant to think about status. You want test hours.
Incorrect: Review results of hardware and software business units. This might sound better than Test execution status but even if review results are probably defects, you shouldn't include the hardware reviews, as the question implies that using reviews you want to find software requirement defects that might later end up as defects that dynamic testing can find.

Rate this question:

35.

TM-3.5.1 (K2) Explain, using examples, the characteristics of a formal review Question: You are the test manager working on an agile project developing information apps. Due to missing and incorrect functionality reported by users, formal reviews of all user stories are planned. The reviews are led by you, the test manager. The main objective of the reviews is the agreement of all stakeholders on the user story format, granularity, completeness, and preciseness. The following persons play the role of reviewers: chief developer (CD), test analyst (TA), product manager (PM), and domain expert (DE). During the kick off-meeting, the CD complains about being pulled off his real duty. After the individual reviews, the following table depicts the number of defects found by each of the three reviewers: CD TA PM DE Major 2 8 6 5 Minor 2 11 5 7 Typo 8 14 9 11 You have to decide how to proceed with the review. Which ONE of the following options should be chosen by the test manager?

A.

Ask for a discussion between the TM and the CD moderated by a third person to get the CD involved
B.

Postpone the review session and redefine the review with the objectives of the CD
C.

Proceed timely with the review session, with the role “scribe” assigned to the CD
D.

Cancel the review, write a report to upper management emphasizing the missing involvement of the CD

Correct Answer
A. Ask for a discussion between the TM and the CD moderated by a third person to get the CD involved

Explanation
Correct: Root cause of the defects must be found
Incorrect: Postpone the review session and redefine the review with the objectives of the CD. All stakeholders must agree on the review objectives.
Incorrect: Proceed timely with the review session, with the role “scribe” assigned to the CD “punishment” don’t help, be constructive!
Incorrect: Cancel the review, write a report to upper management emphasizing the missing involvement of the CD accuses don’t help, be constructive!

Rate this question:

36.

TM-4.2.1 (K3) Develop a defect management process for a testing organization, including the defect report workflow that can be used to monitor and control a project’s defects throughout the testing lifecycle Question: The diagram shows an incomplete defect management process, where three states (states X, Y and Z) have yet to be named appropriately. Which of the following would correctly complete the process?

A.

STATE X – REOPENED; STATE Y - REJECTED; STATE Z – DEFERRED
B.

STATE X – RETESTED; STATE Y - NEW; STATE Z – BLOCKED
C.

STATE X – DUPLICATE; STATE Y - UNCONFIRMED; STATE Z – TERMINATED
D.

STATE X – VERIFIED; STATE Y - REVIEW; STATE Z - FIXED

Correct Answer
A. STATE X – REOPENED; STATE Y - REJECTED; STATE Z – DEFERRED

Explanation
Correct: Both initial triage and assignment may decide to reject a defect (hence transition to REJECTED). If testing finds defect not fixed then it will move to REOPENED. Both initial triage and assignment may decide that a defect may be deferred (perhaps to a later release).

Incorrect: STATE X – RETESTED; STATE Y - NEW; STATE Z – BLOCKED No point retesting immediately after testing. NEW is often synonymous with OPEN.
If state Z was blocked, then you cannot exit this state.

Incorrect: STATE X – DUPLICATE; STATE Y - UNCONFIRMED; STATE Z – TERMINATED A duplicate defect would not require re-assignment. Unconfirmed as state Y does not work as you cannot leave this state. State Z could be terminated in some schemes.

Incorrect: STATE X – VERIFIED; STATE Y - REVIEW; STATE Z - FIXED Verified and tested are often synonymous – so both not needed. Review as state Y does not work as you cannot leave this state. State Z as fixed does not work – fixed is synonymous with resolved and you cannot get from state Z to ‘CLOSED’.

Rate this question:

37.

TM-4.2.2 (K2) Explain the process and participants required for effective defect management. Question: Which of the following represents a legal sequence of states for a defect report that leads to a terminal state? Assume that “in progress” means one or more states where developers or other project stakeholders are addressing the defect.

A.

Initial, in progress, returned, cancelled
B.

Initial, in progress, confirmation test, closed, deferred
C.

Initial, in progress, returned, in progress, confirmation test
D.

In progress, initial, confirmation test, closed

Correct Answer
A. Initial, in progress, returned, cancelled

Explanation
Correct: it corresponds to a defect that turns out
Incorrect: Initial, in progress, confirmation test, closed, deferred it makes no sense to defer a defect that’s already fixed
Incorrect: Initial, in progress, returned, in progress, confirmation test confirmation test is not a terminal state
Incorrect: In progress, initial, confirmation test, closed a defect report can’t be in progress before it’s even reported.

Rate this question:

38.

TM-4.3.1 (K3) Define the data and classification information that should be gathered during the defect management process. Question: You are the test manager on a project where system testing is being performed on software being provided by a third party. You have received a complaint from the third party that the completeness of the defect data from your system testing is unacceptable. The following list of information items has been identified as potentially missing from the defect reports being sent to the third party. Which THREE items do you think are MOST important to add to the defect reports?

A.

The priority to fix the problem
B.

The test environment in which the defect was observed
C.

Steps to reproduce the failure, along with the actual and expected results
D.

The project activity occurring when the problem was detected
E.

The technical type of the defect
F.

The lifecycle phases of introduction, detection, and removal for the defect
G.

The subsystem or component in which the defect lies

Correct Answer(s)
A. The priority to fix the problem
B. The test environment in which the defect was observed
C. Steps to reproduce the failure, along with the actual and expected results

Explanation
Correct: The priority to fix the problem. The third party needs this information to aid their prioritization.

Correct: The test environment in which the defect was observed. The test environment information will help them determine the environment where the defect becomes apparent.

Correct: Steps to reproduce the failure, along with the actual and expected results. These steps (and actual results) will help them understand the defect and the expected results will confirm that the testers understood what was expected.

Incorrect: The project activity occurring when the problem was detected. The third party already knows that these defect reports are coming from dynamic system testing.

Incorrect: Phase of detection is already available (system test), and phase of removal (hopefully now) is not known.

Incorrect: It is not the testers’ responsibility to determine the location of the defect in the system.

Rate this question:

39.

TM-4.4.1 (K2) Explain how defect report statistics can be used to evaluate the process capability of the testing and software development processes Question: It has been decided that the first step to test and development process improvement within your organization will be to reduce the number of defects introduced during development. Which of the following defect report statistics will be MOST useful in fulfilling this aim?

A.

The defect root cause information
B.

The lifecycle phases of introduction, detection, and removal for the defect
C.

The defect component information
D.

The defect removal efficiency information

Correct Answer
A. The defect root cause information

Explanation
Correct: This will show where defects are currently introduced, and so we can target these activities to prevent future defect introduction.

Incorrect: The phase of introduction may be useful, but the detection and removal info is not useful for reducing defect introduction.

Incorrect: The defect component information is used for defect clustering information to target components that need extra testing – but does not directly help prevent defects.

Incorrect: The defect removal efficiency information tells us how efficient we are at removing defects – it does not help with reducing the introduction of defects.

Rate this question:

40.

TM-5.2.1 (K2) Explain, using examples, why it is important to improve the test process. Question: Which TWO of the following statements are the best examples of the importance of improving the test process?

A.

Since testing often accounts for a major part of the total project costs, more effective testing will lead to more effective projects.
B.

Test process improvement models help to reach a higher level of maturity and professionalism.
C.

Since Testing often accounts for a major part of the total project costs, much attention is given to the test process in software process improvement models, such as CMMI
D.

When using test process improvement models, the Deming improvement cycle: Plan, Do, Check, Act, is of no relevance when testers need to improve the testing process
E.

Test process improvement is important because there exist well known and industry-accepted test process improvement models, such that TMMi, TPI Next, or CTP

Correct Answer(s)
A. Since testing often accounts for a major part of the total project costs, more effective testing will lead to more effective projects.
B. Test process improvement models help to reach a higher level of maturity and professionalism.

Explanation
Correct: Since testing often accounts for a major part of the total project costs, more effective testing will lead to more effective projects. - syllabus sect. 5.2.

Correct: Test process improvement models help to reach a higher level of maturity and professionalism. - syllabus sect. 5.3.

Rate this question:

41.

TM-5.3.1 (K3) Define a test process improvement plan using the IDEAL model Question: Assume that you are a test manager and are working to make your testing processes more effective and efficient. You have already a management-approved initial budget in place for these process improvements. Last week, an external consultant completed her assessment and delivered her findings. Which THREE of the following are the remaining steps for this process improvement effort, assuming you are following the IDEAL model for process improvement?

A.

Create a plan for selecting and implementing the assessment recommendations.
B.

Implement the assessment recommendations, including any necessary training and piloting.
C.

Evaluate the benefits, including the return on investment, from the improvements.
D.

Initiate the improvement process across the entire testing organization.
E.

Reject the consultant’s recommendations in favor of a set of internal priorities
F.

Diagnose the current situation by evaluating the sources of inefficiency
G.

Take steps to move your organization to test process maturity level 5.

Correct Answer(s)
A. Create a plan for selecting and implementing the assessment recommendations.
B. Implement the assessment recommendations, including any necessary training and piloting.
C. Evaluate the benefits, including the return on investment, from the improvements.

Explanation
Correct: Create a plan for selecting and implementing the assessment recommendations it’s the third step of the IDEAL process.

Correct: Implement the assessment recommendations, including any necessary training and piloting it’s the fourth step of the IDEAL process.

Correct: Evaluate the benefits, including the return on investment, from the improvements it’s the fifth step of the IDEAL process.

Incorrect: Initiate the improvement process across the entire testing organization. This is the first step of the IDEAL process and has already been carried out.

Incorrect: Reject the consultant’s recommendations in favor of a set of internal priorities. Though it certainly happens more often than not.

Incorrect: Diagnose the current situation by evaluating the sources of inefficiency; this is the second step of the IDEAL process and has already been carried out.

Incorrect: Take steps to move your organization to test process maturity level 5. It is not a given that your organization followed TMMi.

Rate this question:

42.

TM-5.4.1 (K2) Summarize the background, scope and objectives of the TMMi test process improvement model Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for two years, but mostly a lot longer. New tests are developed by the most experienced test analysts as in-house custom test scripts. Variations of tests and the regression test sets are run by the rest of the team. The company management requires monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. Your company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule. You consider TMMi to help you imp rove your project. Which one of the following TMMi aspects will suit best for this purpose?

A.

Align testing improvements with those of the company.
B.

Reach Optimized level to help prevent defects.
C.

Move from Initial level to Managed level.
D.

Reach 85 percent of specific and generic goals.

Correct Answer
A. Align testing improvements with those of the company.

Explanation
Correct: Align testing improvements with those of the company. TMMi supports CMMi, which is your company’s choice.

Incorrect: Reach Optimized level to help prevent defects. Based on scenario-information it is unlikely you are this high.

Incorrect: Move from Initial level to Managed level. Based on scenario-information it is unlikely you are this low.

Incorrect: Reach 85 percent of specific and generic goals. Is irrelevant detail.

Rate this question:

43.

TM-5.5.1 (K2) Summarize the background, scope and objectives of the TPI Next test process improvement model Question: Which ONE of the following statements about the test maturity matrix of TPI Next is true?

A.

For key area/maturity level combinations, the related checkpoints are shown in the test maturity matrix
B.

For key area/improvement objective combinations, the related checkpoints are shown in the test maturity matrix
C.

For improvement objective/ maturity level combinations, the related checkpoints are shown in the test maturity matrix
D.

For key area/maturity level combinations, the related improvement objectives are shown in the test maturity matrix

Correct Answer
A. For key area/maturity level combinations, the related checkpoints are shown in the test maturity matrix

Explanation
Correct: [TPI Next book p. 50]

Rate this question:

44.

TM-5.6.1 (K2) Summarize the back ground, scope and objectives of the CTP test process improvement model Question: Which of the following is an example of achieving an objective for the CTP test process improvement model?

A.

The test team’s defect detection effectiveness improves above industry averages.
B.

The test team’s test process maturity level goes from 2 to 3.
C.

The test team’s test process maturity level goes from controlled to efficient.
D.

The test team undergoes a critical testing process assessment.

Correct Answer
A. The test team’s defect detection effectiveness improves above industry averages.

Explanation
Correct: CTP uses metrics to benchmark organizations against industry averages.

Incorrect: The test team’s test process maturity level goes from 2 to 3 would apply to TMMi.

Incorrect: The test team’s test process maturity level goes from controlled to efficient would apply to TPI-Next.

Incorrect: The assessment is part of the scope of the CTP model, but it is not an objective (except maybe for the consultant doing it).

Rate this question:

45.

TM-5.7.1 (K2) Summarize the background, scope and objectives of the STEP test process improvement model Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for two years, but mostly a lot longer. New tests are developed by the most experienced test analysts as in-house custom test scripts. Variations of tests and the regression test sets are run by the rest of the team. The company management requires monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. Your company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule. You consider that the STEP-model might suit you well to solve above problems in the longer term. Which one of the following STEP basic premises fits your need best?

A.

Testers and developers work together
B.

A requirements-based testing strategy
C.

Testware design leads software design
D.

Defects are systematically analyzed

Correct Answer
A. Testers and developers work together

Explanation
Correct: Testers and developers work together fits ”test is behind schedule”.

Incorrect: A requirements-based testing strategy is OK but requirements are not mentioned in the scenario.

Incorrect: Testware design leads software design. Design problems not mentioned in scenario.

Incorrect: Defects are systematically analyzed is OK but already done, since defects are classified.

Rate this question:

46.

TM-6.2.1 (K2) Describe management issues when selecting an open-source tool Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for two years, but mostly a lot longer. New tests are developed by the most experienced test analysts as in-house custom test scripts. Variations of tests and the r egression test sets are run by the rest of the team. The company management require s monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. You r company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule Your company originally has built an in-house test automation tool as they anyway needed to build interfaces to drive test scripts against their system to fulfill all the telecom standard requirements. Maintaining the in-house tool has gradually become very costly. An open-source tool might free time from your test automation experts. You need to consider several factors before making this decision. Which one of the following statements does NOT apply?

A.

Open-source tools are hard to be adapted.
B.

The licensing terms need to be understood.
C.

The telecom-standard compliance needs to be considered.
D.

Open-source tools have been created for a particular purpose.

Correct Answer
A. Open-source tools are hard to be adapted.

Explanation
Correct: open source tools can be modified, and you have the capabilities, having earlier built custom tools, so you shouldn't care about adapting being hard.

Incorrect: The licensing terms need to be understood is a valid concern, as you need to adapt the tools and maybe give rights of your adaptations to open-source community, depending on licensing terms.

Incorrect: The telecom-standard compliance needs to be considered is a valid concern, as you need the telecom standard compliance.

Incorrect: Open-source tools have been created for a particular purpose is a valid concern, as you have your own specific purposes (which is why you originally had custom tools). Is the original purpose too far from what you need?

Rate this question:

47.

TM-6.2.2 (K2) Describe management issues when deciding on a custom tool Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for two years, but mostly a lot longer. New tests are developed by the most experienced test analysts as in-house custom test scripts. Variations of tests and the regression test sets are run by the rest of the team. The company management requires monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. Your company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule. When your company originally decided to build a custom in-house test tool, one reason for this decision was company’s unique hardware architecture. Maintenance of the test tool has proven to be time-consuming. You consider whether your business unit’s current custom-built tool is still valid, and you think about other options such as open-source software. Which of the following arguments BEST supports the validity of the custom-built tool choice?

A.

There are regularly substantial modifications to the hardware components, so also test tool needs to be adapted often
B.

The company has to follow telecom-standards
C.

The company has many developers capable of developing custom-built tool, so these skills should be utilized.
D.

The tool is easy to learn and use

Correct Answer
A. There are regularly substantial modifications to the hardware components, so also test tool needs to be adapted often

Explanation
Correct: the company’s hardware business unit changes hardware often (every six months).

Incorrect: The company has to follow telecom-standards would suggest using a ready-made tool, but standard-compliance could be met with custom-built tools also, although maybe with more effort.

Incorrect: The company has many developers capable of developing custom-built tool, so these skills should be utilized. This is a prerequisite, but not a reason.

Incorrect: The tool is easy to learn and use makes it attractive to keep the custom-made tool, but doesn't justify the great time spent to use and maintain the tool and the stem doesn't mention ease-of-use.

Rate this question:

48.

TM-6.2.3 (K4) Assess a given situation in order to devise a plan for tool selection, including risks, costs and benefits Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for two years, but mostly a lot longer. New tests are developed by the most experienced test analysts as in-house custom test scripts. Variations of tests and the regression test sets are run by the rest of the team. The company management requires monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. Your company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule You have heard that another similar software product line within your company is using an open-source tool for their test automation. They use it to automate roughly 50% of the tests and execute the remaining tests manually through the user interface of the software. You are requested to report if it is possible to select this tool for your product line as well. What are your key concerns? Mark exactly THREE options.

A.

How much time do you have to use for rewriting your existing tests?
B.

Is it possible to execute some part of your tests manually?
C.

Is it likely that your testers will achieve more with the new tool?
D.

Can all of your testers learn the new tool?
E.

How good is the support for the open-source tool?
F.

Is the new tool user-friendly?
G.

What about the security issues of the tool?

Correct Answer(s)
A. How much time do you have to use for rewriting your existing tests?
B. Is it possible to execute some part of your tests manually?
C. Is it likely that your testers will achieve more with the new tool?

Explanation
Correct: How much time do you have to use for rewriting your existing tests? you need to think about your existing large number of tests, also a ROI concern.

Correct: Is it possible to execute some part of your tests manually? you need to consider the possibility the tool is not enough to all your technical needs, even if it would be faster for some of them.

Correct: Is it likely that your tester s will achieve more with the new tool? it comes down to overall ROI and capability to be faster in the project under the tight deadlines.

Incorrect: Can all of your testers learn the new tool? How good is the support for the open-source tool? Is the new tool user-friendly? What about the security issues of the tool? not your major concern although good point to check in general.

Rate this question:

49.

TM-6.3.1 (K2) Explain the different phases in the lifecycle of a tool Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for two years, but mostly a lot longer. New tests are developed by the most experienced test analysts as in-house custom test scripts. Variations of tests and the regression test sets are run by the rest of the team. The company management requires monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. Your company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule You have heard that another similar software product line within your company is using an open-source tool for their test automation. They use it to automate roughly 50% of the tests and execute the remaining tests manually through the user interface of the software. If you choose the same open-source tool, which of the following activities shall happen first before retiring the current custom-built tool in order to have value as quickly as possible?

A.

The regression test scripts of the custom-built tool must be converted to the new tool.
B.

The custom-built tool must be maintained and converted to the new environment
C.

The backup and restore functionalities of the custom-built tool must be maintained.
D.

All test scripts of the custom-built tool must be converted to the new tool.

Correct Answer
A. The regression test scripts of the custom-built tool must be converted to the new tool.

Explanation
Correct: This is the correct answer concerning retirement, as there are lots of existing scripts, and regression test scripts are the ones used most often.

Incorrect The custom-built tool must be maintained and converted to the new environment activity is not necessary because the old tool will be retired.

Incorrect: The backup and restore functionalities of the custom-built tool must be maintained activity is not necessary because the old tool will be retired.

Incorrect: All test scripts of the custom-built tool must be converted to the new tool. Even if you would like, it is not realistic to convert all the scripts, if you can manage with just regression test scripts.

Rate this question:

50.

TM-6.4.1 (K2) Describe how metric collection and evaluation can be improved by using tools Question: You work for an international company producing hardware and software for telecom networks. Hardware and software development are done in separate business units. You are the test manager of one product line of network router software. In your product line there is a long tradition of creating tightly integrated products using an incremental product lifecycle. The hardware business unit produces a new version every six months. Your software product line aims to have a new version of the software ready for each new hardware version. The software is developed in two-month increments. The business unit schedules are synchronized during design. Your team consists of 15 testers, who have been in the company for two years, but mostly a lot longer. New tests are developed by the most experienced test analysts as in-house custom test scripts. Variations of tests and the regression test sets are run by the rest of the team. The company management require s monthly progress reports listing the number of severe defects found and the status of test execution. There have also been efforts to measure the efficiency of personnel in all business units. Your company has also implemented CMMI on company level. There have been problems to keep up with the hardware development schedule. The problems to keep up with the release schedule have been analyzed further. Preliminarily it seems that there is no time to cover enough of new requirements of a new release. You consider how to measure the coverage of your functional test scripts to help you achieve the release deadlines. Which one of the following options is the BEST choice?

A.

Capture traceability from test scripts to test requirements in a test management tool.
B.

Collect the number of test script executions per increment in a test management tool.
C.

Monitor the performance of the system, so you can tune its scalability
D.

Measure the number of hours spent on test script development as an attribute of the test script.

Correct Answer
A. Capture traceability from test scripts to test requirements in a test management tool.

Explanation
Correct: this metric will tell you automatically if you cover enough of the requirements to make it to the release deadline and if you have too much coverage on some areas.

Incorrect: Collect the number of test script executions per increment in a test management tool on its own doesn't tell anything, the tests could be all on same functional area. However, the measuring of test execution becomes easier with this.

Incorrect: Monitor the performance of the system, so you can tune its scalability concerns performance testing tools.

Incorrect: Measure the number of hours spent on test script development as an attribute of the test script this might help make collecting hours easier, but on its own doesn't help, time is mentioned as problem, so that might lead you to this option.

Rate this question:

ISTQB Ctal Tm 2012

TM-1.8.1 (K2) Summarize the four groups of test closure activities Question: Which ONE of the following is an accurate summary of the test closure activity “test completion check”?

TM-2.2.3 (K2) Explain ways to manage the test management issues associated with experience-based testing and non-functional testing Question: Which ONE of the following statements describes an appropriate approach to managing non-functional testing?

TM-2.3.1 Explain the different ways that risk-based testing responds to risks Question: Which ONE of the following statements BEST describes how risk-based testing responds to risks?

TM-2.3.2 (K2) Explain, giving examples, different techniques for product risk analysis Question: Which of the following statements are examples of different techniques for analyzing the risks to product quality?

TM 2.3.5 - (K2) Give examples of different options for test selection, test prioritization and effort allocation Question: Which ONE of the following is NOT a practical technique for test prioritization and effort allocation?

TM-2.5.2 (K2) Understand and give examples of factors which may influence test estimates Question: Which ONE of the following will most probably influence the duration, but not the effort of the testing activities?

TM-2.6.1 (K2) Describe and compare typical testing related metrics Question: Which one of the following statements about testing metrics usage is TRUE?

TM-2.6.2 (K2) Compare the different dimensions of test progress monitoring Question: Which one of the following alternatives is best to monitor test progress?

TM 2.9.1 - (K2) Summarize sources and uses of standards for software testing Which ONE of the following BEST describes a software standard that provides guidance on test coverage criteria to be achieved?

TM-5.2.1 (K2) Explain, using examples, why it is important to improve the test process. Question: Which TWO of the following statements are the best examples of the importance of improving the test process?

TM-5.5.1 (K2) Summarize the background, scope and objectives of the TPI Next test process improvement model Question: Which ONE of the following statements about the test maturity matrix of TPI Next is true?

TM-5.6.1 (K2) Summarize the back ground, scope and objectives of the CTP test process improvement model Question: Which of the following is an example of achieving an objective for the CTP test process improvement model?