CSQA Prep - Chapter 3 - Quality Baselines | Attempts: 441

1.

What is a Baseline (check all that apply):

A.

Where we are going
B.

Where we are
C.

What we are doing
D.

Current level of performance

Correct Answer(s)
B. Where we are
D. Current level of performance

Explanation
(3-1) Developing a baseline is performing an analysis/study to determine the current level of performance in a specific activity.

Rate this question:

2.

There are two approaches to conduct baseline studies. Choose the two approaches from the following:

A.

Sample survey
B.

Interviewing
C.

Evaluate entire population
D.

Researching

Correct Answer(s)
A. Sample survey
C. Evaluate entire population

Explanation
(3-2) Baseline studies can be conducted in one of the following two manners:
• Evaluate entire population
This means all of the parties or products involved will be surveyed. This method is normally
most effective when the information to be analyzed is automated. For example, when looking
at factors such as schedule and budget.
• Sample survey
Using this method, only a part of the population of people/products are surveyed. This
approach is normally most effective when there is a large population to be surveyed and the
data is not automated. While sampling should be done statistically, it is not essential in these
studies for valid statistical samples to be drawn. The reason is that quality is attempting to
eradicate all defects, and even if the defect is only perceived by a part of the population, it is
still a defect and warrants attention.

Rate this question:

3.

This approach to a baseline study is most effective when the information to be analyzed is automated, i.e. when looking at factors such as schedule and budget. Choose one:

A.

Interviewing
B.

Evaluate entire population
C.

Researching
D.

Sample survey

Correct Answer
B. Evaluate entire population

Explanation
(3-2)Evaluate entire population
This means all of the parties or products involved
most effective when the information to be
at factors such as schedule and budget.

Rate this question:

4.

The following are the most logical groups to conduct baseline studies (choose all that apply):

A.

IT Management
B.

Quality task forces
C.

Business partners
D.

Quality assurance groups
E.

Operations Management

Correct Answer(s)
A. IT Management
B. Quality task forces
D. Quality assurance groups

Explanation
(3-2 - 3-3)
Quality assurance groups
If one has been established, they should conduct baseline studies in areas of quality concern.
• Quality task forces
A special task force or committee established to study quality/productivity in an information
services function. In many instances these study groups precede the establishment of a quality
assurance function. In fact, many of the individuals who chair the study group later become the
quality assurance manager.
• IT management
Specific managers that have a concern over quality may wish to perform a baseline study. Note
that in many instances the study is actually conducted by a subordinate to that manager.

Rate this question:

5.

Which of the following is NOT one of the most commonly used baseline methods?

A.

Management - established criteria
B.

Benchmarking
C.

Industry models
D.

Existing methodologies
E.

Customer surveys

Correct Answer
D. Existing methodologies

Explanation
(3-7) To help understand the type of baselines that are used in IT, QAI has
categorized four most commonly used baselines as listed below.
• Customer surveys
• Benchmarking
• Management established criteria
• Industry models

Rate this question:

6.

Objective baseline studies are based on fact and are most commonly used within IT.

A.

True
B.

False

Correct Answer
B. False

Explanation
(3-4)Objective baseline studies are ones which are viewed as factual and non-argumentative. There are
very few objective studies that can be conducted within information services.

Rate this question:

7.

A management-developed baseline for anything they feel needs to be measured and/or improved is considered what type of baseline (choose one):

A.

IT Climate
B.

Organizational dependent
C.

Employee perception
D.

Perception of events
E.

Human behaviors

Correct Answer
B. Organizational dependent

Explanation
(3-10) Management can develop a baseline for anything they feel needs to be measured and/or improved.
These are baselines that are organizational dependent. There are no industry models or standards
against which a baseline can be determined.

Rate this question:

8.

The organizational climate is the (choose one):

A.

Organizational effectiveness
B.

Opportunities for growth in the organization
C.

Temperature and humidity in the workers' building
D.

Worker's attitude toward their organization

Correct Answer
D. Worker's attitude toward their organization

Explanation
(3-10) The organizational climate is the workers’ attitude toward their organization. It is a composite of
human behaviors, perception of events, responses of employees to one another, expectations,
interpersonal conflicts, and the opportunities for growth in the organization. The climate is crucial
in creating and maintaining an effective organization, and, therefore, should be periodically
evaluated to discover whether the satisfaction level of the employees is positive or negative.

Rate this question:

9.

When the individual involved in recording measurable results has the option of applying judgement, then the measure becomes subjective.

A.

True
B.

False

Correct Answer
A. True

Explanation
(3-5)Subjective baseline studies will be the most commonly conducted studies in measuring quality and
productivity. Subjective means that judgment is applied in making the measure. We noted in the
discussion on objective measures that when the individual involved in recording time has the
option of applying judgment, then the measure becomes subjective.

Rate this question:

10.

What are the two types of models used in the industry today?

A.

Continuous
B.

Organizational
C.

Staged
D.

Procedural

Correct Answer(s)
A. Continuous
C. Staged

Explanation
(3-13)Staged models
Staged models are composed of a number of distinct levels of maturity. Each level of maturity is
further decomposed into a number of processes that are fixed to that level of maturity. The
processes themselves are staged and serve as foundations for the next process. Likewise, each level
of maturity is the foundation for the next maturity level.
Continuous models
In the continuous model, processes are individually improved along a capability scale independent
of each other.

Rate this question:

11.

In a continuous model, the project planning process could be at a higher capability level than the quality assurance process.

A.

True
B.

False

Correct Answer
A. True

Explanation
(3-14) In the continuous model, processes are individually improved along a capability scale independent
of each other. For example, the project planning process could be at a much higher capability level
than the quality assurance process.

Rate this question:

12.

Which of the following are steps which can be used by an evaluator to assess the climate of a specific organization (choose all that apply):

A.

Create a dialog with members of the group
B.

Examine the jobs
C.

Evaluate how employees feel about their manager or leader
D.

Look at the organization's mission and goals
E.

All of the above

Correct Answer
E. All of the above

Explanation
(3-10) An evaluator can use the six steps below to assess the climate of a specific organization, group,
committee, task force, etc.
1. Look at the organization (group, committee, task force, etc.)
Assess the mission and goals of the organization, what it is supposed to produce, and
the overriding principles by which it operates.
2. Examine the jobs
Examine each job in the organization. Ask whether the job is necessary, whether it
makes full use of the employee’s capabilities, and whether it is important in
accomplishing the mission and goals of the organization.
3. Assess employees’ performance
Evaluate each employee’s performance in relation to the organization’s mission and
goals. For each job being performed, ask if the employee is doing what should be done,
is using his or her skills effectively, likes his or her job, and has enthusiasm and interest
in performing the job.
4. Evaluate how employees feel about their manager or leader
Good organizational climate requires good leadership. Determine whether each
employee within the group likes his or her manager, whether they follow or ignore the
requests of their manager, and whether they attempt to protect their manager (i.e., make
their manager look good).
5. Create a dialog with the members of the group
Interact with each employee asking a series of hypothetical questions to identify the
employee's true feelings toward the organization. Questions such as, “do you feel the
organization supports your suggestions”, can help draw out the true feelings of each
employee.
6. Rate organizational climate
Based on the responses to steps 1-5, evaluate the climate based on the 5-point scale on p. 3-10.

Rate this question:

13.

The Software Engineering Institute's Capability Maturity Model Integration is an example of a _______ model.

Correct Answer
Staged

Explanation
(3-13)The Software Engineering Institute’s Capability Maturity Model Integration (CMMI®1) is an
example of a staged model, although it now has a continuous representation.

Rate this question:

4

14.

Which one of the following is NOT a criteria for selecting a model?

A.

Need for measurable goals and objectives
B.

Applicability to the organization's goals and objectives
C.

Ease of use
D.

Management commitment
E.

Need for baseline assessments

Correct Answer
C. Ease of use

Explanation
(3-14)An organization should consider these four criteria when selecting a model:
• Applicability of the model to the organization’s goals and objectives.
Management commitment
Need for baseline assessments
Need for measurable goals and objectives

Rate this question:

15.

An assessment is a process used to measure the current level of performance or service. Therefore it is used to establish a ________. (3-15)

Correct Answer
baseline

Explanation
An assessment is a process used to measure the current level of performance or service. The
objective is to establish a baseline of performance. You can measure against an internationally
accepted model or an organization’s own defined criteria.

Rate this question:

4

16.

A model is an idealized _______ to be accomplished.

Correct Answer
concept
idea

Explanation
(3-12)A model is an idealized concept to be accomplished. Models are usually developed under the
auspice of national or international standards organizations and may be customized or ‘tailored’ to
meet new or changing needs.

Rate this question:

4

17.

Which of the following are factors used to evaluate the quality award process for the Malcolm Baldridge National Quality Award? (3-22)

A.

Approach
B.

Deployment
C.

Learning
D.

Integration
E.

None of the above

Correct Answer(s)
A. Approach
B. Deployment
C. Learning
D. Integration

Explanation
Process
Process refers to the methods your organization uses and improves to address the Item
requirements in Categories 1-6. The four factors used to evaluate process are Approach,
Deployment, Learning, and Integration (A-D-L-I).
“Approach” refers to:
• The methods used to accomplish the process
• The appropriateness of the methods to the Item requirements
• The effectiveness of your use of the methods
• The degree to which the approach is repeatable and based on reliable data and information
(i.e., systematic)
“Deployment” refers to the extent to which:
• Your approach is applied in addressing Item requirements relevant and important to
your organization
• Your approach is applied consistently
• Your approach is used by all appropriate work units
“Learning” refers to:
• Refining your approach through cycles of evaluation and improvement
• Encouraging breakthrough change to your approach through innovation
• Sharing of refinements and innovation with other relevant work units and processes
in your organization
“Integration” refers to the extent to which:
• Your approach is aligned with your organizational needs identified in other Criteria
Item requirements
• Your measures, information, and improvement systems are complementary across
processes and work units
• Your plans, processes, results, analyses, learning, and actions are harmonized across
processes and work units to support organization-wide goals
“Results” refers to your organization’s outputs and outcomes in achieving the requirements in
Category 7. The four factors used to evaluate results are:
• Your current level of performance
Quality Baselines
Version 6.2 3-25
• Rate (i.e., slope of trend data) and breadth (i.e., how widely deployed and shared) of
your performance improvements
• Your performance relative to appropriate comparisons and/or benchmarks
• Linkage of your results measures (often through segmentation) to important customer,
product and service, market, process, and action plan performance requirements
identified in your Organizational Profile and in Process Items.

Rate this question:

18.

Baselines can be conducted for the following purposes (choose all that apply):

A.

Benchmarking
B.

Making sure the runner stays within bounds
C.

Internal Analysis
D.

Planning
E.

None of the above

Correct Answer(s)
A. Benchmarking
C. Internal Analysis
D. Planning

Explanation
(3-6)Planning
To determine where detailed investigation/survey should be undertaken.
Internal analysis
To identify problems/areas for quality improvement. Once the problem/area has been
identified, then no additional effort need be undertaken to formalize the results.
Benchmarking
Comparison against external organizations.

Rate this question:

19.

An audit is an independent appraisal activity and performed by someone independent of the activity under audit. What are the two general categories of auditors? (3-15)

A.

External
B.

Federal tax
C.

Bank
D.

Internal

Correct Answer(s)
A. External
D. Internal

Explanation
An audit is an independent appraisal activity. While assessments may be done by the individuals
involved in conducting the work, an audit is performed by someone independent of the activity
under audit.
There are two general categories of auditors. These are auditors external to the organization
(external auditors), and auditors internal to the organization (internal auditors). The external
auditors are normally engaged by the organization’s Board of Directors to perform an independent
audit of the organization. Internal auditors are employees of the organization that they audit.

Rate this question:

20.

The five maturity levels in the SEI CMMI Framework are: (3-17):Level 1: InitialLevel 2: ManagedLevel 3: DefinedLevel 4: Quantitatively ManagedLevel 5: Optimizing

A.

True
B.

False

Correct Answer
A. True

Explanation
As shown in Figure 3-1, the CMMI® framework is a method for organizing these steps into five
levels of maturity. Each maturity level defines an evolutionary plateau of process improvement and
stabilizes an important part of the organization’s processes.
The five maturity levels are:
Level 1: Initial
At the initial level, an organization does not provide a stable environment for developing and
maintaining software. When an organization lacks sound management practices, the benefits of
good software engineering practices are undermined by reaction-driven commitments. In a
crisis, projects typically abandon any planned procedures and revert to a code and fix
methodology. Success depends on having exceptional people.
The process capability at Level 1 is considered ad hoc because the software development
process constantly changes as the work progresses. Schedules, budgets, functionality, and
product quality are generally unpredictable.
Level 2: Managed
Level 2 organizations have installed basic management controls. Policies for managing a
software project and procedures to implement those policies are established. Planning and
managing projects is based on experience with similar projects. Realistic project commitments
are based upon the results observed on previous projects and on the requirements of the current
project. Project managers track software costs, schedules, and functionality. Problems in
meeting commitments are identified when they arise. Software requirements and the work
products developed to satisfy them are baselined and their integrity is controlled.
The capability of Level 2 organizations is summarized as disciplined, because the ability to
successfully repeat planning and tracking of earlier projects results in stability. To be certified
at Level 2, organizations must document (define), practice, enforce, train, measure, and
improve the following six key process areas:
• Requirements Management
• Software Project Planning
• Software Project Tracking
• Software Subcontract Management
• Software Quality Assurance
• Software Configuration Management
Level 3: Defined
The standard engineering and management processes for developing and maintaining software
across an organization are documented, and these processes are integrated as a whole. There is
a group responsible for the organization’s software process activities, e.g., a standards
development group. An organization-wide training program is implemented to ensure that the
staff and the managers have the knowledge and skills required to fulfill their assigned roles.
Quality Baselines
Version 6.2 3-19
The capability of Level 3 organizations is summarized as standard and consistent because
engineering and management activities are stable and repeatable. Product lines, cost, schedule,
and functionality are under control and quality is tracked. Process definition and deployment
focus on the following key process areas:
• Organization Process Focus
• Organization Process Definition
• Training
• Integrated Software Management
• Software Product Engineering
• Inter-group Coordination
• Peer Reviews
Level 4: Quantitatively Managed
A Level 4 organization sets quantitative quality goals for both software products and processes.
Productivity and quality are measured and included in an organization-wide database. Projects
achieve control over their products and processes by narrowing the variation in their process
performance to fall within acceptable quantitative boundaries.
The capability of Level 4 organizations is summarized as predictable because the process is
measured and operates within measurable limits. Quantitative Process Management and
Software Quality Management are the two key process areas of Level 4.
Level 5: Optimizing
At Level 5 the entire organization is focused on continuous process improvement. The
organization has the means to identify weaknesses and strengthen the process proactively, with
the goal of preventing the occurrence of defects. Software project teams analyze defects to
determine their root causes, and lessons learned are disseminated to other projects.
The capability of Level 5 organizations is characterized as continuously improving, because
projects strive to improve the process capability and process performance. Key process areas of
Level 5 are:
• Defect Prevention
• Technology Change Management
• Process Change Management

Rate this question:

21.

Is the model described below a staged or continuous model? (3-18) Level 1: InitialLevel 2: ManagedLevel 3: DefinedLevel 4: Quantitatively ManagedLevel 5: Optimizing

Correct Answer
Staged

Explanation
(3-32)
• Acquirers and suppliers see a contract view, which includes the acquisition and supply
processes and begins with a contractual relationship to supply software. Depending on the contract, the supply process may use the development process to create new software, the operation process to provide software operation services, or the maintenance process to
repair or improve the software.
• Operators see an operating view, which includes the operations process. The operations
process may use the maintenance process.
• Developers and maintainers see the engineering view, which includes the maintenance and
development processes. The maintenance process may also use the development process.
• The employer of supporting processes sees the supporting view, which includes the eight
supporting processes.
• Managers see the corporate view, which includes the four organizational processes.

Rate this question:

4

34.

The target audience for ISO/IEC 12207 is: (choose all that apply)

A.

Organizations acquiring a system that contains software or a stand-alone software product
B.

Organizations that supply software products
C.

Organizations involved in software operation or software maintenance
D.

None of the above

Correct Answer(s)
A. Organizations acquiring a system that contains software or a stand-alone software product
B. Organizations that supply software products
C. Organizations involved in software operation or software maintenance

Explanation
(3-32) The target audience for ISO/IEC 12207 is:
• Organizations acquiring a system that contains software or a stand-alone software
product
• Organizations that supply software products
• Organizations involved in software operation or software maintenance
The standard is especially applicable for acquisitions, as it recognizes the distinct roles of acquirer
and supplier. Its intended use is for the two parties of an agreement or contract that defines the
development, maintenance, or operation of software. It does not apply to the purchase of
commercial off-the-shelf software products. It is also intended for use with trained, experienced
developers, managers, and acquirers of software.

Rate this question:

35.

A post-implementation audit is conducted to determine any, or all, of the following: • The system objectives were met • The system specifications were implemented as specified • The developmental standards were followed • The IT quality objectives (e.g., maintainability) were achieved

A.

True
B.

False

Correct Answer
A. True

Explanation
(3-42) A post-implementation audit is conducted to determine any, or all, of the following:
• The system objectives were met
• The system specifications were implemented as specified
• The developmental standards were followed
• The IT quality objectives (e.g., maintainability) were achieved

Rate this question:

36.

Post-implementation audits are a _ ___activity.

Correct Answer
quality assurance
QA

Explanation
(3-42) Post-implementation audits are a quality assurance activity. The post-implementation audit is used
to assess the ability of the IT organization to perform effective and efficient work. The results of the
audit will be used to both improve the software system and to improve the process that builds
software systems.

Rate this question:

4

37.

Which of the following are typical steps for performing a baseline study? (Choose all that apply)

A.

Follow up on incomplete surveys
B.

Develop survey instrument
C.

Define conformance and nonconformance
D.

Identify survey population
E.

Take action and notify participants of the that action

Correct Answer(s)
A. Follow up on incomplete surveys
B. Develop survey instrument
C. Define conformance and nonconformance
D. Identify survey population

Explanation
(3-3) The following are typical steps needed to perform a baseline study.
1. Identify products/services to be surveyed
This is the requirements phase of the baseline study. Studies should be directed at
specific products or services. For example, computer programs as a product, and
customer/user interaction as a service.
2. Define conformance and nonconformance
The individuals developing the survey instrument must have defined (at least on a
preliminary basis) the expected conformance and nonconformance. Note that in many
instances the survey will be used to help establish nonconformance, but the general
areas of nonconformance will need to be identified in order to gather nonconformance
data.
3. Identify survey population
The population of data/people to be surveyed needs to be identified. This is a critical
step because the definition of nonconformance will vary significantly depending upon
who is considered the population. For example, programming defects would look
significantly different to the programmer than the end user of the program results. The
programmer may only consider variance from specs a defect, but to the end user not
meeting needs is a defect.
4. Identify size of population to be surveyed
This step is one that involves economics. It is always cheaper to look at fewer than
more. The question that needs to be decided is how few can be examined to give valid
results. Statistically, we rarely try to go below a sample size of twenty, but in surveying
people we may be able to drop below this limit and still get valid results.
5. Develop survey instrument
A specific survey instrument must be developed to meet the survey objectives. Surveys
need to be customized to the specific needs and vocabulary of the population being
surveyed.
6. Conduct survey
The survey instruments should be completed by the surveyed population. From a
quality perspective; it is helpful to train the population on how to complete the survey
questionnaire. This can be done through written instructions, but it is normally better to
do it verbally. If the population group is small, they can be called together for a
meeting, or have the survey instruments hand delivered and explained. Generally, the
validity of the results will increase when extra time is spent to explain the intent and
purpose of the survey.
7. Follow up on incomplete surveys
The survey should have a time limit for response. Normally this should not exceed one
week. If the surveys have not been returned by that time, then the surveying group
should follow up and attempt to get as many surveys completed as possible. Note that it
is generally not realistic to expect every survey to be returned.
8. Accumulate and present survey results
The survey information should be accumulated, consolidated, and put into presentation
format. Suggestions on how to do this follow in a later part of this quality initiative.
9. Take action and notify participants of that action
All surveys should result in some specific action. Even if that action is to do nothing, a
decision should be made based on the survey results. That decision should be given to
the survey participants. Note that whenever a survey is conducted, the participants
expect some action.

Rate this question:

0

1

38.

Which of the following are examples of objective measures: (Choose all that apply)

A.

Number of abnormal terminations
B.

Project completed on schedule
C.

Number of people assigned to a project
D.

Number of programs
E.

Lines of code

Correct Answer(s)
A. Number of abnormal terminations
B. Project completed on schedule
C. Number of people assigned to a project
D. Number of programs
E. Lines of code

Explanation
(3-5) Objective measures are those, which can be accomplished by counting. Examples of objective
baseline measures that can be used for baselines include:
• Project completed on schedule
• Lines of code
• Number of programs
• Number of people assigned to a project
• Number of abnormal terminations
Again, the exactness of the counting will actually determine whether the above measures are
objective or subjective. It is important to recognize that there are very few objective measures, and
thus we are forced to use subjective measures in measuring quality and productivity.

Rate this question:

39.

Baselines should be ____________ even if it is a subjective measure.

Correct Answer(s)
quantitative
quantified

Explanation
(3-5) Baselines should be quantitative even if it is a subjective measure, but quantitatively subjective. For
example, because quality conformance and nonconformance must be defined by people, we are
looking for ways to put this information into a quantifiable format. This does not convey a lot of
information, but it is indicative of a problem. However, if we develop a five-point scale for
unresponsiveness, and ask your dissatisfied customer to complete that scale, we now have
conveyed a lot more information. If our scale rates “1” as very poor service, and “5” as very good
service, there is a great deal of difference between a “1” rating and a “3” rating for dissatisfaction.

Rate this question:

4

40.

Examples of products/services that can be measured subjectively for developing a baseline include: (Choose all that apply)

A.

Understandability of training materials
B.

Areas/activities causing the greatest impediments to quality/productivity
C.

Value of tools
D.

Effectiveness of standards/manuals
E.

None of the above

Correct Answer(s)
A. Understandability of training materials
B. Areas/activities causing the greatest impediments to quality/productivity
C. Value of tools
D. Effectiveness of standards/manuals

Explanation
(3-5) Examples of products/services that can be measured subjectively for developing a baseline include:
• Customer satisfaction
• Effectiveness of standards/manuals
• Helpfulness of methodologies to solve problems
• Areas/activities causing the greatest impediments to quality/productivity
• Causes for missed schedules/over-budget conditions
• Understandability of training materials
• Value of tools
• Importance of activities/standards/methods/tools to individual activity

Rate this question:

41.

Baselines can be conducted for any one of the following three purposes: (Choose any 3)

A.

Benchmarking
B.

Auditing
C.

Planning
D.

Project definition
E.

Internal Analysis

Correct Answer(s)
A. Benchmarking
C. Planning
E. Internal Analysis

Explanation
(3-6) Baselines can be conducted for any one of the following three purposes:
Planning
To determine where detailed investigation/survey should be undertaken.
Internal analysis
To identify problems/areas for quality improvement. Once the problem/area has been
identified, then no additional effort need be undertaken to formalize the results.
Benchmarking
Comparison against external organizations.

Rate this question:

42.

Customer surveys use the "_ _ ___" definition of quality.

Correct Answer(s)
fit for use

Explanation
(3-7) Skill Category 1 provides two definitions of quality. These were “meets requirements” and “fit for
use.” Customer surveys use the “fit for use” definition of quality. Customer surveys are subjective
baselines. Customer surveys measure attitude and satisfaction of customers with the products and
services they receive. Because they are subjective it is important that customer surveys are properly
constructed.

Rate this question:

4

43.

If we wanted to poll the customer on a scale of 1 to 5 on their satisfaction with the user manuals provided by IT, a Report Card would be the method used.

A.

True
B.

False

Correct Answer
A. True

Explanation
(3-7) We can divide customer surveys into report cards and surveys. Report cards ask the customer what
they think about something, for example, were they satisfied with the user manuals provided by IT.
The report card will ask them on a scale of 1-to-5, one meaning very pleased and five meaning very
displeased, on what they think of the user manual. Because the report card is not controlled, it is
sometimes difficult to know how the user calculated a particular rating.

Rate this question:

44.

Most baselining processes have the following steps: (Choose all that apply)

A.

Compare baseline calculations
B.

Identify the cause of baseline variance in the organization you benchmarked against
C.

Identify the organizations you desire to baseline against
D.

Develop a clearly defined baseline in your organization
E.

None of the above

Correct Answer(s)
A. Compare baseline calculations
B. Identify the cause of baseline variance in the organization you benchmarked against
C. Identify the organizations you desire to baseline against
D. Develop a clearly defined baseline in your organization

Explanation
(3-8)There are many different steps that organizations follow in benchmarking. However, most
baselining processes have these four steps:
1. Develop a clearly defined baseline in your organization.
This means that all of the attributes involved in your baseline are defined. In our
example of defects per lines of code, clearly defining what is meant by defect and a line
of code would meet the objective of this step.
2. Identify the organizations you desire to baseline against.
Many factors come into this decision, such as do you want to benchmark within your
industry, do you want to benchmark what you believe are leading organizations, do you
want to benchmark an organization that uses the same tools that are used in your
organization, and do you want to benchmark against organizations with a similar
culture.
3. Compare baseline calculations.
Compare how your baseline is calculated versus the baseline calculation in the
company you want to benchmark against. Benchmarking is only effective when you
benchmark against an organization who has calculated their baseline using
approximately the same approach that your organization used to calculate the baseline.
4. Identify the cause of baseline variance in the organization you benchmarked against.
When you find a variance between the baseline calculation in your company and the
baseline calculation in the organization you are benchmarking against, you need to
identify the cause of variance. For example, if your organization was producing 20
defects per thousand lines of code, and you benchmarked against an organization that
only had 10 defects per thousand lines of code you would want to identify the cause of
the difference. If you cannot identify the cause of difference, there is little value in
benchmarking. Let us assume that the company you benchmarked against had a
different process for requirement definition than your organization. For example,
assume they use JAD (joint application development) and you did not. Learning this,
you may choose to adopt JAD in your organization as a means for reducing your
developmental defect rates.

Rate this question:

45.

A less formal method for benchmarking is to visit other organizations. Select from the following all the steps in this process:

A.

Conduct the visit
B.

Identify discussion areas
C.

Schedule the visit
D.

Put new practice into use
E.

Identify target companies

Correct Answer(s)
A. Conduct the visit
B. Identify discussion areas
C. Schedule the visit
D. Put new practice into use
E. Identify target companies

Explanation
(3-9)A less formal method for benchmarking is to visit other organizations. This will provide the quality
professionals with these benefits:
• The cost and effort to develop new and innovative quality approaches within IT is
cost-prohibitive for most companies. Learn from others and don’t “reinvent the
wheel”.
• Comparing quality programs to those in other companies can identify gaps in current
processes and lead to obtaining more effective quality practices.
• Interfacing periodically with other quality individuals is good for professional
development. Those colleagues will not exist internally unless the company is
large.
Visiting another company is a five-step process, as follows:
1. Identify discussion areas
As it is important for the visit to be mutually advantageous, get management agreement
on what oral and written information can be shared with the company being visited.
Determine the objective of the visit.
• Identify a specific area such as conducting software reviews or independent
testing.
• If the objective is to gather general information, convert it into a visit objective,
such as identifying the three most effective quality practices used by the
other company.
2. Identify target companies
Visits can be within divisions or subsidiaries of the corporation, or to other
organizations or corporations. Identify constraints that need to be considered as part of
the selection process. Consider items such as whether information can be exchanged
with competitors, the availability of travel funds, whether the size of the target
company should be similar, and whether the maturity of the company's quality function
lends itself to the topics selected (starting a quality function requires a company that
has gone through the process). Select three target companies, prioritizing them by the
desirability, and obtain management's approval to schedule a visit with them.
3. Schedule the visit
Contact your peers at the targeted companies. Identify yourself and your company.
State the purpose for the visit, what you can share, the information you would like to
receive in exchange and how the visit would be mutually advantageous. Offer to
provide a letter requesting the visit if your colleague needs it to get the visit approved.
Set a date and time for the visit. One-half to two days is recommended.
4. Conduct the visit
Visits typically begin with introductions, a restatement of the objectives of the visit and
a tour of the other company’s facilities to put the size and purpose of the IT function in
perspective. Agenda items are then discussed in detail. Written documentation is
exchanged and agreement for usage (such as copying, reworking, distributing, etc.) is
given. The visit concludes by thanking management of the other company, and, if
possible, leaving some memorabilia or some of your company’s products as a token of
remembrance.
5. Put new practice into use
Select the one best idea from the visit for implementation. Demonstrating a positive
outcome from these visits will increase the chance of management approving other
visits. Do not try to implement too many things at once

Rate this question:

46.

A Benchmark is an industry or best-of-class norm.

A.

True
B.

False

Correct Answer
A. True

Explanation
(A-1) Benchmark An industry or best-of-class norm.

Rate this question:

47.

The ISO 9001:2000 model was developed with emphasis on the following needs:

A.

Promote use of continuous improvement and prevention of non-conformity
B.

Consistency with the Plan-Do-Check-Act improvement cycle
C.

Simplicity of use, ease of understanding, and use of clear language and terminology
D.

A common structure based upon a Process Model
E.

None of the above

Correct Answer(s)
A. Promote use of continuous improvement and prevention of non-conformity
B. Consistency with the Plan-Do-Check-Act improvement cycle
C. Simplicity of use, ease of understanding, and use of clear language and terminology
D. A common structure based upon a Process Model

Explanation
(3-25) In 1997, ISO conducted a large global survey to better understand their needs. This survey revealed
the need to substantially re-engineer the model itself, with an emphasis on four needs:
• A common structure based upon a Process Model
• Promote use of continuous improvement and prevention of non-conformity
• Simplicity of use, ease of understanding, and use of clear language and terminology
• Consistency with the Plan-Do-Check-Act improvement cycle

Rate this question:

48.

The ISO 9001:2000 standards are based on the following quality management principles: (Choose all that apply)

A.

Customer Focus, Leadership
B.

Involvement of People, Process Approach
C.

System Approach to Management, Continuous Improvement
D.

Factual Approach to Decision-Making, Mutually Beneficial Supplier Relationships
E.

All of the above

Correct Answer
E. All of the above

Explanation
(3-26) The ISO 9001:2000 standards are based on the following eight quality management principles.
1. Customer Focus
2. Leadership
3. Involvement of People
4. Process Approach
5. System Approach to Management
6. Continuous Improvement
7. Factual Approach to Decision-Making
8. Mutually Beneficial Supplier Relationships

Rate this question:

49.

The following are true of the ISO/IEC 12207 model: (Check all that apply)

A.

Covers software lifecycle from concept through retirement
B.

Processes broken down into activities
C.

Organization should tailor a process to the scope, size, complexity and criticality of the software by removing inapplicable activities
D.

Framework for managing, controlling, improving the software life cycle activities
E.

17 processes in the standard (Primary, Supporting, Organization)

Correct Answer(s)
A. Covers software lifecycle from concept through retirement
B. Processes broken down into activities
C. Organization should tailor a process to the scope, size, complexity and criticality of the software by removing inapplicable activities
D. Framework for managing, controlling, improving the software life cycle activities
E. 17 processes in the standard (Primary, Supporting, Organization)

Explanation
(3-29) ISO/IEC 12207, which was published in 1995, is the international standard that covers the software
life cycle from concept through retirement. It contains a framework for managing, controlling, and
improving the software life cycle activities. The standard describes the major processes of the
software life cycle, how these processes interface with each other, and the high- level relations that
Guide to the CSQA CBOK
3-30 Version 6.2
govern their interactions. It has subsequently been amended twice; Amendment 1 defines a
Software Engineering Process Reference Model for use with ISO/IEC 15504 Process Assessment.
For each process, the standard also describes the activities and tasks involved, defining specific
responsibilities and identifying outputs of activities and tasks. Since it is a high-level standard, it
does not detail how to perform the activities and tasks. The standard does not assume a specific life
cycle model, nor does it specify names, format, or content of documentation. As a result,
organizations applying ISO/IEC 12207 should use other standards and procedures to specify these
types of details.
The 17 processes covered in this standard are grouped into three categories, as follows:
Primary Processes
• Acquisition Process
• Supply Process
• Development Process
• Operation Process
• Maintenance Process
Supporting Processes
• Documentation Process
• Configuration Management Process
• Quality Assurance Process
• Verification Process
• Validation Process
• Joint Review Process
• Audit Process
• Problem Resolution Process
Organization Processes
• Management Process
• Infrastructure Process
• Improvement Process
• Training Process

Rate this question:

50.

The target audience for ISO/IEC 12207 is: (Choose all that apply)

A.

Organizations acquiring a system that contains software or a stand-alone software
B.

Organizations that utilize software products
C.

Organizations that market software products
D.

Organizations involved in software operation or software maintenance
E.

Organizations that supply software products

Correct Answer(s)
A. Organizations acquiring a system that contains software or a stand-alone software
D. Organizations involved in software operation or software maintenance
E. Organizations that supply software products

Explanation
(3-32) The target audience for ISO/IEC 12207 is:
• Organizations acquiring a system that contains software or a stand-alone software
product
• Organizations that supply software products
• Organizations involved in software operation or software maintenance
The standard is especially applicable for acquisitions, as it recognizes the distinct roles of acquirer
and supplier. Its intended use is for the two parties of an agreement or contract that defines the
development, maintenance, or operation of software. It does not apply to the purchase of
commercial off-the-shelf software products. It is also intended for use with trained, experienced
developers, managers, and acquirers of software.

Rate this question:

CSQA Prep - Chapter 3 - Quality Baselines

What is a Baseline (check all that apply):

There are two approaches to conduct baseline studies. Choose the two approaches from the following:

This approach to a baseline study is most effective when the information to be analyzed is automated, i.e. when looking at factors such as schedule and budget. Choose one:

The following are the most logical groups to conduct baseline studies (choose all that apply):

Which of the following is NOT one of the most commonly used baseline methods?

Objective baseline studies are based on fact and are most commonly used within IT.

A management-developed baseline for anything they feel needs to be measured and/or improved is considered what type of baseline (choose one):

The organizational climate is the (choose one):

When the individual involved in recording measurable results has the option of applying judgement, then the measure becomes subjective.

What are the two types of models used in the industry today?

In a continuous model, the project planning process could be at a higher capability level than the quality assurance process.

Which of the following are steps which can be used by an evaluator to assess the climate of a specific organization (choose all that apply):

The Software Engineering Institute's Capability Maturity Model Integration is an example of a _______ model.

Which one of the following is NOT a criteria for selecting a model?

An assessment is a process used to measure the current level of performance or service. Therefore it is used to establish a ________. (3-15)

A model is an idealized _______ to be accomplished.

Which of the following are factors used to evaluate the quality award process for the Malcolm Baldridge National Quality Award? (3-22)

Baselines can be conducted for the following purposes (choose all that apply):

An audit is an independent appraisal activity and performed by someone independent of the activity under audit. What are the two general categories of auditors? (3-15)

The five maturity levels in the SEI CMMI Framework are: (3-17):Level 1: InitialLevel 2: ManagedLevel 3: DefinedLevel 4: Quantitatively ManagedLevel 5: Optimizing

Is the model described below a staged or continuous model? (3-18) Level 1: InitialLevel 2: ManagedLevel 3: DefinedLevel 4: Quantitatively ManagedLevel 5: Optimizing

A maturity level is a well-defined evolutionary plateau for achieving a ______ software process. (3-17)

The capability of Level 2 organizations is summarized as ___________, because the ability to successfully repeat planning and tracking of earlier projects results in stability.

To be certified at Level 2, organizations must document (define), practice, enforce, train, measure, and improve the following six key process areas. Choose all that apply:

The U.S. Department of ________ is responsible for the MBNQA and Program. (3-21)

The ____, an agency of the Department’s Technology Administration manages the Baldrige Program. (3-21)

The Malcolm Baldrige National Quality Awards are given in the following categories, with no more than two awards being presented per category per year. Choose all that apply:

The MBNQA award criteria are built upon a set of interrelated core values and embodied in the following categories. Check all that apply:

The MBNQA scoring responses to Award Criteria and Award applicant feedback are based on two evaluation dimensions: Process and _______ .

Other countries and regions have also created quality awards. These use similar categories and variations of the scoring methods used by the MBNQA. The Deming Prize is awarded in _____.

The following major clauses comprise the ___ 9001 standard:Management ResponsibilityResource ManagementProduct RealizationMeasurement, Analysis and Improvement

ISO/IEC 12207, which was published in 1995, is the international standard that covers the ________ life cycle from concept through retirement.

Given the target audience, ISO/IEC 12207 includes several different points of view regarding software development. Acquirers and suppliers see a ________ view.

The target audience for ISO/IEC 12207 is: (choose all that apply)

A post-implementation audit is conducted to determine any, or all, of the following: • The system objectives were met • The system specifications were implemented as specified • The developmental standards were followed • The IT quality objectives (e.g., maintainability) were achieved

Post-implementation audits are a _______ _________activity.

Which of the following are typical steps for performing a baseline study? (Choose all that apply)

Which of the following are examples of objective measures: (Choose all that apply)

Baselines should be ____________ even if it is a subjective measure.

Examples of products/services that can be measured subjectively for developing a baseline include: (Choose all that apply)

Baselines can be conducted for any one of the following three purposes: (Choose any 3)

Customer surveys use the "___ ___ ___" definition of quality.

If we wanted to poll the customer on a scale of 1 to 5 on their satisfaction with the user manuals provided by IT, a Report Card would be the method used.

Most baselining processes have the following steps: (Choose all that apply)

A less formal method for benchmarking is to visit other organizations. Select from the following all the steps in this process:

A Benchmark is an industry or best-of-class norm.

The ISO 9001:2000 model was developed with emphasis on the following needs:

The ISO 9001:2000 standards are based on the following quality management principles: (Choose all that apply)

The following are true of the ISO/IEC 12207 model: (Check all that apply)

The target audience for ISO/IEC 12207 is: (Choose all that apply)

Post-implementation audits are a _ ___activity.

Customer surveys use the "_ _ ___" definition of quality.