Professional Documents
Culture Documents
MEASURING SATISFACTION
With and Without Surveys
Presented by
Robin Lawton
International Management Technologies, Inc.
www.imtC3.com 941-907-0666
OBJECTIVES SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 2
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
THE FOCUS SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 3
WHY TO MEASURE SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 4
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
WHAT TO MEASURE SM
• 8 Dimensions of Excellence
• Outcomes
• Products
• Processes
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 5
8 DIMENSIONS OF EXCELLENCE SM
UNDESIRED DESIRED
CUSTOMER PRIORITIES
4 3
2 1
Product Acquisition Product
Process Characteristics Undesired Customer
Customers Want Customers Want Outcomes Desired
Customers Outcomes
Want to
Avoid
P
R
O
PROCESS D OUTCOME
U
PRODUCER PRIORITIES
C
T
Undesired
Outcomes
Product Producer Producer
Production Process Characteristics Wants to Desired
Producer Wants Producer Wants Avoid Outcomes
8 7 6 5
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
EFFICIENCY IDENTITY PURPOSE 6
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
OUTCOME DEFINITION SM
Undesired Desired
Sought 2 or 6* 1 or 5*
Achieved 2 or 6* 1 or 5*
* Indicates which of the 8 Dimensions this appears in.
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 7
MEASUREMENT FOCUS:
STRATEGY, DESIGN & FEEDBACK SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 8
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
C3 QUESTIONS, RULES & FORMULAS
QUESTION HOW TO FIND THE ANSWER
1- What is the product? WORD RULES SM
d. Feature expectations (these are 4. A satisfying (insert product name) is one which has (insert
expressed as objective, ambiguity-free expectation)
criteria)
SM
STRATEGIC PLANS
AND
BALANCED SCORECARDS
(The Big Picture)
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 10
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
MISSOURI DEPARTMENT OF REVENUE SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 11
SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 12
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
GOOD MEASURES ARE SM
SM
TOWARD
PRODUCT & SERVICE
DESIGN
(Proactive specificity)
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 14
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
MEASUREMENT FOCUS:
STRATEGY, DESIGN & FEEDBACK SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 15
PAGE 1 INSTRUCTIONS
Estimated
Time
(Minutes)
SM
Identify the top three (3) outcomes which best describe this organization’s mission or purpose. Be sure
customers’ outcomes are included. (Refer to the Organization and Customer Outcomes tool.)
A.
2. 5
Desired Outcomes B.
C.
Without discussion, each team member reviews the list below. These are criteria for selecting the critical few
3. products that the organization named above should improve. Each team member puts a check in the Priority
column next to the THREE criteria you think are most important.
Selection Criteria
Priority Votes Rank Owner(s)
The most important products are those that…
Record in the Votes column the number of checks team members gave each of the selection criteria. Record a
4. 2
1 in the Rank column for the criteria with the most votes. Rank the top 3.
Assign each ranked criteria to one or more team members, recording their names under Owner(s). Ideally,
5. 2
two or more team members are owners of a single criteria.
Total Estimate Time 15
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 16
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
PAGE 2 PRODUCT DEFINITION & SELECTION - Page 2
(Minutes)
Criteria owner(s) brainstorm to identify five (5) specific products that best meet that
criteria. Record each product name on a separate sticky note. Be sure products are
produced by the organization named in Step 1 and meet the following criteria.
BRAINSTORMING AREA
Yes No
6. Is the product something the organization named in Step 1 can claim as 12
a.
uniquely its own?
If you can answer “yes” to these questions about each of the products named, you’ve mastered the
first step in customer-centered thinking. Correct the product names as necessary before
proceeding. See Product Definition Tab for more details.
As a whole team, determine if any product has been identified as meeting more than one
of the top ranked and owned Selection Criteria (Step 3).
If there is only one such product, make this the single most important product for
improvement unless the team agrees on an alternate. Record your selection below. (If
your version of this C3 tool includes the Customer Roles & Power tool, the product you
record as First Choice will automatically be filled in there, also.
7. If there is more than one product meeting multiple selection criteria, use majority vote to 3
choose the one you will work on and record that selection below.
If there are none that meet multiple selection criteria, use majority vote to choose the one
you will work on and record that selection below.
First Choice
Second Choice
Total Estimate Time 15
TOTAL TIME 30
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 17
2. ENDUSERS
Team Name
1.
7. Product: End Users:
RANK
3. 4. 5. 6.
2.
Attributes Rank Measured Performance Perception
Priority Customer Expectations (A satisfying product is one which is…)
1
1
End-Users
2
VOICE OF THE CUSTOMER
3 - Product Attributes - 2
3. TEAM NAME ____________________________
4 3
1 Target Product:
5
2 Producer: 4
3 End-Users:
6
5
7
Priority Of
End-Users
Broker for
1
4. 12
2
3 13
Producers
Broker for
4 14
5
15
Totals: 0 0 0
16
6 The Hardest Thing To Do
17
18
19
Fixers
20
5.
21 Who Will Do What By When
7 Discoveries You Made
22
23
Your primary role with this product:
24
30
7. Totals
Also Do
or Video*
Expectations
Miller/
Pages 66-71
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 18
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
MEASUREMENT FOCUS:
STRATEGY, DESIGN & FEEDBACK SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 19
MEASURES OF SATISFACTION SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. MTG01 20
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
HOW TO MEASURE SM
CREATING MEASURES
Do This First Do This Now Do This Next
3
3
End-Users:
4 4
5 5
Priority Of
6 Possible Measures Goal
Measure Product
7 Attribute
Customer Expectations
(Voice of the Customer) Rank
Group
8
10
11
12
13
14
15
16
17
18
Who Will Do What By When
19
20 Priority 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
21 Target Value
Instructions: Fill in green cells. Use INSERT key to enter + and -. Do not use the arrow keys.
22
23
Discoveries
24
25
26
27
28
29
30
7. Totals
Also Do
or Video*
CREATING MEASURES SM
INSTRUCTIONS
1. Name the specific target product.
2. Identify the end-users you will focus on.
3. Determine the top five (5) customer expectations regarding product attributes as stated by
customers. REMEMBER: Product attributes must fit the phrase, "A satisfying (product) is one
which is _____________." Refer to your prior work with the Voice of the Customer Tool.
4. Brainstorm possible measures for each priority expectation using any of the following phrases
(making sure that there is no ambiguity in the measures):
a. The number of _____________ could indicate that the (insert product name) is/is not (insert
expectation).
b. The % of _____________ could indicate that the (insert product name) is/is not (insert
expectation).
c. The dollar amount of/to/for _____________ could indicate that the (insert product name) is/is not
(insert expectation).
5. Rank the top five measures, considering:
a. Relevance to end-user priorities (these measures will really reflect what customers want)
b. Ease and cost of collecting data
c. Competitive advantage of improvements based on these measures
Be sure that each priority expectation has at least one measure.
6. Create a performance goal for the top 5 priority measures. Consider the goal from the customer's
point of view (i.e. How long does a customer say it should take to read an instruction booklet?)
Consider whether an absolute number or range of values is appropriate.
7. Record your discoveries.
8. Summarize your findings by reporting:
a. Answers to steps 1-7.
b. Would these measures also address priorities of brokers and fixers?
c. Who should do what by when?
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 22
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
WORD FORMULAS HELP
An excerpt/application from Creating Measures SM
CREATING MEASURES
Team Name
Discoveries
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
VOC to PRODUCT DESIGN SM
1. PRODUCT
PRODUCT DESIGN TABLE
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
2. ENDUSERS
Instructions: Change the name of the Product Attribute Group (Column A -
blue cells) if the preset title does not fit your situation.
PRODUCT FEATURES TABLE
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
3. 4. 5. 6. End-Users:
Product
Attributes Rank Measured Performance Perception Attribute
Customer Expectations
(Voice of the Customer) Rank
Group
1
Substitute Quality Characteristics Priority
2 CREATING MEASURES
Team Name EASE
3 OF USE
Product: End Users:
4
11
12
Discoveries
Also Do
or Video*
Pages 66-71
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 25
anecdotes
# of principles illustrated by examples or
attendance
# of days between request for class and
Product
Attribute Customer Expectations Rank
Group (Voice of the Customer)
Supported w/materials + + - + + 0 0
Ease of Use
Motivating + + 0 + + 0 +
Interactive + 0 - 0 + 0 +
Relevant to work + + + 0 + + +
Practical + + - 0 + 0 +
Begun and ended on time
Timeliness
0 0 0 0 0 0 0
Available when I want it 0 0 - 0 + + 0
Appropriately paced 0 - 0 0 0 0 +
Informative + + - + + 0 +
Certainty
Priority 7 7 7 3 9 2 8
Target Value
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 26
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
ANALYZING THE MEASURES SM
WHERE IN 8 DIMENSIONS?
• % of core concepts…
• # of principles illustrated…
• # of requests for help…
• % of visuals per page…
• % of participants reporting appl..
• # of days between req. & attend.
• # of times instructor has taught…
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 27
SM
SURVEYS
(After the fact)
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 28
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
MEASUREMENT FOCUS:
STRATEGY, DESIGN & FEEDBACK SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 29
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
KEYS TO SURVEY SUCCESS SM
1. Be clear about the purpose of the survey and who will use the results.
2. Identify specific product(s) to evaluate.
3. Determine which customers and non-customers to query.
4. Decide the timing and frequency of the survey.
5. Good questions find out: By asking questions such as:
What was expected and/or How long did you expect to wait?
wanted? How long did you hope to wait?
What was experienced? How long did you actually wait?
Level of satisfaction with How satisfied are you?
the product or service
Degree of relative Compared with ___________,
importance of this variable how important is that to you?
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 31
AMERICAN AIRLINES SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 32
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
TYPES OF MEASURES SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 33
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 34
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
TIMELINESS:
2-6 SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 35
SURVEY SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 36
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
MSD Measures of Success
SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 37
30 < 11
25
G
20
o
15
o
10 d
5
0
Project
July-Sep 2002 Oct-Dec 2002 Jan-Mar 2003 Apr - Jun 2003
Baseline
Days 21.00 13.13 20.68 25.76 6.24
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
SATISFACTION & TIME SM
5
Cus. Satisfaction
1
1-7 7-14 14-21 >28 days
Days
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 39
40
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
10 STEPS TO ALIGN EXCELLENCE
WITH CUSTOMER PRIORITIES SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 41
Page 1 INSTRUCTIONS
Estimated
Time
(Minutes)
SM
Identify the top three (3) outcomes which best describe this organization’s mission or purpose. Be sure
customers’ outcomes are included. (Refer to the Organization and Customer Outcomes tool.)
A.
2. 5
B.
C.
Without discussion, each team member reviews the list below. These are criteria for selecting the critical few
3. products that the organization named above should improve. Each team member puts a check in the Priority
column next to the THREE criteria you think are most important.
Selection Criteria
Priority Votes Rank Owner(s)
The most important products are those that…
Record in the Votes column the number of checks team members gave each of the selection criteria. Record a
4. 2
1 in the Rank column for the criteria with the most votes. Rank the top 3.
Assign each ranked criteria to one or more team members, recording their names under Owner(s). Ideally,
5. 2
two or more team members are owners of a single criteria.
Total Estimate Time 15
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 42
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
Page 2 PRODUCT DEFINITION & SELECTION - Page 2
Criteria owner(s) brainstorm to identify five (5) specific products that best meet that
criteria. Record each product name on a separate sticky note. Be sure products are
produced by the organization named in Step 1 and meet the following criteria.
BRAINSTORMING AREA
Yes No
6. Is the product something the organization named in Step 1 can claim as 12
a.
uniquely its own?
If you can answer “yes” to these questions about each of the products named, you’ve mastered the
first step in customer-centered thinking. Correct the product names as necessary before
proceeding. See Product Definition Tab for more details.
As a whole team, determine if any product has been identified as meeting more than one
of the top ranked and owned Selection Criteria (Step 3).
If there is only one such product, make this the single most important product for
improvement unless the team agrees on an alternate. Record your selection below. (If
your version of this C3 tool includes the Customer Roles & Power tool, the product you
record as First Choice will automatically be filled in there, also.
7. If there is more than one product meeting multiple selection criteria, use majority vote to 3
choose the one you will work on and record that selection below.
If there are none that meet multiple selection criteria, use majority vote to choose the one
you will work on and record that selection below.
First Choice
Second Choice
Total Estimate Time 15
TOTAL TIME 30
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 43
1. PRODUCT
PRODUCT DESIGN TABLE
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
2. ENDUSERS
Instructions: Change the name of the Product Attribute Group (Column A -
blue cells) if the preset title does not fit your situation.
PRODUCT FEATURES TABLE
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50
Substitute Quality Characteristics
When filling in the green cells, use a + and -. IMPORTANT! Use the ENTER Instructions: Change the name of the Product Attribute Group
key not the tab. If you don't, Excel will think you are doing a caluculation. (Column A - blue cells) if the preset title does not fit your Features
situation
Product: When filling in the green cells, use a + and -. IMPORTANT!
Use the ENTER key not the tab. If you don't, Excel will think
End-Users:
you are doing a calculation.
Product:
3. 4. 5. 6. End-Users:
Product
Attributes Rank Measured Performance Perception Attribute
Customer Expectations
(Voice of the Customer) Rank
Group
1
Substitute Quality Characteristics Priority
2 CREATING MEASURES
Team Name EASE
3 OF USE
Product: End Users:
4
11
12
Discoveries
Also Do
or Video*
Pages 66-71
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 44
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
CREATING MEASURES SM
CREATING MEASURES
Do This First Do This Now Do This Next
3
3
End-Users:
4 4
5 5
Priority Of
6 Possible Measures Goal
Measure Product
7 Attribute
Customer Expectations
(Voice of the Customer) Rank
Group
8
10
11
12
13
14
15
16
17
18
Who Will Do What By When
19
20 Priority 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
21 Target Value
Instructions: Fill in green cells. Use INSERT key to enter + and -. Do not use the arrow keys.
22
23
Discoveries
24
25
26
27
28
29
30
7. Totals
Also Do
or Video*
CREATING MEASURES SM
INSTRUCTIONS
1. Name the specific target product.
2. Identify the end-users you will focus on.
3. Determine the top five (5) customer expectations regarding product attributes as stated by
customers. REMEMBER: Product attributes must fit the phrase, "A satisfying (product) is one
which is _____________." Refer to your prior work with the Voice of the Customer Tool.
4. Brainstorm possible measures for each priority expectation using any of the following phrases
(making sure that there is no ambiguity in the measures):
a. The number of _____________ could indicate that the (insert product name) is/is not (insert
expectation).
b. The % of _____________ could indicate that the (insert product name) is/is not (insert
expectation).
c. The dollar amount of/to/for _____________ could indicate that the (insert product name) is/is not
(insert expectation).
5. Rank the top five measures, considering:
a. Relevance to end-user priorities (these measures will really reflect what customers want)
b. Ease and cost of collecting data
c. Competitive advantage of improvements based on these measures
Be sure that each priority expectation has at least one measure.
6. Create a performance goal for the top 5 priority measures. Consider the goal from the customer's
point of view (i.e. How long does a customer say it should take to read an instruction booklet?)
Consider whether an absolute number or range of values is appropriate.
7. Record your discoveries.
8. Summarize your findings by reporting:
a. Answers to steps 1-7.
b. Would these measures also address priorities of brokers and fixers?
c. Who should do what by when?
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 46
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
CREATING MEASURES SM
CREATING MEASURES
Team Name
Discoveries
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 47
MEASUREMENT PRINCIPLES SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.
VOICE OF THE CUSTOMER:
The Measure of Success SM
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved. 49
Copyright © 2008 International Management Technologies, Inc. www.imtC3.com. All rights reserved.