Software Measurement and

Metrics

Presenter:
Munir Hussain Shahu
MCS, ITIL V3F
My Introduction
Academics:
◦ ITIL V3F Certification – 2011
◦ MS (SPM) – NUCES – 2011 (Expected)
◦ MCS – Karachi University – 2004
◦ BSc – Karachi University – 2002
Experience:
◦ More than 8 years experience in Software
Industry in Health and Human Services vertical
◦ Current: Product Manager at Pragmedic Solutions
Agenda
Quick overview of Software Quality
Engineering
Feedback Loop
Need for Software Measurement
Measurement details
Software Metrics Overview
◦ Product Metrics
◦ Process Metrics
◦ Project Metrics
Overview
Testing
Software Quality Assurance
Software Quality Engineering
◦ Feedback Loop
◦ Analysis through measurements
◦ Quantifiable Quality Improvement
Total Quality Management
Management style aimed at achieving
long-term success by linking quality and
customer satisfaction
All organization members participate in
improvement of processes, products and
services
Implementations in IT industry:
◦ Six-Sigma Strategy (Motorola)
◦ Total Quality Control (HP)
Feedback Loop – Essence of SQE
Measurement Fundamentals
Examples:

•Body Weight
•Lines of Code (LOC)
•The more rigorously the
software development
process is executed, the
better the quality of
deliverable
Levels of Measurement
Nominal Scale
◦ Mutually exclusive categories
◦ Example: Defect Origin
Ordinal Scale
◦ Asymmetric and transitive but no magnitude
◦ Example: Likert Scale (Points from 1 to 5)
Interval Scale
◦ All above properties in addition to the difference
◦ Example: Defect Rate of Products A, B, C
Basic Measures
Ratio:
◦ Static measure; a/b
Proportion:
◦ Static measure: a/N (N = Total)
Percentage:
◦ Static measure: a/N * 100
Rate:
◦ Dynamic measure: y/x (Change in y w.r.t. x)
Measurement attributes
Reliability:
Refers to the consistency of a number of
measurements taken using the same
measurement method on the same subject.
Validity:
Refers to whether the measurement or
metric really measures what we intend to
measure
Representation of attributes

Reliable but not valid

Representation of attributes

Valid but not reliable

Representation of attributes

Reliable and valid

Software Metrics
Product Metrics
◦ Size, Complexity, Design Features, Quality
Level
Process Metrics
◦ Defect removal during development, testing
defect arrival
Project Metrics
◦ Staffing Pattern over lifecycle of software,
cost, schedule and productivity
Product Metrics
Mean Time To Failure (MTTF)
DefectDensity
Customer Problems
Customer Satisfaction
Software Maintenance Metrics
Backlog Management Index
Fix Response Time
Percent Delinquent Fixes
Fix Quality
In-Process Quality Metrics
Defect Density During Machine Testing
Defect Arrival Pattern
Defect Removal Effectiveness
CMMI Based Software Process Metrics
IEEE – 2006
Goal – Question - Metric
In-Process Testing Metrics
Software Reliability Engineering
Rayleigh Model
Reliability Growth Models