SQuaRE (Software Product Quality Requirement and Evaluation) Architecture
SQuaRE(Software Product Quality Requirement and Evaluation) Architecture
2005-10-20
Lee, Keumsuk
(kslee@dongguk.edu)
Dept. of Computer and Multimedia Engineering,
2005-10-20
Outline
• Introduction to Software Quality
• Software Quality Model
• ISO/IEC 9126 Software Product Quality
• ISO/IEC 14598 Software Product Evaluation
• ISO/IEC 25000 SQuaRE Architecture
• Summary
• References
What is Quality?
• Quality:
“(1) The degree to which a system, component, or a process meets specified requirements. (2) The degree to which a system, component, or process meets customer or user needs or expectations” (IEEE Std. 610-12-1990)
“The totality of characteristics of an entity that bear on its ability to satisfy stated and implied needs” (ISO 8402, 1994)
What is Software Product Quality?
• Software Product:
“Set of computer programs, procedures, possibly associated document and data”(ISO/IEC 12207:1995)
• Software Quality:
“Capability of software product to satisfy stated and implied needs when used under specified conditions” (ISO/IEC 14598-1) ->
(1) conformance to requirements
(2) measure of user satisfaction
Software Quality Aspects
Why Measuring and Evaluating Software Products
• Resources and Capability Quality
– In order to go the goal place fast and comfortable, a good car and a skilled driver are key to success.
• Process Quality
– In order to go to the goal place efficiently, good drive map and guides are necessary.
• Product Quality
– You cannot guide the way to the goal if you don’t know where you are.
Software Quality Models
• Quality model:
“The set of characteristics and the relationships between them which provides a framework for specifying requirements and evaluating quality” (ISO/IEC 14598-1)
• Well-known quality models
– Boehm’s model(1976)
– McCall’s model(1977)
– ISO/IEC 9126 model(1991)
Framework for Quality Model
• A hierarchical structure
ISO/IEC JTC1/SC7/WG6
Evaluation and Metrics
• History
– Original idea proposed in 1978 at
– Project initiated in 1985 at Stockholm Meeting.
• Output
– ISO/IEC 9126 , 1991 : Information technology - Software product evaluation – Quality characteristics and guidelines for their use
– ISO/IEC 12119 , 1994 : Information technology - Software packages - Quality Requirement and testing
Evolution of ISO/IEC 9126
International Standards by SC7/WG6
ISO/IEC 9126: Software Product Quality
• Part 1: Quality Model
• Part 2: External Metrics
• Part 3: Internal Metrics
• Part 4: Quality in Use Metrics
ISO/IEC 14598: Software Product Evaluation
• Part 1: General Overview
• Part 2: Planning and Management
• Part 3: Process for Developers
• Part 4: Process for Acquirers
• Part 5: Process for Evaluators
• Part 6: Documentation of Evaluation Module
ISO/IEC 9126-1
Software Quality Model Framework
• Quality in the life cycle
ISO/IEC 9126-1
Software Quality Model
• ISO/IEC 9126 model consists of two parts.
– A model for External and Internal Software Quality
– A model for Quality in Use
External Quality and Internal Quality
• External Quality
– The extent to which a product satisfies stated and implied needs when used under specified conditions (ISO/IEC 14598-1)
• Internal Quality
– The totality of attributes that determine its ability to satisfy stated and implied needs when used under specified condition. (ISO/IEC 14598-1)
Quality In Use Definition
• The extent to which a product used by specified users meets their needs to achieve specified goals with effectiveness, productivity and satisfaction in specified context of use. (ISO/IEC 14598-1)
ISO/IEC 14598-1 Evaluation Process
Product Evaluation Planing
• Major Items of a Evaluation Plan (ISO/IEC 14598-2)
– Project Objectives
– Applicable quality characteristics
– List of Priority
– Quality Objectives
– Schedules
– Definition of Responsibilities
– Measurement Categories
– Using and Analyzing Data
– Reporting
Guidance and Requirements for Evaluation Process
• ISO/IEC 14598-3:
– Process for development of a new product or enhancement of an existing one
• ISO/IEC 14598-4:
– Process for acquisition or reusing of an existing or predeveloped software product
• ISO/IEC 14598-5:
– Process for independent evaluation including third-party assessment
Problems of the 9126 & 14598 series
• Existence of two series and inconsistency among them caused by the building block
approach
• Needs for total view of product quality
• Needs for map and guide for the series
• Needs for Quality Requirement standard
• Needs for umbrella standard on metrics
– TR at current stage
– Duplication of the common part
ISO/IEC 25000 SQuaRE series
• Organization of SQuaRE series of standards
Divisions within SQuaRE
• ISO/IEC 2500n – Quality management division
– All common models, terms and definitions
• ISO/IEC 2501n – Quality model division
– Detailed quality model including characteristics for internal, external and quality in use
• ISO/IEC 2502n – Quality measurement division
– Quality measurement reference model, definitions of quality measures and guidance for their application
• ISO/IEC 2503n – Quality requirement division
– Guidance for specifying quality requirements
• ISO/IEC 2504n – Quality evaluation division
– Requirements, recommendations and guidelines for quality evaluation
SQuaRE Architecture and Related Documents
Relationship between ISO/IEC9126 and
ISO/IEC 14598 series and SQuaRE series
SQuaRE Common Models
• SQuaRE general reference model
– Navigation guide through SQuaRE series of standards as a function of user’s task
• Software product quality life cycle
– The views of internal, external and quality in use software quality during the software life cycle
• Quality model structure
– Categorization of software quality attributes into characteristics, subcharacteristics and quality attributes
SQuaRE General Reference Model
Software Product Quality Life Cycle Model
Issues for the Future
• Technical Issues:
– Integrate with CASE and Management Tools.
– Develop & Validate Quality measures.
– Invite More Field Experiences.
• Standard Issues:
– Integrity within Software Engineering Standards.
– SQuaRE Architecture Extension
– Speed Up the Standardization Process.
– Develop Quality measures Registration Scheme.
References
1. ISO/IEC JTC1/SC7 web site, www.jti1-sc7.org
2. Azuma, M., 2001, “SQuaRE: The next Generation of ISO/IEC 9126 and 14598 International Standards Series on Software Product Quality,” in Proceedings of the European Software Control and Metrics Conference (ESCOM), 2-4 April 2001, London, UK, pp. 337-346
3. Eddie Burris, “Software Quality Management”, http://programminglarge.com, 2003.
4. ISO/IEC 9126-1, Software Engineering – Product quality – Part 1: Quality Model
5. ISO/IEC TR 9126-2, Software Engineering – Product quality – Part 2: External metrics
6. ISO/IEC TR 9126-3, Software Engineering – Product quality – Part 3: Internal metrics
7. ISO/IEC TR 9126-4, Software Engineering – Product quality – Part 4: Quality in use metrics
8. ISO/IEC 14598-1:1999, Information Technology – Software product evaluation – Part 1: General overview
9. ISO/IEC 14598-2:2000, Information Technology – Software product evaluation – Part 2: Planning and management
10. ISO/IEC 25001:—, Software Engineering – Software Product Quality Requirements and Evaluation (SQuaRE) – Planning and management
11. ISO/IEC 25010:—, Software Engineering – Software Product Quality Requirements and Evaluation (SQuaRE) – Quality model
12. ISO/IEC 25020:—, Software Engineering – Software Product Quality Requirements and Evaluation (SQuaRE) – Measurement reference model and guide
13. ISO/IEC 25030:—, Software Engineering – Software Product Quality Requirements and Evaluation (SQuaRE) – Quality requirements
14. ISO/IEC 25040:—, Software Engineering – Software Product Quality Requirements and Evaluation (SQuaRE) – Evaluation reference model and guide