III-3-CherylJones10-24-01COCOMOForum

Slide 1: 

Practical Software and Systems Measurement A foundation for objective project management COCOMO Forum October 24, 2001

Outline : 

Outline Objectives of Measurement and Analysis Initiatives Practical Software and Systems Measurement ISO/IEC 15939, Software Measurement Process CMMI Measurement and Analysis Process Area ISO 9000-3, Guidelines for Software

Objectives of Measurement Initiatives : 

Objectives of Measurement Initiatives Experienced-Based Measurement to Support Management and Engineering Requirements Consistent Measurement Process Across Measurement Initiatives Consistent Measurement Terminology

Slide 5: 

Measurement Process Model

Practical Software and Systems Measurement (PSM) : 

Practical Software and Systems Measurement (PSM)

What is PSM? : 

What is PSM? A Primary Measurement and Analysis Process Used by DoD, Government, and Commercial Programs Technology Based on Actual Experience on Real Programs A Fully Integrated Approach Including Guidance, Tools, Training, Implementation Workshops, Support Products, and a Qualified Technical Team

Key Measurement Concepts : 

Key Measurement Concepts Measurement is a Process - Not a Pre-Defined List of Graphs or Reports The Measurement Process is Flexible - Adapted To Meet Specific Project and Organizational Objectives and Information Needs The Measurement Requirements are Integrated Into the Project Technical and Management Processes

Common Information Needs : 

Common Information Needs Schedule and Progress Resources and Cost Product Size and Stability Product Quality Process Performance Technology Effectiveness Customer Satisfaction

Slide 10: 

Problem Report Status Priority 1, 2, and 3 Problem Reports Build 1 0 100 200 300 400 500 600 700 800 Number of Problem Reports Discovered Closed 30 Aug 98 900 1000

Slide 11: 

Types of Analysis

Slide 12: 

Estimation

Integrated Analysis Model : 

Integrated Analysis Model

Slide 14: 

Integrated Analysis Example

Multi-Level Requirements : 

Multi-Level Requirements

PSM Project Strategy : 

PSM Project Strategy

New Technology Areas : 

New Technology Areas Measurement and New Technologies Object-oriented developments Spiral/evolutionary approaches Interoperability Product lines Initial Recommendations Were Draft Drafted in Early 2001 Field Trials Are Underway - Additional Trials Will be Conducted in 2002

PSM Participating Organizations : 

PSM Participating Organizations US Navy NUWC US Navy OPTEVFOR ODUSD (S&T) OSD C31 OSD PA&E Aerospace Corp. DCMA DFAS DISA DLA DSMC FAA IDA MITRE Corp. NDU IRM College NASA National Park Service Sandia National Lab SEI Soc. Sec. Admin. DoD and Government US Air Force AFMC US Air Force SSSG US Air Force STSC US Air Force CRSIP US Air Force STRATCOM US Army AMC US Army ATEC US Army CECOM US Army ODISC4 US Army SMDC US Army TACOM - ARDEC USMC MCTSSA US Navy AEDC US Navy ASN RDA US Navy FMSO US Navy NAVAIR US Navy NAVSEA US Navy NAWC US Navy NRL US Navy NSWC Overseas Defence Materiel Org. (Australia) LiveWare (Argentina) NRC (Canada) Software and Systems Engineering (Israel) Software Improvements (Australia) Software Quality Institute (Australia)

Slide 19: 

PSM Participating Organizations Independent Engineering ITABHI James Gregory Assoc. Kodak Health Imaging Litton/TASC Lockheed Martin L3 Communications Northrop Grumman OAO Corporation PRC - Litton PRC/TASC QSM Quality Plus Tech. Raytheon - Hughes Robbins, GIOIA Rockwell Collins SAIC Sallie Mae Sentel Software Metrics SPC Sverdrup Tech. Tecolote Research TeraQuest Metrics Tivoli TRW United Defense Univ. Southern CA User Trust Network US West VPI - State University West Virginia High Tech. Cosortium West Virginia University Industry ACS GSG American Sys. Corp. Averstar Bloodworth Int. Tech. Carnegie Mellon Univ. CSC CTA Distributive Software Federal Reserve Bank General Dynamics General Scientific Corp. Graeme & Garland GTE Hawaiian Electric IEEE IFPUG IITRI INCOSE

ISO/IEC 15939, Software Measurement Process : 

ISO/IEC 15939, Software Measurement Process

ISO/IEC 15939 : 

ISO/IEC 15939 PSM Was Base Document for This Standard Specifies Required Activities and Tasks of a Measurement Process FCD Ballot Passed in May 2001 With Only 1 Dissenting Vote - All Comments Resolved at ISO Plenary Terminology Was Adjusted for Consistency With ISO/IEC 9126, 15498, and 14143 Series DIS Ballot Will be Released in September 2001 - Ballot Will Close in November 2001 - International Standard in Late 2001

Slide 23: 

Basic Measurement “Architecture” ISO/IEC 15939 Measurement Process Model Measurement Information Model Information Driven Measurement Requirements Consistent, Tailorable Implementation Process

Slide 24: 

Measurement Information Model

Slide 25: 

Quantity Defined as a Function of Two or More Measures Attribute Measure that Provides an Estimate or Evaluation With Respect to Information Needs Operations Mapping an Attribute to a Scale Meas. Method Base Measure Attribute Meas. Method Base Measure Derived Measure Meas. Function Indicator Derived Measure Algorithm Combining Two or More Measures Measure of a Single Attribute Defined By a Specified Measurement Method Property Relevant to Defined Information Needs Algorithm Combining Measures and Decision Criteria Analysis Model Entities Information Needs

Slide 26: 

Information Needs Information Product Decision Criteria Measure that Provides an Estimate or Evaluation With Respect to Information Needs Base Measure Indicator Derived Measure Algorithm Combining Measures and Decision Criteria Analysis Model Information Product

CMMI - Measurement and Analysis (M&A) : 

CMMI - Measurement and Analysis (M&A)

CMMI M&A : 

CMMI M&A ISO/IEC 15939 Was Base Document for the Measurement and Analysis Process Area CMMI M&A Describes How to Evaluate a Measurement Process M&A Is a Level 2 Process Area Pilot Assessments Are Being Conducted in 2001

ISO 9000-3Quality management and quality assurance standards - Part 3: Guidelines for the application of ISO 9001 to the development, supply, installation, and maintenance of computer software : 

ISO 9000-3Quality management and quality assurance standards - Part 3: Guidelines for the application of ISO 9001 to the development, supply, installation, and maintenance of computer software

ISO 9000-3 : 

ISO 9000-3 9000-3 Is Being Updated by SC7 as Part of the ISO 9000:2000 Update Part 8, “Measurement, Analysis and Improvement”, Was Updated for Consistency With 15939 Standard Is at Working Draft Stage - Expected Publication Date Is 2002/2003

For More Information : 

For More Information PSM Support Center Cheryl Jones - PSM Project Manager TACOM - ARDEC AMSTA-AR-QAT Building 62 Picatinny Arsenal, NJ 07806-5000 (973) 724-2644 (Voice) (973) 724-2382 (FAX) cljones@pica.army.mil PSM Home Page: http://www.psmsc.com