• Home
  • Resources
    • Cybersecurity Policy Chart
    • CSIAC Reports
    • Webinars
    • Podcasts
    • Cybersecurity Digest
    • Standards & Reference Docs
    • Journals
    • Certifications
    • Acronym DB
    • Cybersecurity Related Websites
  • Services
    • Free Technical Inquiry
    • CAT Program
    • Subject Matter Experts
    • Store
    • Training
    • Contact
  • Community
    • Upcoming Events
    • Cybersecurity
    • Modeling & Simulation
    • Knowledge Management
    • Software Engineering
    • Cyber COI
  • About
    • About the CSIAC
    • The CSIAC Team
    • DTIC’s IAC Program
    • DTIC’s R&E Gateway
    • Inquiries & CAT’s
    • FAQ’s
    • DTIC STI Program
  • Cart
  • Skip to primary navigation
  • Skip to content
  • Skip to primary sidebar
  • Skip to footer
Login / Register

CSIAC

Cyber Security and Information Systems Information Analysis Center

header-right

Main navigation

  • Resources
    • Cybersecurity Policy Chart
    • CSIAC Reports
    • Webinars
    • Podcasts
    • Cybersecurity Digest
    • Standards & Reference Docs
    • Journals
    • Certifications
    • Acronym DB
    • Topic Tags
    • Cybersecurity Websites
  • Services
    • Free Technical Inquiry
    • CAT Program
    • Subject Matter Experts
    • Store
    • Training
    • Contact
  • Community
    • Upcoming Events
    • Cybersecurity
    • Modeling & Simulation
    • Knowledge Management
    • Software Engineering
    • Cyber COI
  • About
    • About the CSIAC
    • The CSIAC Team
    • DTIC’s IAC Program
    • DTIC’s R&E Gateway
    • Inquiries & CAT’s
    • FAQ’s
    • DTIC STI Program
  • Cart
  • Cybersecurity
  • Modeling & Simulation
  • Knowledge Management
  • Software Engineering
  • Cyber COI
/ Journal Issues / Cost Estimation & Systems Acquisition / An Innovative Approach to Quantifying Uncertainty in Early Lifecycle Cost Estimation

An Innovative Approach to Quantifying Uncertainty in Early Lifecycle Cost Estimation

Published in Software Tech News
Volume: 15 Number: 1 - Cost Estimation & Systems Acquisition

Author: Robert Ferguson
Posted: 03/14/2016 | Leave a Comment

The inaccuracy of cost estimates for developing major Department of Defense (DoD) systems is well documented, and cost overruns have been a common problem that continues to worsen. Because estimates are now prepared much earlier in the acquisition lifecycle, well before concrete technical information is available, they are subject to greater uncertainty than they have been in the past.  Early lifecycle cost estimates are often based on a desired capability rather than a concrete solution. Faced with investment decisions based primarily on capability, several problems are encountered when creating estimates at this early stage:

  • Limited Input Data –The required system performance, the maturity of the technology for the solution, and the capability of the vendors are not fully understood.
  • Uncertainties in Analogy-Based Estimates – Most early estimates are based on analogies to existing products. While many factors may be similar, the execution of the program and the technology used as part of the system or to develop it are often different. For example, software product size depends heavily on the implementation technology, and the technology heavily influences development productivity. Size and productivity are key parameters for cost estimation.
  • Challenges in Expert Judgment – Wide variation in judgment can exist between experts and the confidence in the input that they provide is generally not quantified and unknown.
  • Unknown Technology Readiness – Technology readiness may not be well-understood, and is likely to be over or under estimated.

 

An Improved Method for Early Cost Estimation

In 2011 the SEI introduced the QUELCE (Quantifying Uncertainty in Early Cost Estimation) method, an integrative approach for pre-Milestone A cost estimation. The method aims to provide credible and accurate program cost estimates within clearly defined, statistically valid confidence intervals. QUELCE produces intuitive visual representations of the data that explicitly model influential relationships and interdependencies among the drivers on which the estimates depend. Assumptions and constraints underlying the estimates are well documented, which contributes to better management of cost, schedule, and adjustments to program scope as more is learned and conditions change. Documenting the basis of an estimate facilitates updating the estimate during program execution and helps others make informed judgments about estimation accuracy.

The QUELCE method differs from existing methods because it

  • uses available information not normally employed for program cost estimation
  • provides an explicit, quantified consideration of the uncertainty of the program change drivers
  • enables calculation (and re-calculation) of the cost impacts caused by changes that may occur during the program lifecycle
  • enhances decision-making through the transparency of the assumptions going into the cost estimate

InformationFlow

Figure 1: Information Flow for Early Lifecycle Estimation, Including the QUELCE Method

Figure 1 shows the flow of information in a typical MDAP Acquisition, with blue boxes added to represent the contributions from the QUELCE method.

Pages: Page 1 Page 2 Page 3 Page 4

Previous Article:
« DACS Software & Systems Cost and Performance...
Next Article:
Selling Your Software Estimate »

Author

Robert Ferguson
Robert Ferguson
Mr. Robert Ferguson is an experienced software developer and project manager who joined the SEI after 30 years in industry. His experience includes applications in real-time flight controls, manufacturing control systems, large databases, and systems integration projects. He has also led process improvement activities at two companies. At the SEI he supports customers with problems in estimation and measurement implementation. Mr. Ferguson is a Senior Member of IEEE. He has Project Management Professional (PMP) certification from the Project Management Institute (PMI).
Related Content:
  • Early Synthetic Prototyping Digital Warfighting For Systems Engineering Journal Article
  • Keys to Successful DoD Software Project Execution Journal Article
  • Software Assurance in The Agile Software Development Lifecycle Journal Article
  • Software productivity progress during the first decade of the 21st Century: Quantifying productivity Journal Article
  • Is Our Software REALLY Secure? Journal Article

Reader Interactions

Leave a Comment Cancel

You must be logged in to post a comment.

sidebar

Blog Sidebar

Featured Content

CSIAC Journal - Serious Games to Enhance Defense Capabilities

CSIAC Journal Cover Volume 5 Number 4

This 2017 special edition of the CSIAC Journal focuses on wargames and the many uses of Modeling and Simulation (M&S) that support decision making needed at the various levels of combat.

Read the Journal

CSIAC Report - Defense Acquisition University Secure Systems Design Course Experiment

CSIAC developed a course experiment with the Defense Acquisition University (DAU) Cybersecurity Enterprise Team. The goal of this exercise was to study the techniques & strategies used to provide cybersecurity-based training, in an effort to educate the entire acquisition workforce on cybersecurity best practices & techniques.

Read the Report

CSIAC Journal - Design and Development Process for Assured Software

CSIAC Journal Cover Volume 5 Number 2

This is Volume 1 of 2 special edition issues on Software Assurance. This edition explores different aspects of developing, deploying and training on how to build assured software.

Read the Journal

CSIAC Journal - Tools & Testing Techniques for Assured Software

CSIAC Journal Cover Volume 5 Number 3

This is Volume 2 of 2 special edition issues on Software Assurance. This edition explores different aspects of software assurance competencies that can be used to improve software assurance functions and how to develop/deploy assured software throughout the lifecycle acquisition process.

Read the Journal

Recent Video Podcasts

  • CS Digest Roundtable #2: Meltdown/Spectre, NIST Framework, GDPR Policy, and Romanian Hackers Series: The CSIAC Podcast
  • CS Digest Roundtable #1: Emotet Trojan, Cryptojacking, and User Data Exposure Series: The CSIAC Podcast
  • Cybersecurity of DoD Critical Infrastructure Series: CSIAC Webinars
  • Challenges to Critical Infrastructure Series: Cyber Awareness Videos
  • Emerging Concepts to Critical Infrastructure Series: Cyber Awareness Videos
View all Podcasts

Resource Topic Tags

Critical Infrastructure Protection (CIP) Data Security Internet of Things (IoT) Ransomware Cybersecurity Network Security Insider Threat Mobile Security Quantum Computing Cyber Warfare Workplace Security Cloud Computing Cyber Legislation Phishing Artificial Intelligence (AI) Risk Management Framework (RMF) Protecting Controlled Unclassified Information (CUI) Modeling & Simulation Software Assurance Password Security Software Engineering Hacking IT Security Encryption Malware National Institute of Standards and Technology [NIST] Intrusion Detection DISA Air Force Research Laboratory (AFRL) Open Source Software

Upcoming Events

Wed 25

MODSIM World 2018

April 24 - April 26
Norfolk VA
United States
May 01

SANS Automotive Cybersecurity Summit

May 1 - May 8
Chicago IL
United States
Organizer: SANS
May 14

Northsec

May 14 - May 20
Old Montreal Quebec
Canada
Jun 11

Transport Security and Safety Expo – TSSX 2018

June 11 - June 12
Washington DC
United States
Jun 25

AIAA Modeling and Simulation Technologies Conference

June 25 - June 29
Alanta GA
United States
View all Events

Recently Active Members

Profile picture of testell
Profile picture of jonlancelot
Profile picture of rbourassa
Profile picture of pwrdude
Profile picture of jreade
Profile picture of broweeble1
Profile picture of harrisog
Profile picture of elowar
Profile picture of pdombowsky
Profile picture of stevechan
Profile picture of donnguyen19
Profile picture of jdalton6
Profile picture of majordavehan817
Profile picture of jsolvesky
Profile picture of gapicard
Profile picture of gunnerf16
Profile picture of jvhoughton
Profile picture of pcaviness

Footer

CSIAC Products & Services

  • Free Technical Inquiry
  • Core Analysis Tasks (CATs)
  • Resources
  • Events Calendar
  • Frequently Asked Questions
  • Product Feedback Form
  • CSIAC Store

About CSIAC

The CSIAC is a DoD-sponsored Center of Excellence in the fields of Cybersecurity, Software Engineering, Modeling & Simulation, and Knowledge Management & Information Sharing.Learn More

Contact Us

Phone:800-214-7921
Email:info@csiac.org
Address:   266 Genesee St.
Utica, NY 13502
Send us a Message
ASD(R&E) LogoUS Department of Defense LogoDoD IACs LogoDTIC LogoTEMS Logo

Copyright 2018, Quanterion Solutions Incorporated

Sitemap | Privacy Policy | Terms of Use | Accessibility Information