{"id":12562,"date":"2014-03-03T14:45:41","date_gmt":"2014-03-03T03:45:41","guid":{"rendered":"http:\/\/www.aspistrategist.ru\/?p=12562"},"modified":"2014-03-31T13:54:25","modified_gmt":"2014-03-31T02:54:25","slug":"graph-of-the-week-if-you-want-it-on-time-keep-it-simple","status":"publish","type":"post","link":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/","title":{"rendered":"Graph of the week: if you want it on time, keep it simple"},"content":{"rendered":"

Late last year, I gave some early impressions<\/a> of the Australian National Audit Office’s Major Projects report<\/a>. Today I’ll have a closer look at some of the data in the report, which will bring us back to another of ‘Gumley’s Laws’. This time the subject is the impact of developmental work on project delivery. (The previous Gumley’s law post was on over-programming in the Defence Capability Plan<\/a>.)<\/p>\n

First, the data. The figure below is taken from the ANAO report and is DMO’s breakdown of the delay in projects delivering Final Operating Capability to the ADF. The projects are split into three categories\u2014military off-the-shelf (MOTS), ‘Australianised MOTS’ and ‘developmental’.<\/p>\n

\"\"<\/a>

Source: ANAO Major Projects Report 2012\u201313<\/p><\/div>\n

The figure is a stark illustration of the penalty paid for developmental work. None of the developmental projects have been delivered without a 40% overrun in schedule, and the average is 92%\u2014almost double the planned time. Note that the F-35 Joint Strike Fighter is excluded by the DMO as ‘not applicable’ because it’s ‘should ultimately become MOTS when it enters production line delivery’. But it certainly doesn’t buck the trend\u2014on original plans the RAAF were to have their first operation squadron in 2012, but will now have to wait until 2020.<\/p>\n

The breakdown into three categories is very coarse, but previous data sets had more fidelity, which allow us to estimate the effect of project complexity on schedule. The figure below is drawn from earlier ANAO reports, when the DMO gave a project complexity figure on a scale from 1 (simplest off-the-shelf) to 10 (most complex integration and development). While the data set is fairly sparse, it suggests the expected delay in project delivery is about 6\u201310 months per degree of complexity compared to an OTS purchase. And that’s about right when we compare it to the delays in delivering projects like the Collins class submarines and the F-35.<\/p>\n

\"\"<\/a>

Source: DMO data on major defence projects<\/p><\/div>\n

Gumley’s laws include two observations pertinent to this. The first is that:<\/p>\n

Off-the-shelf acquisition of products that are technically mature is the only<\/i> reliable way of avoiding cost and schedule risk. (Gumley’s 1st law)<\/p><\/blockquote>\n

That rule (which should be self-evident) has a natural corollary that Gumley also identified:<\/p>\n

\u00a0Deviation from MOTS increases risk, cost, and schedule and should only be pursued when there are no MOTS systems with acceptable performance. (Gumley’s corollary to Law 1)<\/p><\/blockquote>\n

I’d go further than that. If we combine Gumley’s first law with Augustine’s observation<\/a> that ‘the last 10% of the performance sought generates one-third of the cost and two-thirds of the problems’, I think the corollary should take Augustine into account and read more like this:<\/p>\n

Deviation from MOTS increases risk, cost, and schedule and should only be pursued when there are no MOTS systems with performance within 10\u201320% of that sought and<\/span> when the extra performance is judged to be critical.<\/p><\/blockquote>\n

Gumley’s second law is a less obvious, but no less important observation:<\/p>\n

\u00a0Combining two MOTS systems is not MOTS. (Gumley’s 2nd law)<\/p><\/blockquote>\n

It’s important because it’s much easier to conceive projects that involve taking two separate MOTS components and integrating them \u2014even ones that are themselves mature and fully functional\u2014than it is to deliver them. Some examples from Australia’s experience include the lengthy process of integration of the AGM\u2011142 missile onto the Royal Australian Air Force\u2019s F\u2011111 fleet and the much delayed FFG frigate upgrade. In both case all of the subsystems were well-understood, but the interplay between them was anything but straightforward to manage. The FFGs re-entered service years later than expected and the F-111 managed to fire its first AGM-142 just over a year before the airframe was retired. (A quick mea culpa: my fingerprints will be found on that sorry saga.)<\/p>\n

Perhaps the most egregious example was the failed attempt to modernise the Super Seasprite <\/i>helicopter, which required the integration of flight and combat systems, weapons and sensors sourced from multiple suppliers. The net result was a $1.4 billion investment for no capability return at all.<\/p>\n

Gumley’s second law also has a corollary:<\/p>\n

\u00a0\u2018Australianised MOTS\u2019 is an oxymoron.<\/p><\/blockquote>\n

Or, to put it simply: ‘if you change it, it isn’t MOTS’. Again, the data bears this out. The ‘Australianised MOTS’ projects in the ANAO chart above have an FOC delivery variance of just under 50% above the planned figure\u2014not as bad as the developmental projects, but a long way short of the MOTS projects, for which the average slippage is closer to 2%.<\/p>\n

Andrew Davies is senior analyst for defence capability at ASPI and executive editor of\u00a0<\/em><\/em>The Strategist.\u00a0<\/em><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Late last year, I gave some early impressions of the Australian National Audit Office’s Major Projects report. Today I’ll have a closer look at some of the data in the report, which will bring us …<\/p>\n","protected":false},"author":6,"featured_media":12565,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"footnotes":""},"categories":[19],"tags":[33,48,661,631],"class_list":["post-12562","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-policy-guns-and-money","tag-capability","tag-defence-capability-plan","tag-defence-projects","tag-dmo"],"acf":[],"yoast_head":"\nGraph of the week: if you want it on time, keep it simple | The Strategist<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Graph of the week: if you want it on time, keep it simple | The Strategist\" \/>\n<meta property=\"og:description\" content=\"Late last year, I gave some early impressions of the Australian National Audit Office’s Major Projects report. Today I’ll have a closer look at some of the data in the report, which will bring us ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/\" \/>\n<meta property=\"og:site_name\" content=\"The Strategist\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ASPI.org\" \/>\n<meta property=\"article:published_time\" content=\"2014-03-03T03:45:41+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2014-03-31T02:54:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2014\/03\/Graph-Two.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"621\" \/>\n\t<meta property=\"og:image:height\" content=\"402\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Andrew Davies\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:site\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Davies\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\",\"url\":\"https:\/\/www.aspistrategist.ru\/\",\"name\":\"The Strategist\",\"description\":\"ASPI's analysis and commentary site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.aspistrategist.ru\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-AU\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/#primaryimage\",\"url\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2014\/03\/Graph-Two.jpg\",\"contentUrl\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2014\/03\/Graph-Two.jpg\",\"width\":621,\"height\":402},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/\",\"url\":\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/\",\"name\":\"Graph of the week: if you want it on time, keep it simple | The Strategist\",\"isPartOf\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/#primaryimage\"},\"datePublished\":\"2014-03-03T03:45:41+00:00\",\"dateModified\":\"2014-03-31T02:54:25+00:00\",\"author\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/08a9125f7af3039520d264e965235a73\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/#breadcrumb\"},\"inLanguage\":\"en-AU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.aspistrategist.ru\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Graph of the week: if you want it on time, keep it simple\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/08a9125f7af3039520d264e965235a73\",\"name\":\"Andrew Davies\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/bbb47ebb41d4978346dbf2e1d21b992a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/bbb47ebb41d4978346dbf2e1d21b992a?s=96&d=mm&r=g\",\"caption\":\"Andrew Davies\"},\"url\":\"https:\/\/www.aspistrategist.ru\/author\/andrew-davies\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Graph of the week: if you want it on time, keep it simple | The Strategist","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/","og_locale":"en_US","og_type":"article","og_title":"Graph of the week: if you want it on time, keep it simple | The Strategist","og_description":"Late last year, I gave some early impressions of the Australian National Audit Office’s Major Projects report. Today I’ll have a closer look at some of the data in the report, which will bring us ...","og_url":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/","og_site_name":"The Strategist","article_publisher":"https:\/\/www.facebook.com\/ASPI.org","article_published_time":"2014-03-03T03:45:41+00:00","article_modified_time":"2014-03-31T02:54:25+00:00","og_image":[{"width":621,"height":402,"url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2014\/03\/Graph-Two.jpg","type":"image\/jpeg"}],"author":"Andrew Davies","twitter_card":"summary_large_image","twitter_creator":"@ASPI_org","twitter_site":"@ASPI_org","twitter_misc":{"Written by":"Andrew Davies","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/www.aspistrategist.ru\/#website","url":"https:\/\/www.aspistrategist.ru\/","name":"The Strategist","description":"ASPI's analysis and commentary site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.aspistrategist.ru\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-AU"},{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/#primaryimage","url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2014\/03\/Graph-Two.jpg","contentUrl":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2014\/03\/Graph-Two.jpg","width":621,"height":402},{"@type":"WebPage","@id":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/","url":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/","name":"Graph of the week: if you want it on time, keep it simple | The Strategist","isPartOf":{"@id":"https:\/\/www.aspistrategist.ru\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/#primaryimage"},"datePublished":"2014-03-03T03:45:41+00:00","dateModified":"2014-03-31T02:54:25+00:00","author":{"@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/08a9125f7af3039520d264e965235a73"},"breadcrumb":{"@id":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/#breadcrumb"},"inLanguage":"en-AU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.aspistrategist.ru\/graph-of-the-week-if-you-want-it-on-time-keep-it-simple\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.aspistrategist.ru\/"},{"@type":"ListItem","position":2,"name":"Graph of the week: if you want it on time, keep it simple"}]},{"@type":"Person","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/08a9125f7af3039520d264e965235a73","name":"Andrew Davies","image":{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/bbb47ebb41d4978346dbf2e1d21b992a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bbb47ebb41d4978346dbf2e1d21b992a?s=96&d=mm&r=g","caption":"Andrew Davies"},"url":"https:\/\/www.aspistrategist.ru\/author\/andrew-davies\/"}]}},"_links":{"self":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/12562"}],"collection":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/comments?post=12562"}],"version-history":[{"count":7,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/12562\/revisions"}],"predecessor-version":[{"id":12626,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/12562\/revisions\/12626"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media\/12565"}],"wp:attachment":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media?parent=12562"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/categories?post=12562"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/tags?post=12562"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}