{"id":2583,"date":"2021-12-17T10:23:38","date_gmt":"2021-12-17T10:23:38","guid":{"rendered":"https:\/\/www.springboard.pro\/?p=2583"},"modified":"2026-09-02T16:04:37","modified_gmt":"2026-09-02T16:04:37","slug":"how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it","status":"publish","type":"blog","link":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/","title":{"rendered":"How a Failure of Imagination Could Kill Your Product (And How to Save It!)"},"content":{"rendered":"\n
\n
\n
\n
\n

In 2020, the FDA released draft guidance<\/a> suggesting that emergency medical devices such as autoinjectors should meet a standard of 99.999% reliability at the 95% confidence level. What will it mean for your device as this guidance becomes the industry standard? You could test the devices; but to reach that confidence level you would need to test 300,000 of themi<\/sup><\/a>. This is just not feasible for single-use devices, which often must be tested destructively.<\/p>\n

This article describes how you could save your product using reliability analysis, involving fault tree analysis and Monte Carlo simulations. We will illustrate the approach using a hypothetical autoinjector as an example, but it can be applied to any complex system.<\/p>\n

A simple example<\/h1>\n

To establish the reliability of a complex device, we can systematically break it down into simpler sub-systems, work out the reliability for each, and combine those to obtain a whole-device reliability.<\/p>\n

Step 1: build a fault tree<\/h2>\n

The first step is to perform a fault tree analysis, which establishes all the conceivable routes to failure and allows us to examine the likelihood of one failure mode at a time. A simplified example of a fault tree for an autoinjector is shown in Figure\u00a01. Orange nodes are root causes, and yellow nodes are intermediate steps to the red node: overall device failure. To determine the probability of failure, we must determine the probability of each of the orange root causes in turn.<\/p>\n

\"Example

Figure 1: A fault tree for a hypothetical device. API = active pharmaceutical ingredient.<\/em><\/p><\/div>\n

Step 2: calculate the reliability associated with each root cause<\/h2>\n

We can now use the fault tree to systematically consider each root cause in turn, and for each calculate its expected failure rate at the 95% confidence level.<\/p>\n

Root cause: needle is wrong shape<\/h3>\n

In this hypothetical case, all needles are checked for correct shape in-line by the operator, so the green node can be discounted. Of course in reality, we would have to qualify the inspection process, which would itself have a failure rate.<\/p>\n

Root cause: dosing is wrong<\/h3>\n

It is relatively easy to establish a reliability for the dose of the active pharmaceutical ingredient (API): during process qualification, data will have been generated on the loading of the API, and there will be minimum and maximum acceptable limits on this. It can be as simple as fitting an appropriate distribution and looking at the tails to see what the probability is of exceeding the limits. As a first approximation, we can use a normal distribution.<\/p>\n

But hold on! To meet the \u201c95% confidence\u201d requirement, we need to put confidence limits on this reliability. We fitted a distribution only to a finite sample, so it will be only an approximation to the distribution of the whole population. Fortunately, statisticians have figured out how to quantify this uncertainty in our estimate of the true distribution.<\/p>\n

Another way of saying this is that there is an ensemble<\/i> of possible population distributions that might have given us the sample that we measured during process qualification. This is where Monte Carlo analysis comes in: it allows one to model statistical outcomes of a complex sequence of events, and is discussed in more detail in another blog post<\/a>. Using this technique we can look at the tails of many normal distributions from this ensemble, each with its own reliability. We can now plot a histogram of these reliabilities, exemplified in Figure\u00a02.<\/p>\n

\"Reliability

Figure 2: Reliability histogram for API dosing.<\/em><\/p><\/div>\n

The black line in Figure\u00a02 indicates the 95% confidence limit, so we can claim at 95% confidence that this failure mode does not occur just over 99.7% of the time. In other words, 95% of the distributions from the ensemble had a reliability of 99.7% or better.<\/p>\n

Root cause: orifice is too small\/needle diameter is too big<\/h3>\n

These two root causes sound similar, but they are distinct. The failure mode \u201cOrifice is too small\u201d means that the orifice is smaller than its specified lower bound, so that a needle within its specification is not guaranteed to go through that orifice. Conversely, the case of \u201cNeedle diameter is too big\u201d refers to a needle that is outside of its specification and cannot fit through an orifice that is within its own specification.<\/p>\n

These root causes can be accounted for in at least two ways:<\/p>\n

    \n
  1. \n

    Separately<\/b>, i.e. we can perform a tolerance stack analysis for the orifice, put specification limits on it, and consider whether a given orifice meets its specification as we did for the API dosing; and similarly for the needle.<\/p>\n<\/li>\n

  2. \n

    Jointly<\/b>, i.e. we could look at the overlap between the distributions of the orifice and needle dimensions.<\/p>\n<\/li>\n<\/ol>\n

    Either way, we can generate a similar reliability histogram for the intermediate step \u201cNeedle does not exit orifice.\u201d<\/p>\n

    Step 3: combining the reliabilities<\/h2>\n

    Now we have a distribution of failure rates for each mode, we need to combine them to give an overall failure rate at 95% confidence. A crude approach is to add the 95% confidence failure rates for each mode to give an over-estimate of the overall 95% confidence failure rate. There are a few ways of improving on this by sampling from the failure rate distributions we have calculated, but that is beyond the scope of this article.<\/p>\n

    Reliability analysis in the real world<\/h1>\n

    Astronaut Frank Borman described the Apollo 1 disaster, in which three people burned to death, as a \u201cfailure of imagination<\/a>\u201d. This phrase captures the challenge of considering all possible factors that could lead to a failure and the complex interplay between them; and it applies equally to an autoinjector or the Command Module. A real fault tree analysis is a complex, multidisciplinary undertaking that must consider the interaction of mechanical engineering, materials science, electronics, manufacturing, and human factors. Here, our engineers\u2019 experience in developing and trouble-shooting all sorts of medical devices really adds value to a project. A diagram of a fault tree from a real medical device is shown in Figure\u00a03.<\/p>\n

    \"Diagram

    Figure 3: A diagram of a fault tree from a real medical device. Details have been censored to protect client confidentiality.<\/em><\/p><\/div>\n

    In a real device, it may be necessary to consider the effect of stressors, such as age, temperature, or damage. Sanner can help to design a bespoke test program to assess the effects of these factors.<\/p>\n

    Sanner has developed methodology and code for performing these analyses for regulatory submissions. If you would like to get in touch about our capabilities with regard to your product, please contact us<\/a>.<\/p>\n

    Written by Omar Shah<\/p>\n

    \n

    i<\/a> Assume the device only just fails to meet the specification, i.e. its reliability is <\/span>p = <\/i>99.999%. Suppose we test <\/span>n<\/i> devices independently; then the probability that they all work is <\/span>p<\/i>n<\/i><\/sup>. To achieve 95% confidence, we insist that this outcome occur at most 5% of the time, so we set <\/span>p<\/i>n<\/i><\/sup> = 0.05, or 0.99999<\/span>n<\/i><\/sup> = 0.05. Therefore <\/span>n <\/i><\/span>= log(0.05) \/ log(0.99999) <\/span>\u2248<\/span> 300,000.<\/span><\/span><\/p>\n <\/div>\n <\/div>\n <\/div>\n<\/section>","protected":false},"featured_media":2584,"template":"","blog_category":[75,118],"class_list":["post-2583","blog","type-blog","status-publish","has-post-thumbnail","hentry"],"acf":[],"yoast_head":"\nHow a Failure of Imagination Could Kill Your Product (And How to Save It!) - Sanner Group<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.sanner-group.com\/fr\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How a Failure of Imagination Could Kill Your Product (And How to Save It!) - Sanner Group\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/\" \/>\n<meta property=\"og:site_name\" content=\"Sanner Group\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-02T16:04:37+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.sanner-group.com\/wp-content\/uploads\/2021\/12\/Screenshot-2021-11-02-101556.png\" \/>\n\t<meta property=\"og:image:width\" content=\"744\" \/>\n\t<meta property=\"og:image:height\" content=\"495\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.sanner-group.com\\\/insights\\\/blog\\\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\\\/\",\"url\":\"https:\\\/\\\/www.sanner-group.com\\\/insights\\\/blog\\\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\\\/\",\"name\":\"How a Failure of Imagination Could Kill Your Product (And How to Save It!) - Sanner Group\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.sanner-group.com\\\/fr\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.sanner-group.com\\\/insights\\\/blog\\\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.sanner-group.com\\\/insights\\\/blog\\\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.sanner-group.com\\\/wp-content\\\/uploads\\\/2021\\\/12\\\/Screenshot-2021-11-02-101556.png\",\"datePublished\":\"2021-12-17T10:23:38+00:00\",\"dateModified\":\"2026-09-02T16:04:37+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.sanner-group.com\\\/insights\\\/blog\\\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\\\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.sanner-group.com\\\/insights\\\/blog\\\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\\\/\\\/www.sanner-group.com\\\/insights\\\/blog\\\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.sanner-group.com\\\/wp-content\\\/uploads\\\/2021\\\/12\\\/Screenshot-2021-11-02-101556.png\",\"contentUrl\":\"https:\\\/\\\/www.sanner-group.com\\\/wp-content\\\/uploads\\\/2021\\\/12\\\/Screenshot-2021-11-02-101556.png\",\"width\":744,\"height\":495},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.sanner-group.com\\\/insights\\\/blog\\\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.sanner-group.com\\\/fr\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How a Failure of Imagination Could Kill Your Product (And How to Save It!)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.sanner-group.com\\\/fr\\\/#website\",\"url\":\"https:\\\/\\\/www.sanner-group.com\\\/fr\\\/\",\"name\":\"Sanner Group\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.sanner-group.com\\\/fr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How a Failure of Imagination Could Kill Your Product (And How to Save It!) - Sanner Group","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.sanner-group.com\/fr\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/","og_locale":"fr_FR","og_type":"article","og_title":"How a Failure of Imagination Could Kill Your Product (And How to Save It!) - Sanner Group","og_url":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/","og_site_name":"Sanner Group","article_modified_time":"2026-09-02T16:04:37+00:00","og_image":[{"width":744,"height":495,"url":"https:\/\/www.sanner-group.com\/wp-content\/uploads\/2021\/12\/Screenshot-2021-11-02-101556.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Dur\u00e9e de lecture estim\u00e9e":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/","url":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/","name":"How a Failure of Imagination Could Kill Your Product (And How to Save It!) - Sanner Group","isPartOf":{"@id":"https:\/\/www.sanner-group.com\/fr\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/#primaryimage"},"image":{"@id":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/#primaryimage"},"thumbnailUrl":"https:\/\/www.sanner-group.com\/wp-content\/uploads\/2021\/12\/Screenshot-2021-11-02-101556.png","datePublished":"2021-12-17T10:23:38+00:00","dateModified":"2026-09-02T16:04:37+00:00","breadcrumb":{"@id":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/"]}]},{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/#primaryimage","url":"https:\/\/www.sanner-group.com\/wp-content\/uploads\/2021\/12\/Screenshot-2021-11-02-101556.png","contentUrl":"https:\/\/www.sanner-group.com\/wp-content\/uploads\/2021\/12\/Screenshot-2021-11-02-101556.png","width":744,"height":495},{"@type":"BreadcrumbList","@id":"https:\/\/www.sanner-group.com\/insights\/blog\/how-a-failure-of-imagination-could-kill-your-product-and-how-to-save-it\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.sanner-group.com\/fr\/"},{"@type":"ListItem","position":2,"name":"How a Failure of Imagination Could Kill Your Product (And How to Save It!)"}]},{"@type":"WebSite","@id":"https:\/\/www.sanner-group.com\/fr\/#website","url":"https:\/\/www.sanner-group.com\/fr\/","name":"Sanner Group","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.sanner-group.com\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"}]}},"permalink_manager":null,"_links":{"self":[{"href":"https:\/\/www.sanner-group.com\/fr\/wp-json\/wp\/v2\/blog\/2583","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.sanner-group.com\/fr\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.sanner-group.com\/fr\/wp-json\/wp\/v2\/types\/blog"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.sanner-group.com\/fr\/wp-json\/wp\/v2\/media\/2584"}],"wp:attachment":[{"href":"https:\/\/www.sanner-group.com\/fr\/wp-json\/wp\/v2\/media?parent=2583"}],"wp:term":[{"taxonomy":"blog_category","embeddable":true,"href":"https:\/\/www.sanner-group.com\/fr\/wp-json\/wp\/v2\/blog_category?post=2583"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}