Is that a project manager or a product manager you're after?

I typically do quite long stints with clients. This enables me to approach the market every 2-3 years with a clean pair of eyes and some ability to discern how it has (or has not changed).

And, I observe a dominant trend in the market for project managers. Something that while it may have been present previously, is now all but ubiquitous. 

Let me ask a couple of quick questions first - consider this a little warming up to the subject.

1. Which project management methodology requires the project manager to be a subject matter expert?
2. Which project management process requires the project manager to be a subject matter expert?
3. Which project management product requires the project manager to be a subject matter expert?
4. Which project management process, product or methodology requires the project manager to have implemented the same (or nearly the same) product before.
5. How many projects fail due to a lack of subject matter expertise on the part of the project manager?

(Please note - your project management subject matter expertise is a given)


And, the answer in all cases (as you almost certainly reasoned for yourself) is none of them. Even if you quibble the last one - it's almost a self-evident conclusion if you accept the other 4.

Now I do understand why project managers tend to operate in their chosed fields of (say) construction, accounting or (in my case) information technology. If you spend 90% of your time communicating, you can't spend 90% of the time deciphering what (for the uninitiated) is going to be opaque jargon.

But, that's not what I'm seeing. What I'm seeing is hiring managers who (for instance) are seeking a highly literate technical project manger, with (say) extensive CRM experience and (in particular) SalesForce.Com. But also (and these aren't necessarily nice to haves), Oracle, SQL, Agile, UML. Oh and not forgetting your extensive (for example) experience with off-shore oil and gas and the two CRM implementations you'll have already done.

Now a quick review of some of the chief culprits which cause projects to fail

1. Poor risk management
2. Poor stakeholder identification / engagement leading to omission of requirements
3. Estimating that corresponds in no way to what is achievable on the ground
4. Flawed business case
5. Poor scope control

So which of these are addressed by anything other than good project management practice? Yep - none of them.

So how did we get here? I can't say because I'm not a recruiter with my finger on the pulse of the concerns and imperatives of hiring managers, but I have my suspicions. 

1. Unprecedented levels of cynicism towards both project managers and the profession of project management
2. Organisations instinctively reaching for the comfort blanket of 'someone who's done it before'.

I'm somewhat fortunate in that my technical background allows me a certain discretion. But I know this. On any project where I'm forced to use my technical expertise, I'm not doing the job the client is paying me for. And worse still, neither is somebody else.

That's agile with a small 'a' for me please

Business agility is a good thing. But that's not Agile project management. Agile working is probably a good thing in most cases, but that isn't Agile project management either. An agile mindset is more or less obligatory for the jobbing project manager - but nor is that Agile project management.

Don't get me wrong, there's a lot to like about the Agile Manifesto and even more to like about the 12 principles which underpin it. (I must remember to say the words "...maximizing the amount of work not done is essential" in my next job interview). But neither of these things are (in themselves) project management.

I can understand the appeal of Agile to programme stakeholders. If you've adopted Prince 2, all your requests for change should technically be added to the issues log. This can sometimes lead to a distinct cooling of the relationship with the sponsor when (inevitably) it is their requests for change. And it's not just Prince 2, if you've adopted the PMI/PMP standard, then one of the sponsor's key roles is to defend the project from change.

Against this, Agile adopts the persuasive position of "Welcoming changing requirements, even late in development." And, show me the techie who wouldn't heartily endorse the value of "working software over comprehensive documentation".

But since there isn't actually any such thing as "Agile Project Management" per se but rather a collection of iterative approaches (namely; Scrum, Extreme programming, Agile Modeling, Unified Process, Agile Data, Kanban etc) what exactly were you after? Because if you don't know the answer to that question - I certainly don't. (It might be that by the time I've finished this post - there will be such a thing as Agile Project Management - its a fluid landscape...)

Is Agile something of an emerging 'norm' in software development (and selected other) projects? Undoubtedly. But I'm not even sure if that's the point. If you're a programme sponsor or budget holder attracted by Agile techniques and want to know what you are going to get and when you are going to get it, you might want to validate that Agile can answer these questions to your satisfaction.

But you've heard all sorts of good things about an iterative approach and you want one? Fine - adopt v-model development or incorporate specific iterative elements into your project methodology either by tailoring Prince 2 or adopt PMI / PMP which already has a healthy iterative element in its planning cycle.

Personally, when I hear the word Agile used on projects I'm usually on the immediate look out for either of the following potential issues;

• Is the project simply too big to satisfactorily drive out one set of objectives and requirements (in which case it should be split into multiple projects)
• Is your schedule so tight that to spend the time required on planning "is going to place the schedule into an unacceptable negative schedule variance".* (in which case you should hire in some lots of very smart planners, recognise you're running at high risk and adopt rolling wave project planning 

*Credit to Wikipedia for turning 1 syllable (late) into more!

It isn't my view that Agile 'anything' is necessarily the antidote to these two potential issues. 

The author is a business focused, benefits driven project manager with no formal qualification in Agile and no experience whatsoever in developing software. Other views undoubtedly exist.

Would you be comfortable with an independent audit of your CV?

1. Go for it - you'll be lucky to find a spelling mistake
2. I'm okay about this - there's supporting evidence for most of it
3. None of the above

Some people might regard me (and many of those who share my views) as somewhat idealistic, potentially a little naive or maybe just unhelpful. I don't.

I don't fib on my CV. Never have, never will - and there's plenty like me too. Other views do exist and they always will.

To some extent, some hiring managers can afford to be somewhat relaxed about this - they either outsource the effort to validate the CVs or structure the interview to mitigate the risk.

If that was really an optimum way to work however - they'd have been no horse meat scandal. We'd accept 'mis-labelling' as a cost of doing business and move on. But then the horse meat scandal had two victims - those who (like me) might have been partial to the odd 'Shergar pie' now and again and also the legitimate farmers and retailers who's margins were either driven down or eradicated by one product masquerading as another.

And so it is in the professional arena. We have hiring managers who are being misled (examples too numerous to quote) and job seeking professionals who are being squeezed by candidates with less professional integrity. And, when an individual is prepared to concede in the national press that not only have they lied on their CV but they'd to it again - that's a problem.

For the time-being though, all I can do is help my clients sift CVs and seek to validate in interview their content. This experience has acquainted me with business analysts who can't analyse and technical specialists who aren't special at all. Which is fine up to a point. I do however reflect lamentably on all the CVs which were passed over because they didn't measure up to someone else's masquerade.

A cow, an Alderney and a raging bull...

Apologies for the gratuitous blog title. Google's decision to withdraw their excellent Reader tool has quite scythed my readership statistics with a corresponding impact to my moral.

I'm minded to start up such cheap tactics as including the names of minor celebrities such as Paris Hilton and Miley Cyrus simply to catch some incidental drive by traffic.

As a jobbing project manager, one of course does get a reasonable level of exposure to the catalogue of general (and often dubious) apocrypha that accompanies the day to day cut and thrust of managing change.

An example of such apocrypha would be "...all projects succeed and all projects fail. Just to varying degrees of both..." which is possibly a little trite, but I quite like it all the same.

One such example which I don't like is "...you pay a project manager to worry so you don't have to...". I've never liked this terribly much because in theory a very talented worrier is suddenly a sought after commodity and I'm not one of those.

And then there's this little gem "...you pay a project manager to communicate..". Simple, undisputed fact. I like it.

Perhaps because I'm a little left of centre about these things, I've always thought that Alex Alexander Milne's "The King's Breakfast" contains many allegories useful for the project manager. There's some stakeholder management, some requirements management, setting of expectations and supplier management all in a few simple lines intended to amuse children. There's even some remarkable insights into value management. (Okay - that last one is a bit of stretch

So perhaps now is an opportune time to elaborate a little on the title of this post. One of the challenges faced by the PM is summoning the language, the agility, wit, poise and timing to communicate effectively. Don't get me wrong, the PM isn't unique in having these challenges but the PM is certainly likely to be in the room when;

1. The sponsor asks for dairy products from the cow;
2. The supplier questions whether it is an Alderney or a Friesian from which the afore mentioned dairy products should be derived and;
3. The site foreman explains that no amount of coaxing is going to persuade an angry bull to give up a pint of the white stuff.

Yes, yes - I know, all part of the usual carry on a project management. But for our purposes here, we're talking about milk, Friesian's and bulls. And, you won't be. You'll be talking about change and, likely as not changes to an existing landscape many years in the making. You won't be talking to the king, the queen and the dairymaid, you'll be talking to real people with real skin in the game each of which is likely to have different needs and agendas, some of which will undoubtedly conflict. The information they want will be put to different purposes and will need to be presented in a range of different formats and mediums. Sometimes it's a one off and sometimes it'll be a repeating and up-to-date feed potentially updated in real time.

If this isn't delivered or can't be delivered it's likely to be the PM's phone that starts ringing.

So what useful steps can taken up front to guard against the prospect that either you can't or don't communicate as required. And, to understand the expectations and, where necessary to inform them.

1. Process and procedure. I'm not going to labour this one, I hope rather that it is self-evident. If you don't have process and procedures, make sure you can report on whatever alternative is in place. And by the way, I'm not altogether sure what that alternative is Semantics aside, there's usually a way to navigate around aspects of work that are inherently not susceptible to process. Wrap process and reporting around them and 'go up the stack' to ensure that the entry and exit points are understood within an overarching 'flow of process'. Acknowledge that there may be elements of the overall flow of process which are able to be more accurately and more precisely reported upon than others.
2. Validation and verification. Make sure you're doing the right thing. And make sure that thing is done right.
3. Nomenclature and language. Make sure that you're all singing from the same hymn sheet. Make sure your inputs are capable of supporting the required reporting outputs. Do not make assumptions that the data will just join up. Define it to the required level of detail and perform the requisite static testing and prototyping to ensure that it all stacks up.
4. Create standards, generate and publish a configuration management policy which is aligned and supports your overall reporting aims.
5. And perhaps most importantly make sure you, as PM ,are in the room to inform the discussions to make sure these steps are taken and that the necessary resources are allocated to the tasks.

 So, as it turns out, the phrase  "...you pay a project manager to worry so you don't have to..." might not be so much dubious apocrypha but rather something to say three times a day before you go to work to ensure that not for one minute do you ever forget it.

Late for a very important date - again?

Say what you will, most projects don't get delivered on time. A critical appraisal might include the word late. I'm starting to think however that the terms 'on time' and 'late' are worth consideration. And maybe, if enough consideration is given to the subject perhaps there might be something genuinely novel and interesting to conclude about the nature of projects generally, the frailty of current management approaches and what can be done about it.

There's an interesting blog post here that I read sometime ago - you should read it but in absolute summary - there's no such thing as slipping dates, just bad forecasts. I remember this really making an impression with me when I read it. I don't just think its a good point, I think its a potent entry point to a much richer discussion.

A while back I prattled on about an idealised constant 'K', which represented all the work that was required to be done to complete your project assuming no waste. I've re-rendered the drawing below.

There's some simplification here. There's no discussion of change requests, procedural acumen or PMO statistics for this sort of project run in your organisation but broadly;

Work that needs to be done to complete your project is K
Work that you identify to be undertaken for your project is Kb
Magnitude of error in plans is K - (k2) + (k1).

k2 is interesting as you may or may not end up doing it and to some extent it cancels out k1 which you'll always have to do.

What's our list of variables then? Things that might influence k1 & k2. I suggest the following

1. Preliminary planning fails to identify accurate the work that needs to be undertaken or the time it will take to complete it.
2. Failure to accurately identify dependency relationships, leads and lags
3. Blunders, poor forecasting and re-work
4. A change budget (£/$) but no corresponding schedule allowance
5. HR Management issues (absence, incompetence and ineptitude)
6. Failure to manage complexity
7. Criminal or unlawful activity
8. Acts of nature

Of the 8 points above, I would suggest that item 1 is far and away the most significant. Some other time I might take the time to blog on the predilection of homo sapiens to focus on outliers at the same time as dismissing the significant but for the time-being I think I'll simply focus on items 1, 2 & 3 above.

Let's take a moment to summarise and take stock. Project delivery consistently moves to the right (perhaps systematically so) and there is (I suggest) some consistent harbingers of this movement. Interesting this isn't it? We've got a consistent output (delays and destabilisation of the project schedule), consistent inputs (I'll continue to subscribe to points 1-3 above - other views almost certainly exist). Shouldn't this mean we can do something to quantify and assess the potential impact to our projects?

There's a little bit of overlap here potentially with the schedule performance index which I mention here. But its not quite the same animal. Firstly, you've actually got to implement some rudimentary earned value management and (somewhat shockingly) almost no one ever does. But it will only help you so much as it will only use a sample of work done so far rather than a more useful measure the project in its entirety. This means you'll get increasingly good data as your project progresses but at the outset, it'll be highly unreliable.

At this point, I feel I want to talk about cooking for a while. 

Cookbooks are full of recipes. They describe the ingredients and implements required, the steps, temperatures and techniques to use and usually describe the output. They do this consistently well otherwise people wouldn't buy them.

If you follow the instructions and you have a little culinary acumen you can have a high level of confidence that what is delivered will be edible. Delicious even. If however, you use second rate ingredients, rush the prep, burn the food and respond to a late request to remove the anchovies, there's significantly less chance that what you deliver will be fit for purpose or on time.

Cookbooks are a good illustration of our idealised constant 'K' that I mentioned above. They do have the advantage however that a) they're not a unique undertaking and b) almost universally they'll have been reworked and rehearsed perhaps over several generations. So, they're not projects are they. But they do highlight the importance of knowing everything there is to know at the outset and what the benefits of knowing everything are.

Continuing on our epicurean line for a spell longer. If we removed some of the ingredients and steps from a recipe we'd be doing something to model in abstract the deficiencies in planning to which many projects (all?) find themselves prone. Would we be able to identify the omissions? What could we do with them if we did identify them?

We'll, there's one sure way of identifying that there are omissions (as opposed to what they are) and that's cook the dish. I don't think its too much of a stretch to suggest that any omissions could be identified and quantified. So what's the benefit of investing this time and effort? What can we do with the information we're now in possession of?

Can we extrapolate anything about the remainder of recipes in the cookbook (project)? Can we play any discrepancies across the remainder of the project? Well, maybe. Omissions from the fish section might not be applicable to the dessert section and should you take your cookbook to your aunt's for Sunday roast, all bets might be off when comparisons are made with cooking in your own kitchen. This is where the schedule performance index (and cost performance index) fall short for our purpose here - they focus exclusively on the sample of work that has been done, not a proportionate sample of the whole piece.

What I am tilting at here is that if we cook a few recipes up front we'll be better able to assess the cookbook in its entirety. The more recipes we test (the greater the sampling) the better picture we'll develop of the overall scheduling, scope and procedural quality.

So what next? I'll seek to elaborate the points above and answer the following questions.

1. When is this sort of critical appraisal essential as opposed to desirable or superfluous?
2. What could the job of analysis of a project scope / schedule entail?
3. What could the output be used for?
4. Who would do it? When? And for what purpose?

Equine allegories

First, please excuse the title  - a cunning attempt at promoting my blog. Anyone (and I mean anyone) who Googles "Equine allegories" is sure to be directed straight here. A winning strategy I think you'll agree.

Now, for those of you not in 'my manor' as it were, there's been a bit of a scandal of late with beef not being beef. Suffice it to say, jokes about Red Rum Steak abound. 

I think this has got some fascinating insights for anyone in the business of change.

Let's talk about quality assurance and product acceptance first. Projects are comfortable in a landscape of customer / supplier. Other approaches exist. I've always adopted a stance that the supplier is accountable for quality assurance. Equally, the customer never divests themselves of the onus for due diligence corresponding to product acceptance. It is too risky to rely wholly upon the supplier's quality assurance.

Now, risk. I've never been comfortable about the whole 'transferral' of risk thing. Mainly, because I don't think you can transfer risk predictably and reliably. I'm minded of a supplier who was responsible for building the new Wembley Stadium and F.A cup finals which were held in Cardiff (Wales) for 2 (3?) years due to delays in construction. And similarly here, while the supermarkets in Britain can point the finger at their suppliers, the fact they've not done their own testing isn't going to sit well with their customers. Particularly when they've almost certainly profited from the whole fiasco..

From a consumer point of view, it seems to me that the consumer demands choice at the lowest  price. Now hold on a minute there, because actually, I don't.. But, it's the line spouted by the business's involved in grocery retail so there may be a grain of truth in it. So, if we only make a purchasing decision predicated upon cost, then we're likely to get a supplying decision predicated wholly around cost with all the consequences it brings.

You'd think governance would play the part of fair, honest and effective broker in all this. I wouldn't. Basel II, Sarbanes Oxley and FSA couldn't avert the biggest banking crisis of a generation. You can try all the tricks in the book to minimise risk, maximise value and ensure the right decisions are made by the right people to the right criteria at the right time. But, if greed, gain and guile are the prevailing cultural themes within an organisation, it won't matter.

But, there is an up. Discovering that stuff has gone wrong today makes you better off than you were yesterday. You can start the job of corrective action, you can learn some lessons and strengthen whatever is needed to prevent re-occurrence. 

Finally, there's something else to take away from all of this. We can read and write all the books we like. Develop the discipline of project management in new and exciting directions. Effective and sound judgement however is something ephemeral, acquired slowly and lost quickly. 

Making life easier (and a bit of process stuff)

Projects generally have a lot of 'interconnectedness'. And please - I don't just mean railway projects.

Processs are rarely 'stand-alone'. The outputs from one process are, more often than not, the inputs fir something else. (So help me) you'll start to hear the words ecosystem and (abandon hope all who enter) 'synergy'.

In an ideal (and possible mythical world) you have ERP, CRM and EPM tools into which all your various risks, issues etc are included. But, from time to time, the enterprising PM may find themselves without these tools and forced to fall back on more prosaic mechanisms (by which I mean Excel).

I've provided a spread sheet here. I call it ACRID (derived from Assumptions, Constraints, Risks, Issues and Dependencies). You'll also come across the term RAID (minus the constraints), and you'll probably not often come across a CORDIAL log which (of course) contains the lessons learned log. Any attempt to include a quality log is headed for the rocks.

We don't want to make life too hard for ourselves and, of course, we'll want to keep an eye on the whole process ecosystem angle so we're not duplicating effort left, right and centre.

I include here a template for a highlight report. I like highlight reports as I know of no better way to bridge the divide between the poets (for whom business transformation is a mere pen stroke) and the plumbers who lie awake all night worrying about it. I take some license but there's a sliding scale in there somewhere.

So, back to the whole inputs and outputs thing. If you take a look at the highlight report template (which is aligned with Prince 2) you'll notice there's quite a bit on work packages and products. Check back to previous posts and you'll have all all you need to cut and paste into the highlight report.

In fact I'll paste in the contents page from the highlight report template and append it with where you derive the content from each section from.

1. This reporting period

Not much going on in here

1.1 Work Packages

...Or here

1.1.1 Pending authorisation

If you need them, you'll have been writing them and you'll know which ones are outstanding authorisation

1.1.2 Completed in this period

From the project plan, paste in relevant sections of WBS

1.2 Products completed in this period

From the project plan, paste in relevant sections of WBS

1.3 Products planned but not started

From the project plan, paste in relevant sections of WBS

1.4 Corrective actions taken during the period

Issue log or other sources as appropriate

2 Next reporting period

Not much going on in here

2.1 Work Packages

...Or here

2.1.1 To be authorised

From the project plan, paste in relevant sections of WBS

 2.1.2 To be completed in the next period

From the project plan, paste in relevant sections of WBS

2.2 Products to be completed in the next period

From the project plan, paste in relevant sections of WBS

2.3 Corrective actions to be completed in the next period

Could be anything - use your judgement to include what you feel is appropriate

3 Product and stage tolerance status

SPI / CPI figures as appropriate (this will have to wait for another day for detailed coverage).

4 Requests for change

From the ACRID log so long as you raise all your changes as issues

5 Key Risks

From the ACRID log

6 Issues

From the ACRID log

7 Lessons Report

From the ACRID log

***************************************
Some points to bear in mind.

1. Truncate (i.e. hide a few columns) on the product descriptions, WBS elements, risks etc as you'll not fit them all on a single landscape A4 and the detail is probably more than your audience will want
2. I'll cover off a bit on the cost performance index (CPI) and schedule performance index (SPI) another day.
3. Corrective action could mean almost anything - include what you think is appropriate
4. Some stakeholders will want detailed information about resource burn, budget status or other detailed information not included above - this is a good sign and shows that the sponsor is 'on board' and giving the project focus.

And, to wrap up the topic of the highlight report I conlude with the following key points which I hope will impress upon you the benefit of producing it, even if your stakeholders are sanguine on the topic.

• It is an excellent tool of communication to all stakeholders, both to relay issues and status concerns but also to keep all parties abreast of progress. It is a principal tool by which the project manager can relay, escalate and communicate issues and anxieties which require board / sponsor input.
• I find it amongst the best ways of structuring a project board meeting, particularly for stakeholders less experienced in sitting on project boards
• If (like me) you keep all your WBS elements, product descriptions and logs up to date, with practice, you can produce one of these in about 20 minutes.

The Great Wall of China, governance and my sock drawer

Went to a talk by Geoff Reiss tonight - author of, amongst other things, Project Management Demystified (I own a copy - recommended).

All sorts of interesting points cropped up and I thought to relate a few here. The talk was entitled "Great and Deadly Projects". Geoff it turns out has a considerable interest in singular projects undertaken across the millennia (The Great Pyramids and The Great Wall of China) to name a couple.

The Panama Canal which was undertaken in 1911 for instance (great) thought to have had 30,000 fatalities (deadly) was noteworthy. The question of whether in 2011 there were the 30,000 projects with <1 fatality begs an answer.

A well intentioned attendee suggested that there was a clearly a case of better governance. Some wag in the audience responded that this would simply have led to more accurate record keeping of the casualties.

This last is a prompt that I must set pen to paper on the topic of governance. Mind you I must first acknowledge the dilemma that if you asked 10 PMs what governance was you'd get 11 different answers. Can the governance specialists do better?

Thank goodness too that Geoff Reiss fielded something that's been on my mind for quite some time now, namely that the truly great projects were very lucky.

There's a lengthy post in its own right here but I'll aim to unsettle you bit right now. Let's set the scene a bit on the topic of risk. (I have to do this because the nomenclature used on the subject within the spectrum of project management is inconsistent and imprecise). And that's twice I've been hindered by terminology in one blog post.

First, what's risk? Something bad that may happen? Maybe. Let's say that risk management is the job of reducing the likelihood of something bad happening and reducing the impact if it does happen. So if you can't assess the likelihood of something or what the impact could be - is it a risk?

Building on this is the assertion that if the something bad that may happen is a) subject to probabalistic.distribution and b) has a known consequence / impact then it is a risk. I've been racking my brains for the perfect illustrative vehicle for this and the best I could come up with is my sock drawer. More on this in another post, but for now, if its not a risk what is it? I suggest you're standing at the yawning abyss of mathematical uncertainty. The problem is  that almost everything you read about risk will incorporate the word uncertainly. 

Something else rather interesting arose on the topic of communications today too. While bemoaning dwindling levels of interest and low rates or response to communications initiatives a fellow project professional bemoaned that stakeholders were only reporting positively via surveys about their experiences. The noteworthy point in this is that those stakeholders who were still attending sessions were feeding back positively. No channel of communication existed with stakeholders who'd left for greener pastures. I don't quite know what the communications parlance is for talking to people to who are talking to you any more, but in its absence you might try 'friendly consultation'.

Note to self - must write to Francis Maude and ask why isn't Earned Value Management mandated in public sector projects.

Requirements, testing and quality

I'm a big fan of testing, test methodologies and approaches. It's a fantastically rich and mature discipline and offers a lot to the project manager. I think the value of a project manager will almost certainly be amplified by even the most rudimentary knowledge of the discipline.


One approach I've become comfortable with is illustrated below.

Here's a link to a read only Google Doc of the illustration. Please help yourself. Here's a link to an editable version - if you can come up with something you think is better or interesting, please amend it as you see fit. If you do edit it, add some comments to the blog explaining your rationale. 


I'm only going to touch on each component briefly now. In practice, with the exception of the quality log, the components are in themselves substantial topics. But I intend to make this something of a recurrent theme and I'll try and support the process with a few useful resources along the way.


Hopefully, most of the elements illustrated are reasonably clear. Requirements, a big topic in itself, will almost certainly be the starting point for the majority of projects. I'll come back to the quality risk analysis (QRA) later. Development and implementation are condensed - they're not my focus here. We undertake testing* and either verify a requirement has been met, recording this in the quality log or find that it hasn't been met and raise a defect. 

*In practice, testing is an ongoing activity throughout the project life-cycle, but for my purposes here, it is illustrated it as a single element.

In practice, the quality log might seem a superfluous overhead. It can however prove to be quite a useful document, illustrating what has been achieved. By comparison, the defect log which, on its own, can paint a picture that isn't wholly representative.


The quality risk analysis was something I came across in Rex Black's book, Critical Testing Processes. Equally, he covers it in reasonable detail here. I include the abstract below.


Testing any real-world system is potentially an infinite task. Of this infinite set of possible tests, test managers need to focus on the most significant risks to system quality. These are the potential failures that are likely to occur in real-world use or would cost a lot if they did occur. This article describes practical ways to analyze the risk to system quality, providing guidance along the way to achieving effective and efficient testing.


I'll return to the topic of quality risk analysis and include a useful resource to support its use in due course. However, it would seem an opportune time to leave you with a very succinct and almost universal definition of quality namely; meets requirements, fit for purpose.