- Published on
Complexity and its impact on organisational leadership & management
Complexity and its impact on organisational leadership & management
We all talk about complexity, but what is it? This framework makes sense of complexity for leading, managing, decision making and designing organisations. As a simple alternative to Cynefin, this introduces a new and better way to understand, effective leadership and re-design organisations.
You can either read this article, or as an alternative, watch the 17 minute video that I created.
What is complexity?
We are going straight in to define complexity simply using an example, because complexity is simple to grasp (despite all the arguments and science around it.) Complexity is all around us. So, leaving behind the academic descriptions on the internet, for me complexity has to be experienced to be understood. And that is what we are going to do now. We need to look at our actual younger self;
- What did you do when you left school?
- Did you know exactly what you were going to do from that moment onwards?
- Were the steps you took to get the your first job already planned out from the start?
You were living with your parents, wondering how to get out and live somewhere else. Find some work to pay the rent. A friend invites you to share their apartment and you begin a job in a restaurant. You think you might like to manage a restaurant one day. But after some time, you really don’t like working late, stuck in a hot kitchen. So you begin to look for other work, and a friend of your father has a vacancy in his office. In desperation you agree to try that out. After six months, you find you are good at the work in the office, and they promote you. Your life in working in insurance has begun! Then 10 years later you change to a different profession.
Despite our focus on logical cause and effect, almost all of our life experiences happen according to wilful intent and seeming chance events, that conspire together to create the outcome that occurred into our lives. Change one thing; a rainy day, and the sequence and outcome changes. You happen to read a job advert at a friend’s house whilst reading their newspaper, that results in the job you have today. You might walk into a random cafe and meet your future partner.
These events rarely happen when we just wait or plan for them to occur, but this might also have an impact on our outcomes.
In most cases where we are in our lives today, has been arrived at by applying intents in a general direction. But none of this was predictable, nor under our direct control. Our experiences are based on those that others contribute to; perhaps family, colleagues, friends, that are also out of our direct control.
This experience of uncertainty and partial happenstance is surely our most direct example of complexity. It certainly helped me to then take that concept into organisations.
Now let's have a look at organisations.
Complexity and organisations
This is a framework that is an alternative to Cynefin, that will help us to deal with complex work situations in a far more effective and better ways than how we often do. That framework revolves around three key situations that we find in organisations;
- logical situations,
- complex situations,
- critical situations.
complexity framework diagram
Before we dive into this framework, let us ask: what is working and managing in organisations today REALLY like?
A large part of the work that managers do in organisations is about how we do things; applying rules, making decisions, designing better ways of working. We are usually doing this by adjusting how we:
Changing the work - by designing and improving our services,
&
Dealing with daily work - by managing operational teams,
As managers, we are constantly dealing with situations and resolving problems in the workplace. All while we are trying to reduce the long list of to-do items we have to deal with.
However, if we are really honest with ourselves, we often find that what we actually do is often more about reacting to keep the organisation stable.
How often are we actually:
- fire-fighting urgent actions, and fixing them with the first solution that comes to us,
- dealing with awkward situations, that seem intractable, and
- dealing with issues that seem to keep repeating - a 'whack a mole' approach.
Perhaps we are just too busy to have the time to actually stand back and question how these apparent situations occur?
Here, we are going to look at how we really behave, and our decision-making. We will highlight how successful decision-making works. Lets start by looking at three types of situations on our to-do list, the first being Logical situations.
Logical situations
Definition — A logical situation is one that, when we observe it, we can understand that it follows a rational logic; we know how it was created and therefore its outcome is possible to determine.
Our response to logical situations are often based on thinking of our organisation running like a well oiled machine: a machine paradigm, a mechanistic way of thinking. So when the organisation machine is broken we go and fix it. These situations consist of cause and effect relationships that we can understand. We find facts, and use data to inform us as to what to do.
As an example, the design of a business process that describes a service like online shopping, is logical by its design. The way that we document it and train people follows a logical flow. Logical operational processes are how we understand organisations and how to manage them.
Examples of Logical situations or services of organisations are;
- An online shopping service.
- Dealing with an employee being late to work, using an HR process
- Dealing with a customer complaint.
- A standard surgical operation.
Logical situations can be:
- Simple situations, that are easily understood.
or,
- Complicated situations, are logical that are not immediately understood. So they require further expertise, time and understanding to resolve. Manufacturing an aircraft is a complicated situation, because every part of an aircraft is measured and known, but no one person can understand it all.
Characteristics of logical design in organisations are;
- Processes and services that are seen as designed like a logical flow; defined as transactional.
- Control is through fixed hierarchical decision-making structures.
- The use of procedures and standards that are to be followed.
- Audits that are used to assess compliance with the standards.
- Measures are used for understanding, control and planning.
- Change occurs through planned project management.
How we deal with a logical situation
Identifying and resolving a problem is usually based around a logical analysis;
- Assess the situation, define an outcome, and plan for that outcome.
- Analyse the cause and effects inherent in the situation.
- We apply our experience and solve the solution.
Logical simple method = define - analyse - solve
Logical change in organisations
In organisations change most often happens through projects, by design, maybe a reorganisation, or a process improvement. Or just a decision by a manager to change something themselves. These activities consist of rational analysis and decision-making.
The more we understand a logical linear system, the more control we can have over it.
Also, the more we understand how this logic works, then its workings and outcomes become more predictable. Business analysis is based on this logic.
Change within a logical situation ensures everyone understands what they need to do. Monitoring becomes the measure of variance to that plan. Planning becomes a key competence of managers in this logical process.
Service design and Project management are methods for organisational change that has found great success in redesigning highly transactional services, and implementing change projects.
Complex situations
What is complexity? Complexity is not logical, it is;
- illogic, a complex issue cannot simply be directly linked to a cause.
- ambiguous, and therefore unpredictable.
Lets start by defining this relationship;
Complexity = uncertainty
What does that mean?
Reminding ourselves about what complexity is from the paragraph at the start of this post.
- What did you do when you left school?
- Did you know exactly what you were going to do from that moment onwards?
- Were the steps you took to get the your job already planned out from the start?
The characteristics of complexity and how they might manifest in an organisation.
- Ambiguous or new. We come up against something that neither we, nor anyone else that we know has come across before.
- Partial view. We can only get a partial perspective of the situation.
- It cannot be understood or solved in isolation. We can change one part of an organisation, maybe in a department, but the impact of that change then creates a new problem somewhere else in the organisation. (like 'Whack a mole')
- Bigger than our individual ability to control. It sits outside a single hierarchy and across systems that are not under single control. An example is how social media is not controllable, it can only be influenced.
- It is dynamic. This is when an aspect of what we are involved in simply keeps changing according to patterns that we simply cannot predict.
- We cannot solve it. Often there is no clear solution or final result to a complex situation.This makes a definition of success difficult or nearly impossible to define, and the complex situation may change but actually remain unresolved.
- Uncertain outcomes. Because of the uncertainty listed above we cannot easily extrapolate future events from past data. We cannot predict what is going to happen. Therefore we really don’t know what the outcome might look like. So defining the outcome at the start of a complex project might be inaccurate.
Let's look at an organisation, and look for what is complex, or messy in operating and managing it.
- Is there not an apparent messiness, or complexity in how a manager makes decisions?
- Is there complexity in the real behaviours of individuals and groups of employees?
- Is there complexity in the practical creation of a redesign of a service, or of the actions of customers over time?
How much of what we see and do in an organisation is actually complex?
For a very long time I believed that we should be working and thinking in the workplace logically. I continually tried to create certainty. And when I saw that this did not often happen, it became a problem for me. I felt I had to try harder to be logical and control. However, after looking at those situations using the concept of complexity, I realised that I was actively immersed in complexity all around me. I realised that we as individuals and groups of people are perhaps far more complex than we think we are. And that much of what goes on in an organisation is actually complex rather than logical. What we are uncovering here is that the way we deal with logical situations in organisations has to be very different to how we deal with complex ones.
At this point, as a reader, it might be helpful to think about and explore these complex concepts yourself; with regard to your life as we have written above, and your experiences working in organisations. It took me many weeks, perhaps months of thinking about complexity, to link complexity to me and my work.
I found complexity scary, because I was used to knowing how things worked, and how to plan. And complexity pushed that way of thinking aside. This irrationalism also extends to organisational change and redesigning work within an organisation. I began to see that the fact that change programmes were less about following a logical method, and more about a set of human interactive activities that leads to positive change. When we “engineer” with only logic in mind, it does then explain why so many change projects fail to meet their objectives. What if we replace that planning of change by explorative design, test and learn that is more human, more about adapting and developing emergent outcomes?
In today's business world, we recognise, far more than we used to, the uncertain nature of business and the ever changing business environment it resides in. This is not because there is something wrong, but because it is inherently complex. Complexity challenges the fundamental assumption that we operate in logical scientific ways, by recognising exactly the opposite; that uncertainty and a lack of cause and effect, are valid. And in many cases complexity might be the dominant principle.
Examples of complexity
- The reasons why families fall into debt, and therefore their way out of their situation is often complex.
- Employees behaviour within an organisation; their complex and adaptive interactions and behaviour.
- Designing and operating a non-transactional service within an organisation, will often have complex elements from customers to deal with and their varied requirements.
- Booking a flight is logical, but missing a flight and then having to rebook, is often complex, because the intended solution may not be to simply repeat the booking to the same destination. It depends entirely on the situation with the customer and their changed needs.
- Transforming an organisation.
Dealing with complexity
Complex situations cannot be resolved using logical methods
Identifying a complex situation.
When we are confronted with a situation in an organisation, before we begin, the first question we can ask ourselves is;
As an example, we can take the payment element of an online sales service;
1. Is it critical, logical or complex?
Answer; The bulk of how we pay for a service, especially online, is transactional and logical. The underlying concept is logical.
2. What about the customers, what payment method can be used?
Answer; Payment is inherently a transactional process and logical. The underlying concept is logical.
3. What about those who cannot pay?
Answer; When we understand these customers, in many cases the causes of why they cannot pay is out of their and our direct control. The underlying concept is often complex.
Therefore 3 above, needs to be approached very differently compared to the elements 1 & 2 of the service.
Dealing with a complex situation
A method to deal with complexity
- Immerse yourself into the situation, rather than asking for data, or a report. We do this to view it from different perspectives, and as a system as a whole.
- When we are immersed in that situation, our task is to make sense; to find out what is going on. We are interested in learning as much as we can. Putting aside our own views and solutions, we search for alternatives. We might talk to a group of front line people in their workplace, where we ask open questions, observe and listen. We ask people to take us through the workflow, and we see what they see. We understand what it is like to be them, and we pay attention to their behaviours and concepts they hold. We are co-constructing a picture of how things work from different perspectives.
- At this point we might then change something or test or try something out. And at the same time continue understanding the unfolding picture of what is occurring through sensemaking. We do this, not to solve the problem, but iteratively to further understand and learn what happens when we change something. As we observe the impact of any changes, this activity often leads to emerging further insights. I like to call this process synthesis rather than analysis.
- When we have understood to a point of whole understanding that we believe is sufficient, we might be in a position to co-design with others to decide what to change or adapt.
- Often, we need to keep connected so that we can continue to learn and deepen our understanding. So we repeat the loop iteratively.
We are familiar with individual analysis, but Synthesis is different, it is integrating; synthesis is less about focusing on a specific area, and more about pulling back and understanding how each element interacts with each other. When we immerse ourselves in a situation, our intent has to be one of learning, and synthesis is about understanding the whole situation, including all the hidden aspects that we cannot see or have data on. The outcome of synthesis is more clarity and understanding, and because this understanding is complex, it is often difficult to put into facts and data. It might be helpful to see the concept of;
synthesis is integrating, analysis is reductionist
We often have to reflect before we act.
We often have to look at relationships rather than just facts.
We cannot define outcomes at the start of the process, because we don't know what those outcomes might be.
We cannot have targets, and we might not know costs and timescales.
These are quite different to logical situations.
Characteristics of complexity
These are some of the characteristics of dealing with complexity, it requires;
- A specific leadership style to foster teamwork, rather than management, to bring people and insights together.
- Synthesis more than analysis, where the primary purpose is not to 'fix', but to learn.
- Accept messy situations that we cannot control. We need to accept that we do not know all the answers.
- Embrace order and disorder as both being valid, and allow space for innovation and curiosity.
- Collaborate and ask appropriate questions.
- Value knowledge & understanding, rather than data.
- Understanding that decisions are best made closest to the engagement with the work or the customer
- Succeed by collaborating with others in the whole system, rather than decisions in isolation.
When we are implementing change, complexity points to;
- Non-linear design method like 'test and learn', the path of the change follows what we are learning.
- An emergent design, where outcomes cannot be predefined
- Co-designing with employees and customers, learning and creating together.
Experimentation and learning should be fundamental to the method used.
Structure for dealing with complexity - designing and leading
In a complex situation, the understanding of the real context, is often not with data or with a group of people in a room, but it should almost always occurs at the place in the work where that complex situation occurs.
For example, if we have a front line employee whose job it is do deal with something complex, then they are at the place that can best deal with that complexity; not the manager, or the expert, but that employee. We go to where the greatest understanding of it occurs and how it manifests.
The structure of decision-making for logical situations may well be the hierarchy, and expertise. Conversely, the operating structure for complex situations is often best understood as a network of people, with the one who has the most understanding of that situation at the centre of that network. That diagram of a network looks like a spiders web, the links changing as the information in the centre changes. The network shifts in response to change, because it senses, understands and reacts to that change. We can call this a self-organising network. A network of knowledge, responsibility and decision-making.
And what of the role of managers and leaders in complexity? The managers job should be to design the organisation to allow for the freedom to act at the place where the complexity exists, for decision-making to occur there.
The managers job is to allow for the freedom at the place where the complexity exists, for decision-making to occur there.
structure within logical and complex approaches
Rethinking analysis, understanding with sensemaking
Facts, Data and Reality
Data are discrete pieces of facts that have been converted into numbers. Data is a representation of measurable reality that has been reduced to categories, and values. Logical situations lend themselves to data and categorisation to help to make sense of it. They rely on the accuracy of facts to understand and measure. Therefore logical situations can use the methods of analysis, like data analysis and categorisation very successfully.
The information we acquire about complex situations through sense-making, follows illogic characteristics. It is usually multi-layered, and connected in various ways. When we examine a part, seemingly separate elements are connected with each other. We can understand a complex situation as a systemic picture in our minds. A picture in the mind is rich, expressive, and connected in ways that transcend description and categorisation. This is the processing of sense-making.
How do we put this complex picture into data? The answer I have found is that we cannot do this easily. So, I resist the temptation, and alternatively I keep the complex picture of sensemaking in the mind as a primary repository for understanding. When I engage and transmit this with others, we do this as a rich picture or a story.
Complexity & digital
Lastly, what about the role of digital technology? This is such an interesting and important subject because it is so relevant today.
Firstly, digital is not just a technology, it also comes with its own set of principles and paradigm that reside in our minds when we consider digital. The model of how Amazon works, for instance, gives up a simple input - output machine model.
Secondly, digital is inherently logical, and complexity is not, therefore digital struggles to deal with any type of complexity.
I like to think that there are two main types of processing technology.
- Digital, great for dealing with logic.
And what is the technology that is best suited to deal with complexity?
- The human mind.
And that comes free with every person, so lets use it!
And what is the technology that is best suited to deal with complexity?
It has to be the human mind.
Using the complexity framework in an organisation
#1 What method we use.
Generally in our work, each of us seeks to make things simpler, to make our work easier. As we simplify, we use the same methods that we trust, again and again.
It's quite natural. It is like the quote:
If the only tool you have is a hammer, you tend to see every problem as a nail
Abraham Maslow
In my observation, one of the causes of the rise in 'complexity' in the business world that we see today, is because we fail to recognise complexity and how to deal with it appropriately.
#2 It's a mixture.
What we realistically find in the business and design of organisations, is that real situations are a mix of complex and logical, and sometimes critical. A situation is not only one or the other, but one characteristic will be more dominant than others. Often I will say 'that is a complex situation because the complexity is dominant.
Critical situations
Critical Situations in organisations
- Managers in any organisation who feel pressure to deal with an action list that they have to get through. Our primary intent is to get through our action list quickly, which results in a behaviour that is based on speed. We find ourselves in a crisis or ‘fire-fighting’. It appears that when we work like this, we have little time to think about the method we use, or the impact of acting in this critical mode. In firefighting mode, the true nature of the causes of issues are rarely addressed, and problems often re-occur at a later time. This situation is endemic in so many organisations, the Hero manager in action!
If we are looking at a chaotic situation, perhaps the best way to begin is to attempt to move from chaos, to one where we have some control - some stability. So, if you are a manager operating in this state, you can take steps to calm that immediate response.
- First pacify the crisis, by “buying time” to deal with the chaos now, to make some space to think.
- Deal with the underlying reasons of the situation, so that we can decide how to keep the chaos under control.
Try to move to
Calm thinking = clear the crisis, reflect — re-evaluate the situation - decide
When I see a manager acting in crisis mode, I have learned that I cannot really engage with them rationally, until the crisis is over.
I have also learned a very interesting deeper aspect to this that explains the reactions we have. We are human after all…
- We prefer to find the easiest solution, rather than the real one.
- We prefer to have an easier time, rather than do more work.
- We react to our fears and work within the culture of the organisation.
- Many of us seem to prefer and even enjoy 'firefighting'.
The simplicity of the complexity framework
complexity framework
Rethinking an organisation as a Complex Adaptive System
Our understanding of an organisation then includes the quality of relationships and interactions. It is these interactions that actually make the organisation work and thrive.
We are familiar with the diagram of a logical organisation, but there is no equivalent diagram that describes a CAS. The reason is that a CAS looks different to different people in the organisation, depending on the reason of interest. A diagram of knowledge is different to the diagram describing the operations, and it is different to the diagram that reflects authority. These differences are a characteristic of how we understand and view organisations as systems, in that they are shaped by us as individuals.
This lands us in an awkward place, unless we simply accept that this lack of clarity is how it should be. Let us accept that there is no one model of an organisation. So let's not try and create one right now. This situation is not a problem, we will sort that out another time. First let's Understand the workplace and our services, then we will worry about what might it look like as a diagram.
- We tend to seek simple solutions, but human organisations are inherently complex.
- It is natural for us to simplify that which we do not understand.
- We like to fix, but often we need to understand first.
This framework is derived from Keith Grint, and Rittel & Webbers work, and many front line people who I have had the pleasure to work with over the years.
The Cynefin framework
The third point that I found when using Cynefin with managers in my work, is that they very quickly get into confusion with having to learn new words and meanings. It is a massive learning exercise for them, when it should be simple. So I designed something for my work that is designed for organisations, and more straightforward to work with.
ver 1.2
John
This then helped me to get past the conceptual arguments and find that reality itself is the best learning place to go to for this. I then tried this with teams and managers and they found it very helpful and applicable. Hence the article!
Does that make sense, and help bypass the theory?
If I'm right, you're not talking about 'ontology' (is something *fundamentally* of one type of another, regardless of what you are thinking about it - a tricky concept of course when we inevitably 'frame' situations al lthe time).
Nor are you talking about how to 'see' situations - the ways things like expertise, timing, purpose, context, constraints etc shape the possible framings that might make what seems complex simple, or vice versa.
You are talking (I think) about how to *respond* to situations - when life comes at you fast, or the to-do list challenges you - how you can decide how to act.
It's hard to keep these three possibilities separate, since indeed they all layer onto each other - you could argue they're inseperable, but that's precisely the kind of argument you are asking to put aside here to invite people into a conversation about your prractice and what you think works.
But this way of writing it seems to do that much more. It's still challenging that there are obvious similarities to Cynefin, but it's a very valid point that that framework has no monopoly (from the Stacey Matrix to Adaptive Leadership to Grint to Ackoff to Rittel and Weber etc) on these distinctions.
Yes, I am suggesting moving away from the theory and epistemology and simply practice when in the reality.
I describe this because I find that to do otherwise, when in complexity, to be highly problematic. We end up in a theoretical removed from reality space. And thats the problem. We then argue, and find this space difficult.
The similarities to Cynefin are due to the fact that the main 'domains' were developed well before Cynefin came along, in my observation and reading they are inherent in writing since the 1960's.