Recently I posted on SHIFT about evaluation. The evaluation circumstance I talked about is really just one semi-formal way of realising that real situations are often bigger than the way we choose (initially) to look at them.
Table of Contents
ToggleIn the spring we went on a short break โ and it made me think on how our expectations and criteria setting can fail to deliver the whole story โ because this place was more than the sum of its parts. In fact it was a bit of a lesson in the power of perception.
OK, so letโs start at the beginning โ how do you judge a hotel? Well, you think about the things that matter and you score them, letโs say out of 10. For a hotel then, we might have things like comfortable beds, good food, car parking and so on. Now I could score our hotel on that kind of criteria:
Food โ 6/10:ย ย ย ย ย ย ย ย ย ย ย good, but a bit predictable, safe and overpriced
Beds โ 5/10:ย ย ย ย ย ย ย ย ย ย ย ย comfortable enough for decent sleep but aware of the odd spring here and there
Car Park โ 7/10:ย ย ย ย ย ย enough open space, gravelled in parts, near the door, some mud.
I knew the hotel was โdog friendlyโ because that was the first criteria put in when I searched for somewhere to stay in the area.
But never mind the scores, the place was great โ although I canโt exactly tell you why in a way that makes total self-contained sense. It just felt right, much like the way I felt about Melbourne in my first hour of walking around 20 years ago. I canโt tell you why Melbourne is still my favourite city โ certainly not by taking the cityโs attributes to pieces and scoring them individually. Somehow it just works for me as a whole.
And the Suie Lodge hotel worked the same way. It just felt comfortable โ for us and the dog!
How might this relate to ITSM?
This all seemed to me just a lovely example of how, whatever you think you might want and whatever you think you are delivering, the factors that make the service well received might be things you hadnโt thought about. Or they may be things you canโt control. Triggered a few questions that I realised have wider application.
Would we have loved the hotel if the weather hadnโt been good (dry all 3 days โ in Scotland!)? To make real sense of things like customer satisfaction then we have to measure and cross-refer to the uncontrolled external influences because they might actually have more impact on customer perception than the service itself.
For a hotel, if they measure (by asking) overall customer happiness with their stay, what factors might be useful โ some that come quickly to mind might be:
- Weather โ bearing in mind that some might want sunshine, and some might want snow
- Traffic conditions, less likely to like place if you arrive in a bad temper
- Who else is staying in the hotel โ loud, friendly, young old โ all might affect a guestโs comfort level
Well, we could go on; but we arenโt really concerned about hotels of course.
We all suffer, or benefit, from external factors
What are the equivalent factors for those using the services that you provide? Do you publish it along with your performance figures?
Certainly those things that you canโt control but which your customers might hold you to be responsible for are important to capture for your own ongoing management decisions and policies. Things like network provider performance. Can you map satisfaction with an IT service against network issues? Probably, but other factors like the pressure being placed on your customers by things like workload, missing performance targets, global recessions etc are bound to have a knock-on effect on how content they are with your service provision. So they are certainly useful things to capture and to know. Of course, they arenโt necessarily that easy to measure, but then who said the best things are easy?
This isnโt an escape clause, not an external factor you can quote to escape from blame. Quite the opposite in a way, they are the kinds of factor you should be aware of and use to drive efforts for more directed customer and user support at times when you know you are going to have more unhappy customers than usual.
Just because you canโt control things, doesnโt mean you shouldnโt notice them.
After all, what would you think of a local governmentโs roads division who, charged with keeping the roads usable in the winter, didnโt keep records of how much it had snowed to judge their costs and customer comment profile against? And recall how government figures โ on things like unemployment and financial growth โ always seem to be โseasonally adjustedโ. That sounds like taking external factors and building them in even before you publish. But then again, for your performances might that feel a little like cheating?
PS โ The phrase โBless the Weatherโ is, for me, associated with the late, great John Martynโs song www.youtube.com/watch?v=hqVDXsFWL18. A wonderful evocation of how we are, in turn, both blessed and cursed by factors beyond our control.