Kurt's Blog

January 16, 2017

Motivation

Filed under: Uncategorized — Kurt Häusler @ 1:45 pm

So everyone knows that for knowledge work, money and other extrinsic motivators don’t work right? And people are instead motivated by intrinsic motivators like autonomy, mastery and purpose.

Well that is what a lot of you think but it is actually missing much of the story. When people like Dan Pink talk about it, they actually mention something intuitive at the beginning that listeners forget because the focus is on the interesting non-intuitive bit. Before the intrinsic factors actually have a motivational effect people have to be paid enough to “keep the issue of money off the table”. No one tries to hide this, but I don’t know if people focus on it enough. I guess most motivational theorists and speakers must come from countries like the USA where a significant number of knowledge workers are earning over this thresh-hold. I am not sure if it is so relevant elsewhere. I decided to look at average salaries for different types of knowledge worker to see if I could notice any patterns.

Lets have a look at some numbers from glassdoor.com. I was always redirected to the German version based on my location and couldn’t switch to the English version without signing up and filling in all details. I also converted to Euro based on current rates. These are the average salaries for each job in each country:

Job

Germany

USA

Switzerland

Software Developer €49,845 €80,245 €101,386
Scrum Master €30-70k €55-90k €112-136k
Project Manager €60,540 €86,308 €111,945

A couple of other things to keep in mind:

  • Taxes in Germany are higher than they are in the USA and Switzerland.
  • I guess for Scrum Master in each country they did not have enough entries to provide a straight up average, but they did provide a sample of entries. Here I tried to represent the range without the outliers.
  • Costs may not be comparable between countries. I know Switzerland has higher living costs, but I don’t think overall they are twice as much. I think Germany and the USA might be more comparable.

Looking at these numbers I would make the bold claim that in Germany we don’t need to worry about intrinsic motivation too much. Only the very top end are going to be earning over the thresh-hold where intrinsic motivation plays much of a role at all. I would say in Germany, we need to concentrate on paying people more. In Switzerland it would seem to be the other way around. Here we can really see the power of intrinsic motivation. In the USA it could go either way, I would say most are indeed earning over the thresh-hold, but many not.

Now, I know the software development managers in Germany are saying “Impossible. We cannot pay our guys any more. The customer would not accept our offers. We would have to let people go”. Sure, I am very familiar with the software development market in Germany and where the money goes. I would say in most cases we have to live with developers who are demotivated and are constantly looking for a better paying job. There are a couple of things we should also be looking at in most cases:

  • Doing the wrong projects and optimizing for employee utilization. Knowledge work based projects should offer significant rather than scant returns. German managers will go to great lengths to make a sale and keep their employees busy for the tiniest of margins. They have a real phobia about saying no to low value endeavors especially when employees are sitting there without a project. What happens is they make that sale, because doing something is better than doing nothing, and when a high value opportunity comes along, everyone is too busy to take it up.
  • We also have a phobia about killing low value projects early. For some reason we don’t like quitting. We want to slog on through and get it done regardless. Most things are fine to start but they aren’t meant to succeed. The focus should be on proving early that something is a loser, and killing it. Freeing up people for better things.
  • We spend too much on non-value-adding management and organisational effort. Typically when introducing lean or agile methods we add new roles in addition to existing power structures. This is a big cause of waste in organizations. By replacing rather than supplementing management roles with agile roles we can free up a lot of money to reallocate to value-adding knowledge workers resulting in increased motivation and better financial results.

Anyway, to summarise, the almost blind belief in intrinsic motivation might be appropriate for some countries, but in many countries we have to listen a bit more closely to the bit the theorists and speakers don’t spend so much time on: You have to pay enough to keep the issue of money off the table. In Germany, we do not do that, so intrinsic motivation is of limited utility.

January 12, 2017

Do I support local businesses?

Filed under: Uncategorized — Kurt Häusler @ 12:40 pm

It seems like one of the trendy ideas is to support local businesses. I buy a lot of stuff from Amazon and have been mildly criticized for doing so. At the time I responded defensively but the reality is of course more nuanced. At a philosophical level I find “preferring to shop locally” to be very similar to nationalism or even racism. The idea that someone is more deserving of my business merely because they are from the same area, speak the same language, and look similar doesn’t sit right with me. In fact if I look at the world today I would claim the opposite. If I look at comparative standards of living across the world I would think the relatively poorer shop owner or service provider in South America, Africa, Eastern Europe or Southern Asia deserves my business more than the rich German over the road.

And of course as someone who actually lives in a country other than that in which he was born I am the foreigner. I wouldn’t like to think someone refuses to do business with me in favor of a “true local”. I also wouldn’t like to think people in other countries, especially in fellow EU countries, don’t want to do business with me simply because of where I am located.

So much for the theory. In a practical sense, I don’t like going to shops. I don’t like the over the top attempts to trick me into spending money with color choices, background music and even smells. I feel bombarded and almost overwhelmed with the pressure to consume. I dislike that I can never find the thing I want and am forced to make compromises and pay 3x the price for the privilege.

Having said that, I buy the following things locally:

  • Groceries
  • Shirt cleaning services
  • Fast food
  • Experiences rather than products, e.g. attending events
  • Very small cheap things that I need urgently
  • Things that might get broken easily in the post

Everything else I order online from wherever it is cheapest. This includes both products and services. I think in doing so I am performing a social service.

Where businesses choose to do their work is exactly the same. I always cringe when nationalists complain that a new factory is set up in another, usually disadvantaged country. It is good to support workers in poorer countries isn’t it? Or when racists complain about e.g. Indian workers “replacing” white workers in North America or Eastern Europeans “replacing” Western Europeans. It is how equilibriums work. Rich countries in general have a high demand and low supply of labor, whereas poorer countries have the opposite. That is why it is possible to save money by investing in people from these countries which makes prices lower for end-consumers.

To be more concrete, I have a lot in common with the average Slashdot reader, but one area in which I differ completely is in their anti-competitive stance against the foreign programmer. Especially the H1B Indian programmer. It always makes me cringe to see very well paid people up in arms because people from a foreign country are just trying to lift themselves out of a subsistence economy into a modern knowledge based economy, and help fill the capacity shortage we have in IT.

The other example that comes to mind are those in the UK, who never voted Brexit, but were always harping on about “buying UK”. They are complaining now, but why were they never chanting “buy EU”?

Everyone (well not me) claims to be a trendy leftist, socialist these days. I thought part of that was “international worker solidarity” or something, but as soon as it comes to foreign workers they ignore that completely and revert to a nationalist, protectionist stance: “them foreigners are stealin mah jerb!”

Of course I am biased, as someone who had the opportunity to live and work in another country it makes sense. What I really don’t understand is how people in a similar position to me can have such nationalist positions and criticize the very labor mobility that enabled them to live overseas in the first place.

I am proud to be a globalist rather than a nationalist.

November 16, 2016

Learning the Mainframe

Filed under: Uncategorized — Kurt Häusler @ 4:49 am

In my job as IT consultant for the banking industry I sometimes have to do some work on an IBM Mainframe, which means the z/OS operating system, formerly known as OS/360, MVS, and OS/390. Yes there are other companies selling mainframes but most of them are “IBM compatible” and there are other mainframe operating systems including Linux but z/OS is the main one.

image

But how are you supposed to learn how it works? Most people don’t have access to one at work, and even if you do you probably shouldn’t use a client’s expensive mainframe time to play around.

The way I learned was to first pick up some theory from this excellent book, freely available in a variety of formats: Introduction to the New Mainframe: z/OS Basics

image

Just from skimming through the interesting chapters you can turn up to work and not be completely lost when performing your mainframe tasks.

So with a book, and limited access to a real machine you can get started. But what if you don’t have access to a mainframe? Can you download and install z/OS on a VM? Sort of. There is an emulator available called Hercules. But it isn’t that easy to get going. You still have to hunt down the operating system on your own in most cases, and install it yourself which is a bit much for a beginner. The latest freely available operating system version is I believe a version of MVS from the 70s. Don’t worry it is not actually that different to the latest version. The best way to run it at home as a beginner with minimum hassle is to find The MVS Turnkey System. I did this and was able to play around a bit with the help of the previously mentioned book but it is not the best way.

image

IBM has a contest for students called Master the Mainframe. They give you access to an internal z13 and provide you a tutorial. Students get their work marked and can maybe win a prize or something. If you are not a student however you can still take part, but your work will not get marked and there will not be any prizes.

If you register here anyone can get an account on the mainframe and complete the tutorial style challenges. It takes a couple of days though. When registered you can find the tutorial challenges here: http://mtm2016.mybluemix.net/index.html

Click on Connectivity Guide to get started on the first steps.

image

I was able to get about halfway through Part Two in one weekend, to give you an idea of how much work is involved. It does get more challenging though so I expect Part Three to take a bit longer.

Once you do it, you can rightfully claim z/OS experience on your C.V. which might increase your worth if you are already involved in IT, consulting or banking. There is a shortage of talent as the older guys retire so there should be good opportunities for people with basic skills to move in and replace them. Even if you don’t want to specialize in the mainframe you will be surprised how often basic skills are required on banking projects even in management roles.

Here are some additional points related to the mainframe:

  • Some people say you can’t do Agile on the mainframe. This is completely false. There are no technical issues to doing Agile on the mainframe. You can unit test COBOL. You can refactor it. You can run automated tests. You can do DevOps and deploy several times per day. The barriers to Agile are usually cultural and bureaucratic rather than technical.
  • Mainframe teams don’t need Agile for the same reasons. Getting new products on the market quickly is less of a priority. However Agile is critical to manage other risks: Old legacy code with technical debt and knowledge gaps as people leave without training replacements properly.
  • The mainframe guys were using NoSQL not just before NoSQL was invented but before SQL was invented. In fact trendy modern ideas like event sourcing look a lot like how mainframes have been storing transactions in systems of record in “NoSQL” DBs like IMS since the 70s.
  • The mainframe is and always will be great for batch operations and transaction processing and anything requiring very high levels of reliability. IBM seem to be moving away from z/OS and towards Linux for the new economy, supporting mobile applications and hosting web services etc. They also have a vision of replacing the scaled-out data center approach of lots of cheap x86 servers running VMs, with single mainframes running thousands of Linux VMs. I don’t know about this. I think you end up paying for levels of reliability that are not required. For me the future of the mainframe will always be a niche oriented around z/OS and not an ideal way to host e.g. Java web services on Linux VMs.
  • After you finish reading the previously mentioned book. There are whole series of books covering mainframe topics in depth: ABCs of IBM z/OS System Programming. Here is a link to Volume 1.

December 27, 2015

My Weight Loss Tips

Filed under: Uncategorized — Kurt Häusler @ 10:27 am

For a long time I was slightly overweight, but I think I have it under control right now. My problem is staying at the right weight range is only worth a moderate amount of effort for me, so exercise doesn’t work, and neither does eating right if it requires putting extra effort (and expense) into shopping, cooking and cleaning up. Trying to exercise going to much effort did not result in weight loss, and simply created a new problem. The exercise and eating right made me enjoy life a lot less than simply being slightly overweight. Anyway, the following eating pattern worked for me. Not just in getting my weight back on target, but also improving my mood and energy levels throughout the day.

Breakfast

Staying at a hotel made this easy: A large low-carb breakfast of bacon, eggs, tomatoes, mushrooms, yogurt and fruit salad, as well as a liter or so of multi-vitamin juice. I know there is a lot of sugar in the juice, but I think that is ok if I don’t grab any other carb-heavy crap. I eat until I am full. It gives me a great start to the day. I usually wait until I get to the office before having coffee or green tea.

Lunch

The work cantina made this easy too. Sometimes going to other restaurants made it hard though. Here I mix things up, and generally let my body tell me what I should eat which is simply what I feel like. Sometimes fish, sometimes some other meat dish, perhaps with vegetables and sometimes salad. Because I had such a heavy breakfast I don’t have a huge appetite at lunchtime, so it is easy to stick to the meat and vegetables and avoid carbs. Here I sometimes take the standard side of carbs if I feel like it but usually only eat a third to a half of it. Most of the time I take no carb-heavy side dish. If I take a salad I usually add tuna, and even though the dressings are unhealthy, I add them to make it nice and don’t stress about it too much. At restaurants it can be difficult, but I try to follow this pattern as much as possible.

Dinner

No dinners. Or very seldom I might have something small for social reasons. This helped me sleep much better too.

Other tips

  • No deserts.
  • No cooking at home. If cooking is your hobby then cooking at home could be a great option. For me it takes too much mental energy to research healthy recipes, find ingredients, make sure I have the right equipment, cook it with my minimal cooking skills, and clean up afterwards. It is also expensive and wasteful to buy ingredients for one dish, and then have to throw out 90% of it when it expires anyway. The kids hate home cooked food anyway and refuse to eat it. So cooking at home is a big no-no for me. I think I could only make it work if it became one of my major hobbies, but I am not interested in this at this stage.
  • No snacking.

February 10, 2014

#NoEstimates Interview with Fabian Schiller

Filed under: Uncategorized — Tags: — Kurt Häusler @ 11:30 am

#NoEstimates – an Interview


I met up with Fabian Schiller (Twitter, Blog) recently at the Agile Rhein-Main User Group in Wiesbaden, we started having a brief chat about #NoEstimates, and decided to continue our discussion via email so it could be blogged later. All numbers are fake yet realistic. Fabian also blogged the interview on his blog.


Fabian:  “Hi Kurt, you tell me that it is a good thing to stop estimating? I’m sorry, but I cannot imagine how that could work out. How will I be able to calculate the costs for an upcoming project? As a business person, I must – at least – have a rough estimate, how expensive my project will be to know if it will pay off. How can you do this without estimation?”


Kurt: “Yes I think in general it is a good thing to stop estimating, there will always be situations where it makes sense, and of course it also depends on what we mean by estimating. For calculating costs estimation is especially bad. In fact the agile community had never even discussed estimation for this purpose. Estimation was generally safe as a tool for teams to use in planning how much work to take on each iteration and for providing rough forecasts about which features might be available in which release. For calculating costs there are a variety of approaches. Asking a team to sit down and guess how many developer hours each feature will require to type in and adding this up and multiplying these hours by various hourly rates is the poorest approach I have seen whether we are preparing an estimate for a T&M project or determining an actual price for a fixed price project.


My first comment would be that pricing an entire project at once is un-agile. It is at best hybrid, but that might be ok. Exactly how I would price the project depends on a lot of factors. How well does the customer understand about what he wants? Has the team done something similar before? Does the customer have a budget? How flexible is the customer and is he open to working in new ways or does he have certain constraints?


One simple approach (that might work in some cases but not others) would be to identify the most important feature than can be developed in one sprint. We know our team costs for a sprint so we can base the price for this “Version 0.1” or “Minimal Viable Product” on our costs. Then the customers question might be “how do I know in advance how many sprints I will need?” Then it gets interesting. I would perhaps then ask him something like “what are the minimal features we need to go live and start earning money?”. Perhaps something like the Incremental Funding Method could be an option.”


Fabian: “OK. That explains a lot. I see many valuable approaches in what you say. The idea of delivering MVPs and approaching a project in small steps is nice. But as a customer I do not want to risk building one increment after another to determine that my money will not suffice to get the minimal marketable product ready when the money is already spent. So, I essentially want to know if there is a realistic chance to get my product built within my budget. How might that work with an MVP approach? Or am I and my project just not eligible for working agile? Is that what you are saying?”


Kurt: “The assumption I made, was that there was at least enough money available for a minimal viable product (One thing we like to offer customer’s is a special price for an MVP that can be completed in 1 sprint), and some extra available for further work in case it is not ready to go live (if the software development is only part of the product for example, we probably can’t go live until the rest of the product is ready anyway). It sounds like you already have a fairly detailed understanding about exactly what it is you want as well as a budget. In other words, fixed scope, with a fixed upper bound on budget. This is probably the easiest case. Without needing to get too detailed, we can compare our delivery rate of features with our pricing and see whether the budget easily covers it or not. We can probably do this with an MVP approach but it sounds like the difficult part is already done. You already know exactly what you want. (MVPs are usually used when the customer doesn’t know exactly what he wants, and wants to first test the market with an MVP and use the feedback to drive the vision of the product) In this case we can simply build it, one feature after another, and provide regular feedback about how much of the budget we will be using. This is a fairly typical approach, and definitely qualifies as agile software development. Radical people like me would consider it a hybrid situation, as the financial decisions and requirements gathering has already taken place for the whole project, and only the development itself will be carried out iteratively. So the whole “project” doesn’t sound agile, but the software development phase can certainly be carried out according to agile software development.”


Fabian: “OK, I think I got that. You would just take all my stories, divide them by your average

sprint capacity and then – since you have a fixed size team – know how the costs would be. Correct?

But how do you know, that the stories, I will deliver are about the same size as the stories, you worked on in the past? If you simply take the number of stories, size should matter. Doesn’t it?”


Kurt: “That is roughly right, yes. However I won’t pretend to be able to “know the costs”. The first step is to see if we are anywhere in the same ballpark. I would take your stories, and split them, which is a fairly mechanical process looking for certain keywords, steps in a workflow, or variations etc, and count those. The numbers I base my costs on are actually based on a larger group of 20 people that is usually split into 2-4 teams and works on 2-4 different things at once. So not quite sprint capacity, but close. I know over the last 12 months this group has cost roughly 130,000 Euro per month on average, and has delivered over the last 12 months roughly 180 items per month. So that means my costs are roughly 730 per item. We only need a small margin say 5% as everything else, like rent, hardware, training, maternity leave etc is already included in the 130,000 costs. That brings it up to about 760, which I would round up to 800 to provide a nice round number and cover the risk on my size if I have to commit to a price up front, say if you will only accept a fixed price offer. Oh and you don’t really need a fixed size team, you just need to know how much the typical team changes over a year affect costs. It is definitly better to have a fairly stable team though.


So we can take that 800 and multiply it by the number of stories, you have and compare it to your budget. I would recommend proceeding only if the price is significantly lower than the budget. If it is more, or comes close then the project might not be such a business success. Even if the expected price is slightly lower than the budget, I would still suggest looking for a better project, knowledge work should result in significant rather than scant returns.”


I fully expect that in any backlog the stories will vary in size. This size is not as important as many people think, once you consider the whole value stream, rather just just the development itself. I expect that the distribution of the true lead times of items I attempt in the next 12 months, and my throughput will be similar to the distribution of sizes of items I delivered and my throughput over the last 12 months. Plus every new project gives me new statistics that I can use to base the next months prices on (and one month of year old statistics drops out of the moving average). If your project turns out to result in longer lead times or a drop in throughput (whether that has anything to do with item size or some other factor), then my cost per item will go up slightly, and I will raise the prices for the next project. Possibly however another customer’s project has factors (maybe item size, maybe something else) that result in shorter lead times and an increase in throughput and they will cancel each other out.”


Fabian: “OK, I see, there is a lot more thoughts in #NoEstimates than just denying to estimate 😉

Your explanations sound reasonable. But they open up two further questions for me:


1.) If your first step is to break down stories at the beginning of a project to relatively small ones – will you not be very detailed before starting to implement? This sounds kind of like a classical project specification for me…


2.) Using your mechanics, you would implicitly reward customers, that formulate larger and larger stories over time which sounds not good for neither your understanding of the project nor the next customer, who will have to pay that bill? After all, the distribution of story sizes is not a random variable, but highly determined by your customer!”


Kurt: “With regards to question 1, my preferred approach is in fact NOT to break down all stories in a project to relatively small ones. My preferred approach is to simply pick the single most important feature, break that down if necessary, deliver it, and repeat. Even if we might know what the next most valuable features are I would ignore them for now and concentrate on the single most valuable feature. This is not too radical for agile software development or lean startup. This particular case is a bit different for these reasons: you already know exactly what you want, and have already completed the initial phases of the project in a waterfall manner, at least the requirements gathering seems to be complete. The other reason why we do this initial quick splitting is because you wanted a forecast upfront about how the expected costs of the whole project might compare with your budget. This is definitely a hybrid project but that is ok, most are.


You are right that a customer who is paying per feature might try and make them bigger to get more for his money, that is why we always split before committing together to beginning development of an item. But it could still be the case, that even after splitting one customer’s project’s items turn out to have shorter lead times or less impact on system throughput than another customer’s items. This doesn’t necessarily mean one customer is being rewarded over another. It means that customers are paying for the value they get rather than the effort we put in. Why should a customer pay more for a feature just because we have to do a bit more research than usual? Such extra investments don’t just benefit him but help the team in general, so this method spreads the costs. Why should a customer pay more for a feature just because an employee has gone on maternity leave and we had to hire another. Costs will go up, throughput will go down. This will change our cost per item, but no specific customer should be rewarded or penalised for this.”


Fabian: “I think, I understand: Either I know exactly what I want to have (and am willing to invest heavily in analysis), then you would just break down stories to relatively small ones. Otherwise, you would suggest to proceed incrementally via MVPs (where you break down stories for the next increment only).


The activities in both cases seem relatively similar to what I would do when I would estimate a project (or a part of a project):

* Specify what will be delivered with the next milestone

* Break it down (to a certain degree), to see what has to be done

* Assign every item some specific effort

You just leave out the last item, which is putting a number on it, ain’t you?


The amount of work for assigning efforts seems relatively low for me, if you already broke down the work. This brings me to my next question: What are the concrete advantages of not estimating? What problems are solved by not estimating?”


Kurt: “The first bit is roughly right, although I don’t think anyone should ever need to invest heavily in analysis. If you know what you want in advance then the analysis has been done. If you don’t then we can start to think in a lean startup way, and conduct experiments to test our market assumptions and generate new knowledge. I guess initial story splitting is a kind of analysis, but it is more like a simple mechanical process, looking for keywords etc.


And of course as usual, both extremes are rare, more typical is something in the middle, where the customer knows something about what he wants, but not all the details.


I like your list of three points. I would leave out the third point, but I would replace it with something like “assign a risk category”, or “assign a class of service” or “calculate the cost of delay”. Actually these things don’t need to be, and shouldn’t be, done all at once in the beginning. That is waterfall, or hybrid not agile. I think it is better to do such things as late as possible, just before the actual development.


You are right that the problem with estimates is not just that it takes time. It is unprofessional. It is like fortune-telling. It is simply guessing, and in several decades of software development we have learned that it doesn’t work. The numbers that is produces cannot be reliably used for anything, except perhaps sprint and release planning. Now we are starting to understand why it doesn’t work. You cannot reliably predict the effort involved in completing work in the complex or chaotic domain. Even if you could predict it, this number will not have any meaningful relationship to anything important. Now the agile community has talked a bit about estimating, and done a reasonable job with it so that it is useful in certain circumstances, done in a certain way. Using relative units like story points has helped scrum teams perform sprint and release planning, particularly when the variability of PBIs is not well understood. It is important that everyone understands the limitation of this approach. That these estimates are not to be understood by a customer to be a promise, they are not applicable when considering the wider value stream, they should not be used to base prices on etc.


No one in the agile community ever said that effort estimates are the correct approach to use for calculating costs in an offer or invoice. No one ever said that effort estimates be used to determine project delivery dates. Doing this has resulted in losing huge amounts of trust and money (either the customer’s or supplier’s).


So there are several problems solved by not estimating: Project failure in general, mistrust and disappointed customers, teams that feel disappointed when the actual lead time and delivery rate doesn’t match their guesses, and huge loss of money.


Imagine these slight exaggerated scenarios. Imagine a Scrum team developing software according to a backlog, and they need to know what they might achieve in a week. In this case the units of work (PBIs) are relatively large and few in number compared to the container (the sprint). It is like packing large stones in a small jar. If the stones have a variety of sizes then guessing at their rough relative sizes can help determine if we can pack in 5, 10, 15 or 20 stones in the jar. This is all the agile community has ever used estimation for, and in this specific context, it solves a specific problem.


If we consider the whole value stream, not just the development, and look at the departmental or business unit level, or even if we consider whole projects rather than individual sprints, then we aren’t packing large stones into small jars. The size of the units of work is relatively smaller compared to the container. It is more like filling larger jars with grains of sand. Not only filling the jars, but collecting them from the beach, cleaning the jars, filling them, packing them into a box and taking them to a post office. In this scenario would you bother trying to estimate the size of each grain of sand? No. You would use concrete measurements of how many boxes could be delivered to the post office over the last lear, and use that information to base future business decisions on.”


Fabian: “Thanks Kurt! I think we covered many topics. And cleared up several misunderstandings about #NoEstimates. I really appreciated this dialog as I learned a lot!”


January 6, 2014

2013 in review

Filed under: Uncategorized — Kurt Häusler @ 9:23 am

The WordPress.com stats helper monkeys prepared a 2013 annual report for this blog.

Here’s an excerpt:

A San Francisco cable car holds 60 people. This blog was viewed about 3,600 times in 2013. If it were a cable car, it would take about 60 trips to carry that many people.

Click here to see the complete report.

May 20, 2013

Pricing, and a little bit about estimation.

Filed under: agile, kanban, lean, scrum, Uncategorized — Tags: , , , , , , — Kurt Häusler @ 12:54 pm

So I keep getting involved in discussions on twitter related to the different ways of basing prices for software projects, and it is hard to get some of the subtle details across in 140 character snippets so I thought it might be a good idea to put some ideas together in the longer form of a blog post. The whole thing is somewhat related to the #NoEstimates debate.

I also believe the base of my ideas is fairly mainstream. Most of the agile community (dominated by the Scrum community) talks about estimation in terms of estimating PBIs so you can plan how many to take on in each sprint. A few people still do it in ideal person days like Mike Cohn recommended back in the dark ages, which I am opposed to (but not to the point of getting into arguments about it) as I think there are some serious downsides to that approach. That is not a radical opinion, and it is the reason why most people use more abstract, relative units of size like story points, which I personally don’t advocate, but I don’t oppose either. Even most of the defenders of story point estimation for sprint planning recognise that the true advantage is in getting the team to talk about what needs to be done, and the actual estimate is a secondary benefit. A few of the more advanced teams, and even the inventor of story points Ron Jeffries himself, prefer to simply use a count of PBIs. This is the approach I find most sensible, when combined with backlog grooming and story splitting. Also after using Kanban for several years I have realised that estimating is pretty much wasteful. I don’t think that is a radical opinion either as it seems shared by much of the Kanban community, who make use of a metric called throughput which is essentially the same as velocity and is typically presented as a number of items done per unit of time.

But as long as all we are talking about is how many items to plan for each sprint, who cares? The consequences of over or underestimating are minimal. If we plan too few ask the PO for more, and the velocity goes up to plan more for the next sprint. If we over plan then we drop the velocity and plan less for the next sprint. As long as this is all we are using estimates for then who cares how we do it.

For me estimates are only really a problem when they are taken more seriously than intended. For example when calculating prices, or when forming an offer or contract that a customer may rightfully interpret to be a commitment to deliver, and expect to be based on something more solid than a guess. Sadly the agile community talks so much about estimation in conjunction with sprint planning, and very little about contracts and pricing. I have even heard people say that the way that contracts and prices are done is completely orthogonal to how the software “project” is carried out. I disagree completely. From my experience the way the contract is written and the way the work is priced are the fundamental factors that indicate to what degree any software development endeavour will be “agile” or not. Or should I say to what degree it is even appropriate for knowledge work and product development, or anything in the complex domain for that matter.

If some manager comes to the team and says “these requirements have to be done by the end of July, and we have a budget of 20 architect “person-days” and 60 developer person-days and 30 tester person days and 10 manager person days, now use Scrum to make it a reference agile project”, then your options are pretty limited.

I think the disagreements in the NoEstimates debate are based on a misunderstanding. The ProEstimates crowd are saying “What is wrong with estimates? It is just a simple tool to help teams plan how much work to take on each sprint”. The NoEstimates crowd are saying “if you are making promises to customers, and trying to price your work, there are much more professional ways to do it than guessing”. The ProEstimates crowd just don’t see things like offers, contracts and pricing to be relevant. Heck the Scrum Guide doesn’t even mention them. All that businessy stuff happens way upstream anyway so we just have to accept whatever deal management outside the Scrum team has made, and as long as we carry out the work according to Scrum we are all agile right?

I agree with both sides, which is possible because they are talking about completely different things. I just find the ProEstimate argument to be boring, obvious, non-controversial and not addressing any particular problem. The NoEstimate argument on the other hand is advocating one of the critical next steps that the software development community needs to take in order to restore a culture suitable for software development and good faith with our customers.

The other misunderstanding I see in the NoEstimates debate is that the ProEstimates crowd thinks the NoEstimates advocates are somehow refusing to answer questions like “How much does it cost?” and “How long will it take?”. This is quite false. As far as I am aware the NoEstimates crowd are attempting to answer exactly these questions using techniques with a higher level of professionalism and more reliability than guessing.

Anyway the opinions I have on pricing are based on experience, and they are also more relevant to some contexts than others. I believe this blog post is highly relevant to the following types of software development, which is where I have most experience:

  • Companies doing custom software development work for other companies.
  • Product companies where the customers pay for the features they want and even the bugs they want fixed.

I suspect this blog post might be less relevant for the following types of software development:

  • Internal IT. I have little experience in this area, and even less in how it is priced and funded, but I suspect things are a lot simpler than when dealing with an external customer
  • Product companies where the product is funded in another way separate to the development of features. E.g. via a subscription model, or advertising, or purchases of new versions. I do have a bit of experience in this area, and things are a lot simpler.

I think a lot of people on the ProEstimates side of the fence are engaged in the latter areas and simply don’t see the issues that the NoEstimates guys are having to deal with.

There is also a grey area in-between, such as where are large company has outsourced its IT and while the company doing the software development is technically doing custom development for a customer things are also much simpler as there is only one customer. In effect it is basically the same as internal IT.

So what is the problem?

I have worked for a number of companies in the former category that used similar methods for pricing software and suffered similar disadvantages because of it. Generally these companies rely on a horrendous mix of time tracking, rate cards, up front estimation in person-days, time & materials billing, bookable time and “slack” divided up according to percentages, and the need to explain to customers why the actual amount billed differed slightly from its up-front estimate. For me this is the worst. And so many of these customers are using agile approaches like Scrum to develop the software too. You would think they would be aware of the dangers of things like time tracking. The community (with the exception of Scott Ambler) seem to be unanimously against it. But unfortunately those with an understanding of knowledge work and product development are not those making the deals. They are usually a very different type of person unlikely to read books like Don Reinersten’s Flow, or engage in the subtleties of the economics of software development at conferences or online. They are more like the software equivalent of the used car salesman. 

So here is how it works: the customer has an idea of what they want. Sometimes this is just a vision (which is good), sometimes it is a more detailed list of requirements (which is ok, but a little bit wasteful as it is highly likely to change). The salesman will then take some of the team capacity and if the customer only had a vision those team members will then have to come up with some business and technical concept and estimate how many person-hours of each role is required to develop each bit of the solution. If the customer presented a more detailed list of requirements then they can skip the business concept, and just come up with the technical concept and an estimate. The salesman has to choose carefully how many and which team members get to be a part of the conception and estimation activity. You don’t want the whole team as this is all non-bookable time, which is perceived by such cultures as expensive, so usually the salesman picks the architect, the analyst and the best senior developer, or something like that.

This approach is already non-agile, or worse than that, it is fundamentally against the realities of knowledge work and product development, regardless of “agile”:

  • The idea of having a complete set of requirements at the beginning is long known to be unrealistic, the the downsides to this way of thinking are well known. Many of the requirements will, according to the Pareto Principle, be superfluous in the sense that their effort in being developed will be out of proportion to their use in the finished product. It is also a myth that anyone can know in advance what is required, This always changes. The customer never gets exactly what they want, and even before they see the first version they change their mind about what they think they require.
  • It is actually preferred, and more realistic to start with a mere vision. This allows the true scope to be discovered, adjust and grow as the development endeavour proceeds, and starts off with the knowledge that scope is and should be negotiable. The idea of having a complete set of requirements works against this. For the actual software company to start with something good (a vision) and discard all the advantages by turning that into a detailed list of requirements up front is bizarre and ridiculous. The chances of it being what is actually best for the customer are even less than if the customer themselves came up with a list.
  • It is also pretty disadvantageous to select a sub-set of the team to create the conceptions and estimates. This requires crossing the problem-solution line, and breaks one of the rules of estimation that it has to be done by the whole team. In software development, the team should be problem solvers. They should get an idea of something small that the customer desires, and work with the customer in solving the problem, implementing the solution as software and realising it as true customer value. With the used-car-salesman approach, the small sub-team of elites are trusted with the task of solving the problem, and determining the solution up-front, and the actual development team are reduced to mere source code typists, which is highly demotivating.
  • Additionally the estimates are usually much more optimistic than if they had been given by the team, and those in the sub-team are not available to the development team for assisting with the actual development of actual software.
  • It is also a waste of time, all these discussion that take place during conception and estimation still need to be held again so the actual whole team can understand them. (At least this second discussion might be bookable to the customer).
  • If you are using something like Scrum, combined with estimation in story points which is fairly typical, you have to go through and estimate everything again anyway.
  • Also these estimates are usually “ideal”. They only reflect the actual minimal time an expert might spend on typing in the solution once and that is all. Anything like research, or learning, or pair programming, or communicating with each other, or improving the system, or tests, or refactoring is extra. That is why project managers add a buffer to to the estimates or the price that the customer sees, so they have some wiggle room later, but the actual team still sees the tighter estimates. After all if you let them see the actual buffered values they will simply chew the buffer up with non-value-adding activities like refactoring or writing tests, and there won’t be any buffer left at the end to make up for the shortfall which for some reason always occurs at the end.

So what happens next? The developers start counting hours present in the workplace and recording them in some electronic system. This is called time-tracking, and suffers the following problems:

  • Some people say the main or only problem is the time that time-tracking takes. This might be the most obvious issue but it is the least of it. Sure it can chew up around 15 minutes per day, but time tracking is much more evil than that.
  • The developers have a budget per feature, and there is a general hectic vibe with everyone primarily concerned with which booking position every minute of the day belongs to. No one want’s to be the guy that has less bookable hours than anyone else. In fact everyone tries to keep their bookable hours as close to 100 percent as possible, as the general perception is that any hour not booked is wasted. Typically project managers and even product owners insist that anything like knowledge transfer, or writing tests, or refactoring or even one person in a programming pair shouldn’t be at the customer’s cost, and has to be booked to an internal booking position. As a result, these activities simply do not get done, or at least no one wants to spend much time on them.
  • The teams more expensive roles end up siting there idle. Since the project manager was involved in the technical conception and estimation, and was concerned with presenting as low a cost as possible to the customer, he preferred to see more (cheaper) junior developer hours being offered as more expensive architect or senior developer hours. As a result, even when the team is struggling to meet its sprint goals, the architects sit there doing nothing because if he did the work the customer would get a more expensive bill than if the junior developer did it. The customer would then come back and demand to know why he was charged architect costs for something that could have been done by a junior developer. As a result project managers insist on architects NOT helping the team to meet their sprint goals, which damages the feeling of trust in the team.
  • A related issue is when cheaper developers get assigned the tasks where there is a high risk of requiring more time than that estimated. I have seen a team suffer a huge drop in motivation when a student, with a cheap per hour rate, was given all the most interesting tasks (that were sold to the customer as junior or senior developer hours), because he essentially had more than twice as much time as estimated to do it, and you automatically have some extra buffer for the risky, more innovative and interesting parts of the “project”.

I hear a lot of managers claim that time & materials works well for them, and that estimates correspond very well with actual development hours. That is because developers are painfully aware of their budget, and compromise on quality in order not to “overspend” their time budget. Without fail these managers also wonder why they run into technical debt issues a year later. Actually they don’t wonder. They know it is down to poor commitment and discipline on the part of the developers. On the other side of that coin is that it discourages innovation, and encourages maximising expended effort. Assume a task was estimated at 5 days. If someone can find a clever way to do it in 2 days he probably should right? Well with T&M there is no incentive. If he does it in 2, then he might not have anything else to do for the week and his bookable hours will drop. Also the company will  get 3 days worth of money less. Usually project managers solve this by shuffling hours around and lying to the customer about what took how long. They will simply say it took 5 days, and use the extra 3 days to reduce something that took longer than expected.

Particularly sad are the companies that think they are cool and generous like google for allocating a 20% “slack” time that doesn’t have to be bookable. This implies that everyone is under extreme pressure to book the other 80% of their time. Guess what ends up being done in the 20%? Meetings, bug fixes that the product owner thinks should not be billed to the customer, writing tests, learning from other developers, pair programming and refactoring. It is much better NOT to have such a percentage goal of bookable hours. The team needs the freedom to decide for themselves how to best to allocate their time in order to deliver, and besides, the customer pays for everything anyway. It is not like the government pays for the 20% time. This trick might look good at first glance, but it is total bullshit that has no pros, and only cons.

There is one general issue that lies at the root cause of all the parts of this nasty approach to pricing software development efforts: The idea that it is appropriate to measure software in terms of person-hours. Once we get beyond that dangerous myth, we instantly solve a number of problems and we open things up to the next level of professionalism in managing software development.

So what is the alternative?

So let’s look at better models for pricing software in order from best to worst, according to my opinion:

  1. Value based pricing: The best way to price software is according to the value it brings the customer. We can negotiate with the customer and help him discover what sort of value the delivered software might bring, and come up with a price that correlates with the expected level of investment required to bring such a return. However I find this suffers from a couple of problems that might make this approach difficult:
    • Business value is hard to determine. Software development, when worthwhile, is a high risk endeavour, featuring an asymmetric payoff function similar to the development of medications. We can expect to start a large number of experiments with the hope that they will be highly successful, and expect that most of them will be canceled as soon as we discover that they are not going to be a big winner. The occasional big winner results in so much profit that it more than covers the losses associated with the “failed” experiments. (Actually, the information we learn from these experiments usually makes the investment worthwhile, so failure is probably mot the right word). The fact is, we often have to at least start the development process and test a feature or two on the market before we even know what its value might be. This is hard enough at the project level, and even harder at the “story” level that agile development prefers, so I suspect for this reason value based pricing to be very difficult in practice. One model that could work would be to measure actual value afterwards, but this requires a high level of trust, and exposes extra risks for all participants. It essentially makes the software development company a full stakeholder in the product, which may or may not make business sense.
    • The other issue is that customers may not be willing to share their expected value, even if they know it.  They want to get the lowest price possible, and not give the software vendor a hint as to the maximum they might pay. There are also a lot of things that can be done cheaply and easily, but result in huge wins for the customer. The vendor might think it is fair to take the usual percentage cut of the wins, but the customer most likely does not.
    • Even if we know the customer value, before we decide if we should do it or not we might like to know to what degree, if at all, it covers our costs. This means that even when using value based pricing, we might still have to use one of the following more cost-based methods to determine if we should do it or not.
  2. Price per feature (determined at time of commitment): My current favourite model is very simple and based on measuring the teams price per (average) groomed feature. It works especially well with a system where Kanban plays a role. You should have a rough idea of your costs. Ideally they are mostly a function of team salaries and fairly fixed, otherwise in more dynamic environments you can determine separate components, perhaps basing it partially on an average of previous months, and known costs for the next month. You simply divide these costs by the throughput and add an appropriate margin. Before the customer and team commit together to developing a feature, some backlog grooming should occur and the team should perform the usual steps of story splitting. Queue replenishment consists of presenting the split stories to the customer, together with the current price per feature. They can select as many stories as there are free places in the input queue. When working with multiple customers it is good to authorise the product owners to do this on behalf of the customer, or to establish some idea of how much team capacity is to be allocated to each customer (ideally in terms of total system WIP). This shouldn’t be too big a deal, the PO can communicate with the customer up until queue replenishment about what the price could be and how many free slots the customer will have. The price is fixed at the time of moving the item from the backlog to the input queue, and payment is due a number of days after the item is done. If you have a two stage commitment system, or end up cancelling more than a handful of items in the middle of the process and have multiple customers then it could get a little more complicated, but I might blog separately about that. I don’t currently see any disadvantages, but I know someone will have some questions about it so please challenge me in the comments, and allow me the opportunity to make this concept even more solid. I know a lot of people seem to think it will only work with items that are “roughly the same size”. This is not true, and in fact the concept of size is a bit bogus when considering the whole value stream. We groom and split in order to preserve some liquidity and flow in the process, to prevent large items from blocking the system, and to inhibit the lead time distribution from blowing out too far to the right. I fully expect significant differences in the measured lead times of different items, that is the reality of knowledge work and product development, but there is no real need why they all need different prices. If the customer has 3 features in the backlog, but only feels 2 are offer enough value to justify the price per feature, then he should only choose those 2.
  3. Renting team capacity for a period of time (in terms of system WIP, not in available person-hours): This might be an ok option for those doing a longer term software development effort, and wan’t to save the communication overheads of accepting a small offer every week or so. It is also based on a Kanban approach. Assuming costs (plus margin) of 100,000 per month, and a total system WIP limit of 100, then we could have one customer paying 30,000 per month for exclusive rights to 30 of that WIP, and so on. If the throughput is 100 items per month, we might expect he gets to see 30 items per month. Or he might not. We could provide both options and allow him to choose which is best for him.
  4. Fixed price per team-day or team-sprint (aka. T&M light): This is probably good for Scrum teams, or teams when you only have a single customer and don’t have too many issues with balancing capacity between different customers or classes of service. It is also based on costs plus margin. One discussion I got into recently on twitter was with a defender of T&M. It turns out they don’t do up-front estimates of entire projects, they don’t have rate cards, they don’t have a target number of billable hours and most importantly they don’t do time tracking. Basically for every day a team works, they get a bill for a team day with a discount for team members on holiday. To me this is a lot closer to a fixed price per team-day than the true T&M monster as typically practiced. However they reported it requires a large amount of trust, and only works when the team has a single customer (which some consider ideal, but I personally consider it a risk of the “all eggs in one basket” variety.) The team just developers iteration after iteration until either the product is good enough, or the customer decides they have spent enough money.
  5. Fixed price variable scope: This is the classic agile fixed price scenario where there is some budget set up in advance, and the team simply develops iteration after iteration until the money runs out. It is essentially equivalent to the fixed-price per sprint, except presumably the option to quit before the fixed budget runs out is excluded. I don’t know what is supposed to happen if the product is good enough before the budget runs out. I guess the team is supposed to keep developing unwanted features until the budget runs out. There is also the question of how is this budget determined. I guess the customer has some idea of what he wants to spend. I could also imagine it being based on a rough release plan, which is in turn based on an initial but negotiable backlog and a known velocity. I am not sure what advantages this model brings over the previously mentioned ones.
  6. Fixed price, fixed scope, but the price is obviously sufficient to cover costs and the scope is easily achievable by the due date: Sometimes we get lucky even with dysfunctional traditional methods. As long as we ask for more than enough money to cover things even if things go wrong, and we leave ourselves plenty of time to get things done, even with the inevitable changes in scope, then why not? It is still better than the full-on T&M model with all its disadvantages. But not much better.
  7. Fixed price, fixed scope, fixed due date, and the team thinks it will be tight: This might even be worse than full-on T&M. I don’t know which one is worse. They are both extremely damaging. Sadly they are the 2 most common approaches. In fact the typical Scrum-using but otherwise not very agile company thinks they are the only two options. They are convinced that one of them is not “agile” so the other one must be. Usually a company has a bad experience with number 7 so declares it un-agile, and then feels super smug and ultra-agile for using full-on T&M together with Scrum.

So there you have it. My current views on the various approaches to the pricing of software development. I have to mention again that my favourite is 2. I don’t really have a problem with any of 1-4. I don’t see much point in 5. 6, 7, and the full-on T&M I described at the beginning are the used-car salesman approaches. They are lazy, damaging, unprofessional and betray a poor understanding of how knowledge work and product development works. Instead of violating our customers and teams with such approaches we need to think about things a bit deeper, and consider the damage we are doing, and start behaving more like professionals. The relationship between the software development and the customer is too important to be left to sales-people. It requires product developers to be involved. It needs to be more like the way a doctor and their patient communicate, than the way we currently operate, as if it were possible to fix scope and sell person-hours like the kids at McDonalds sell fries.

I recently read a blog post from someone, it isn’t that great, it exhibits one of the misunderstandings about NoEstimates (he somehow thinks NoEstimates is all about refusing to answer the “how much” or the “how long” questions), but one quote was interesting:

If you don’t know where you are going, if you don’t have some notion of what done looks like, if you can’t tell me approximately how much and how long, please don’t start.

At first I thought, woah wait a minute, this pretty much excludes anything in the complex domain, aka anything worth while. Even beginner agilists know that software development is an experimental process, and it is quite typical to begin something before we know how much it will end up costing, or how long it will take. But on second thought I agree with him. There is no way to know what done looks like when we are talking about a large project, no way of knowing how much it should cost, and no way to know how long it will take. They can only ever be discovered once we have invested some effort in the information generation aka software development process. So I agree. We should not do large projects. However we do know what done looks like at the story level. We can say how much it will cost, and we can provide a certain degree of confidence about how long a story will take based on concrete measurements and backed up by statistics. So I agree. We should only ever do story sized things. Actually why not take his quote even more seriously and use it to base our definition of what we should attempt to develop? If we don’t know what done looks like, we can’t put a price on it, and we can’t say how long it will take then we shouldn’t start it. It is obvious what he means. We shouldn’t do anything larger than stories, we have to get away from projects being the main batch size of relevance to pricing, offers and customer communication in general.

So here are the main points again:

  • Don’t sell person-hours, it is not appropriate for things like software
  • Don’t pretend scope can be fixed in advanced
  • Don’t use time tracking
  • Don’t use T&M billing
  • Only estimate where and how it is appropriate, the whole team may use story points to plan how much work to take on per sprint, and that is pretty much the only place for estimation in software development.
  • Never estimate in hours, only relative units like points
  • Never base prices on estimates, use measurements instead
  • If you have customer contact, write offers, work out prices or negotiate contracts, please go to a couple of conferences, read a book or two, and engage with the community
  • Don’t think you are cool by gifting your employees 20% slack time (by insisting 80% of hours must be bookable), all you end up doing is pressuring the employees not to spend time doing what they should. And it really messes with the idea that a team should self-organise
  • If the offer and pricing is fundamentally not “agile” or at least makes no sense from a knowledge work and product development perspective, then planning the development using Scrum won’t help you much
  • Forget about “projects”. When it comes to prices and offers, we don’t want to deal with anything larger than a story

I have a feeling this might be a blog post I keep coming back to and refining. I already suspect I have left some interesting details out.

Any questions or comments? 

Addendum 1: Two additional models that I have been made aware of but forgot to include to this list are the “price per story point” model. I don’t prefer it, as it suffers from many of the same disadvantages that other approaches based on up-front estimation suffer, but if you are estimating in story points anyway, it might work for you. I would probably put it somewhere between 4 and 5 maybe. The other model is the incremental funding method. This is a really great one if you can get it to work. In this method we minimise initial investment and risk, and focus on developing a product that makes sufficient money to fund further development. This concept isn’t really an alternative pricing model as such, and can thus be combined with any of the above listed pricing models as an additional technique. You could even use it to filter out projects that should not be invested in past their initial MVP. Any projects that don’t self fund after a calculable investment in money or time should be cancelled, so that that investment can be channeled in more worthwhile activities. I believe Don Reinertsen’s book Flow even presents some useful numbers that can be used to help support such decisions in the section on asymmetric payoff functions.

February 5, 2013

My Reading Strategy

Filed under: Uncategorized — Tags: , — Kurt Häusler @ 2:02 pm

I enjoy reading but, I find it difficult to make time to read. There is usually some other thing I find to do instead. I have found that reading in bed in the evenings doesn’t really work. I just don’t take things in as I am falling asleep. About the only time I get to read is when I have to spend a bit of time travelling on a train or something.

Last year I choose my books based on the list of required reading for the PMI-ACP certification. It began slow (as I wasn’t spending as much time on trains), but in the last few months I was able to churn through the books, spending a couple of hours on a train each day.

I was planning on allowing Amazon’s recommendations help me decide but since I read so much on the topic last year, I am sick of the “agile-management” related genre of books, so I decided to concentrate on some more technical books.

The problem with technical books though, is that it makes a lot more sense to read them in front of the computer rather than on the train.

So I am making the radical decision of reading 2 books at once. One technical book for at home, and something else for the train.

But what topic though? Well there are a lot of topics that aren’t quite technical, they aren’t quite domain-related, and they aren’t about process. Things that my current employer might find useful for managers like me to know about: business intelligence, social media, innovation, competition, the market, cloud computing, data warehousing etc., but all from a business rather than technical perspective. Who knows, maybe I will find something interesting… I started reading a book on data warehousing but I am finding it pretty dry and they way the author keeps calling people “resources” is distracting.

Got any suggestions?

January 9, 2013

Retrospective 2012

Filed under: Uncategorized — Kurt Häusler @ 10:46 am

So this will just be a short note to let you know what happened last year and how I felt about it.

We started the year off in a new city and with a new job. I had already spent the previous 6 months doing something other than being a software developer, internal Kanban coaching and process improvement, but at the beginning of 2012 I became a consultant at a company claiming “The Agile Organization” as one of its areas of core competency. After a slow month settling in I was sent off as a part of a team to my first client, where my job was to help improve their Scrum process. The Scrum process was already pretty good though. I was able to make a couple of suggestions which were readily accepted, but there wasn’t a lot to do there full time for 4 days per week. I started to notice some other issues at the technical and management level, which were actually connected, but they were either hard for an external consultant to directly fix or outside my mandate.

I ended up feeling a bit bad about being there counting billable hours that I felt were out of proportion to the amount of value I was providing and convinced my boss I should probably finish up and leave the team to get on with it.

And that was basically it. Month after month I was sitting at home (turning up to the headquarters on Fridays) waiting for another customer, only collecting 70% of my salary.

Now this job had a variable salary. I was guaranteed 70% each month, but the other 30% were based on billable hours. At the beginning it was explained to me that it should be no problem working enough billable hours to make the full 100% and the idea behind the variable salary was that in previous years people had worked so much that they had no time to write articles and attend conferences etc., and that the variable salary means people can choose not to take on a client project and still get a reduced salary. It was not explained to me as a system for allowing the company to save money in case the projects dried up, while still keeping me hanging on so they can assign someone to work in short notice without having to recruit.

Now you have to understand that in Germany you get a generous unemployment insurance of 70% of your last salary anyway, so it became clear to me that variable salary is of no benefit to the employee, and only benefits the employer. Basically you are unemployed, receive the same amount of money as if you were unemployed, but you are not free to start work elsewhere, you have to wait out your notice period.

What I should have done was to set the base level at the 100% and enjoy anything I get from over that from billable hours as a pure bonus. Then it wouldn’t have been so bad.

As it turns out, after taxes I was getting roughly half as much as I was in the previous year and what I expected, and after things like rent and insurance came out I only had around 10% discretionary spending money than I had in the previous year and what I expected.

I had lots of free time though. Not much money but lots of free time.

But I don’t want you to think money was the main issue. I certainly reduced the number of conferences I attended in 2012 because of money, and also because I wanted to be free in case we got a client. The main issue was frustration with not doing anything.

I had developed a lot of interest and knowledge in exactly the area the company wanted to specialize in. I knew there was a lot of demand for expertise in these areas. I knew other consulting companies working in this area had more work than they had people to do it. The fact I was so extremely keen and reasonably well qualified to work in an area where there was so much demand, and it was an area my employer wanted to specialize it, it was just plain frustrating not to be able to work! I think they had problems developing a marketing strategy as there was a lot more meta-conversation about how to find customers than actual discussion about agile organizations and what it means to be one.

There was an attempt for me to write articles and presentations solving potential problems that future customers might have, but I don’t think that works so well in the agile world. I think so much is context dependent, and of course “complex” that any solutions can only come about when an actual problem exists and a mechanism to allow a solution to grow via feedback etc. I came up with a few bits and pieces but never got to try them out, so for me they remain unrefined, unvalidated, and essentially spoiled milk (which is an analogy for any work invested that expires before it gets a chance to realize value).

Anyway I made the decision before my 6 month trial period that I have to do something, so at the same time as waiting for a client via my current employer, I decided to open up a search into finding work through other channels. I noticed there was a lot of interested in me personally either as employee or freelancer, either as developer, coach or consultant, but little interest in having a team of consultants coming in selling a box with “The Agile Organization” written on it.

As it turned out the company and I had fairly different ideas about what the agile organization actually is. For me it was something larger than software development, and involved a significantly different management system and culture than what exists in the typical organization. I had imagined helping organizations realize the vision shared by people in the Rightshifting and Stoos communities. My employer was really focused on just helping companies with the way they develop software mainly by scaling Scrum, and helping with some of the issues that companies face with using agile approaches while still attempting large-scale projects with several interdependent teams without having to change too much at the cultural level, or affect the management system outside of the software development departments too much. Not that there is anything wrong with that. There is certainly demand for it, but it is something I find somewhat less interesting than enabling my vision for the future of the workplace: small teams of motivated individuals having fun delighting customers supported by leaders acting and thinking according to a synergistic or chaordic mindset, rather than merely developing software a bit faster while still being constrained by the same old analytic management culture.

But I was patient, and not under any real pressure. It would have been ideal if a client came, and I could have remained employed as a consultant, but other opportunities simply won the race, and I now have an interesting job at a company that mostly develop and maintain web sites for advertising and marketing, but not exclusively.

They have an interesting structure based on the Scrum team. They have a number of super-teams. Each headed by a Process Master (analog to a Scrum Master) and a Business Owner (analog to a Product Owner). Outside these super teams are minimal roles. Senior management, administration and office. All other functions are contained within the super-teams that enjoy a fairly high amount of autonomy. Within these super teams we have a number of roles like product owners and scrum masters, developers, engineers, information architects and the like. They are divided into cross functional project teamlets, some of which use Scrum some not. Many teams also use Kanban in various ways.

I applied for a Scrum Master job, and was offered a role as Process Master which is like a Scrum Master of Scrum Masters and has some extra management responsibilities that a Scrum Master would typically not have. I have also been working as the scrum master for one of the projects within my super-team.

So far so good. I am still getting used to many aspects of the role that are new to me.

I did attend a couple of conferences this year. Notably the Stoos Stampede, and Lean Kanban Netherlands where I also gave a talk for the first time.

After a bit of a rough start I am pretty happy with how 2012 ended and I am excited about how 2013 might look.

September 18, 2012

The Häusler Problem-Solution-Value Distance Model

Filed under: Uncategorized — Kurt Häusler @ 12:17 pm

I remember sketching out this simple idea a few months ago, and I have been thinking about it since then, so I decided I should blog about it. It is essentially a model for looking at the general process for identifying problems, investing work in solving them, and then applying that solution in order to realise some value. Visually it looks like this:

Psv

P is the point at which the “problem” is identified or specified. S is the point at which some work is invested in forming a solution to the problem. V is the point at which the solution can be utilised to realise some value.

The other important concept is the “distances” between P and S, and S and V, or indeed the total distance between P and V. Distance here might not just be spatial, it could also be temporal. It could even be more abstract like the distance between two people’s mindsets or value systems. Or it could be a vector quantity, with spatial, temporal and other components.

The central claims I intend to make with the model can be summarised by the following formulae:

  • distance PV ∝ waste
  • distance PV ∝ 1/quality
  • distance PV ∝ 1/motivation

That is, the longer this distance PV is, the more potential for waste, more potential for quality problems, and more potential for demotivation.

It should be interpreted from the S perspective. Some manager or knowledge worker hears some description of some problem. He or she invests some work in developing a solution for it, and hands it on to further on in the system, to be, somewhere, at some time, utilised in generating value. In the most ideal case, the distance would be 0. Point S occurs at exactly the same conceptual point as point P and point V. That is the knowledge work or manager is right there when the problem is first conceived, invests work in a solution at that same point, and the value is immediately realised.

This concept is already understood, and finds expression in many existing principles. For example the lean concepts of “going to the gemba”, and “those who do the work are best placed to solve it”. Also the agile concepts of close collaboration between customer and developer, and developing products with short feedback cycles.

Many models and theories of intrinsic motivation also claim people are more motivated when they can at least see, or better yet be involved in, that right hand part of the model, where the value is realised. This puts the solution in context and provides a sense of purpose to the expended effort.

It also has implications for every day decision making. Once understood, it is harder to claim that developing solutions in isolation, remote from the problem and point of value realisation, is merely a matter of taste, or a valid alternative way of working. It becomes a matter of professional ethics to continually try to reduce this distance PV. It also allows us to help decide in which problem solving activities might be better investments of effort. We should normally prefer to invest effort where the problem was more closely and recently identified, and thus better understood, and can also be realised as value sooner.

I also think there is a fractal aspect to the model. It is possible to zoom out and see this whole PSV chain as being part of an S point in some larger context. It seems possible to zoom in on an S point, and see it containing other smaller PSV chains. There could also be multiple S steps between a P and a V (where perhaps the act of realising one solution as value is the same as defining a problem for the next step).

I was recently discussing on twitter the situation of developers wasting effort on developing software that is not useful, and whether or not they have the power to be involved in deciding what should be developed. In terms of this model, I claimed it was more professional for knowledge workers to see themselves in that whole context, and understand the context that gives rise to the problem and how it should be realised as value, rather than merely solving problems. It certainly seems professional to continually strive to shorten this distance where possible.

Older Posts »

Blog at WordPress.com.

%d bloggers like this: