Saturday 10 August 2019

Fibonacci, The Delphic Method, RAND and a little bit of SCRUM

Looking through some old emails I discovered this little gem, shame on me though I had not marked the source: 

"Frequently there are great debates about the use of the Fibonacci sequence for estimating user stories. Estimation is at best a flawed tool but one that is necessary for planning work.

User story estimation is based on Department of Defense research in 1948 that developed the Delphi technique. The technique was classified until the 1960’s (there are dozens of papers on the topic at rand.org). Basically, the Rand researchers wanted to avoid the pressure towards group conformity that typically led to bad estimates. So they determined that estimates had to be done in secret. Initially, the estimates would be far apart because people had different perceptions of the problem so they would have them talk about highs and lows after estimating in secret, then estimate in secret again. At Rand Worldwide you can read the original papers that demonstrate convergence.

Rand researchers then studied the effect of the numbers estimators can choose and found a linear sequence gave worse estimates than an exponentially increasing set of numbers. There are some recent mathematical arguments for this for those interested. The question then--if you want the statistically provable best estimate--is what exponentially increasing series to use. The Fibonacci is almost, but not quite exponential and has the advantage that it is the growth pattern seen in all organic systems. Why does the Fibonacci sequence repeat in nature? So people are very familiar with it and use it constantly in choosing sizes of clothes. For example, tee shirt sizes are Fibonacci. Since some developers are averse to numbers (a really strange phenomenon for those working with computers) they can use tee shirt sizes and their estimates are easily translated to numbers.

Microsoft repeated this research in recent years in an award-winning IEEE paper. As a result, Microsoft has abandoned hourly estimation on projects. See Laurie Williams, Gabe Brown, Adam Meltzer, Nachiappan Nagappan (2012) *Scrum + Engineering Practices: Experiences of Three Microsoft Teams. *IEEE Best Industry Paper Award, 2011 International Symposium on Empirical Software Engineering and Measurement.

So the Agile community has converged on the Fibonacci as the sequence to use. Unfortunately, many agile teams do not use it properly and try to get everyone to agree on one Fibonacci number which gives you mathematically and experientially provable bad estimates through forced group conformity. This is the very thing the Rand researchers invented the Delphi Technique to avoid.

Over and over again, researchers have shown that hourly estimates have very high error rates. This is true even if the user is an expert. It’s the tool that’s the problem. If you want to practice based on evidence, relative size estimates simply deliver a much more accurate estimate."

Does anybody recognise it?

Update: I was being lazy .. it is from Scrum Inc .. Googled the first paragraph and it found it, that's nice pattern matching and I should have done it straight away!
https://www.scruminc.com/why-do-we-use-fibonacci-numbers-to-estimate-user-stories/

5 comments:

Martin Rapier said...

Well, I completely agree with what it says, but I don't recognise the source.

Geordie an Exiled FoG said...

Cheers Marin,
The motto of the researcher is "always write down the source!"

Geordie an Exiled FoG said...


Googled the first paragraph and found it!

https://www.scruminc.com/why-do-we-use-fibonacci-numbers-to-estimate-user-stories/

Martin Rapier said...

I've just some rather frustrating conversations with both my boss and the Security Manager about flexibility, responding to change, product focussed teams and roadmaps. One wants a gantt chart and the other wants to introduce a four stage security assurance process with 'only' 90 questions to answer. Neither seems to understand or accept the world of not knowing.

Geordie an Exiled FoG said...

My sincere sympathies Martin

As a friend I can only but ask one thing of you .. can you keep these very professional gentleman in your organisation so that they don't by chance or quirk absentmindedly join mine ;)


Sometimes Dilbert is a documentary!