Don't go chasing waterfalls, please stick... Hang on. They're back

Culture wars, generation shift... hipsters

Since the publication of the Agile Manifesto, there’s been a steady acceptance that Agile is the way to go when it comes to software development. The old waterfall method was seen as something rather quaint and old-fashioned, the equivalent of hanging onto your vinyl LPs when the rest of the world was downloading onto their iPods.

And yet, just as vinyl is making a comeback so we see that waterfall is still clinging on tenaciously. In fact, it’s not just clinging on but positively ruling the roost. According to Gartner's IT Key Metrics Data, waterfall methods were employed on 56 per cent of development projects in 2015.

So, given that it’s generally accepted that agile projects offer much scope for effective development, why are organisations still clinging to the old methods?

Old school is cool

It’s something that worries David Norton, research director at Gartner's Application Governance and Strategy Group. He says there are two strands: “There is the organisational drift back to Waterfall where a company has moved to agile practices and not changed the culture.

“Then there’s change at the project and programme level. This is far more common, we get about two or three calls a week where that’s happening or in danger of happening.”

The hold-up with agile is not due to technical issues – agile deployment remains the best option for most software projects – rather cultural obstacles need to be overcome.

Middle management wall

Translation: middle management, which is like permafrost – something that’s hard to penetrate. “If they don’t change, then we say that the agile antibodies aren’t strong.”

It’s a resistance others have noticed. A senior analyst at a FTSE100 insurance company (who wishes to remain anonymous) explained these “cultural” problems in terms of an organization still running mainframes and handling batch processing.

“You get these guys in their 50s, with no social skills and they’re the ones who maintain the systems. The company can’t get rid of them as the kids haven’t got the right skills,” he told me.

Typically what happens, our analyst explained, is that management will decide to “go agile”.

“They’ll drop in some new age guru who will use agile to develop a web-based system at the front end. At some point, however, they have to speak to the backend and connect to the CICS, DB2 and COBOL applications and that’s where it all breaks down,” he concludes.

He cites as one example a project that was implemented using an agile approach but after a few months, it was clear it was falling behind and eventually the team started using an old methodology.

It’s a situation Norton’s seen in other companies. He says that such situations have to be handled carefully. “If I see guys in their 50s who have been doing COBOL since Moses, I know there’s going to be pushback.”

He cites one client in the US where two of the company’s brightest COBOL programmers both resigned on the same day, the day after they’d been told the company was going agile.

“That considerably slowed the company down – there was enough knowledge to keep the lights on but it did mean that it slowed down the release of new products – as they were struggling to keep the lights on.”

In such situations, it’s important that companies move gradually. “The attitude is that they think ‘I’m not having someone breathe down by neck, telling me what to do.’ In that instance, you can’t go fully into agile mode, it’s literally baby-steps so you can slowly move them.”

Church of Agile

One of the problems, however, is that there’s a tendency for there to be an almost evangelical belief in agile as a methodology and that this sets up conflict.

Mike Adam, CEO of referral marketing agency Digital Animal, has seen the way that agile has become all-pervasive. “There’s a belief in agile as the way that things should be done, it’s like it’s the Church of Agile,” he says.

In March, he wrote a blog setting out the limitations of agile and attracted much criticism for going against received wisdom. Adam sees agile as a dragon in need of slaying. According to Adam, the age of Agile will soon be over - Winter is coming.

He sees that agile has become accepted because it’s fashionable: “Agile is a hipster methodology – it’s when methodology becomes a religion that you get problems.”

Adam stresses he absolutely agrees that agile development is the way forward but - and this is the big but - he points out that the methodology isn’t really that important. What is important, he says, is that there’s a strong leader – one with vision. He draws parallels with the showrunner for TV series, someone who provides an over-riding world view.

Gartner’s Norton agrees that personnel are key to this – and not necessarily technology leaders. “I’ve seen one company where they were doing agile and have reverted; what’s happened is that it lost a couple of people from the finance side and compliance side, the new people came in and didn’t understand what agile was about,” he says.

It’s not only management that can hinder agile rollout. According to Wayne Harris, a product owner at Chroma Sports, agile doesn’t sit very easily with the Prince 2 project management methodology, for example. “Trying to run an agile project with Prince 2 project management is a nightmare,” he says.

There are other methodologies out there, too, that agile must contend with: PMP and CAPM to name just two.

But back on Prince. Harris sees reporting as a major issue and the way that agile meets head-on with this methodology. “The biggest issue is being able to measure what’s happening - Agile isn’t easy to report.”

He knows many companies are aware this is an issue. “I went to a seminar to listen to an agile evangelist talk about this. There is a way that Prince can work with Agile, said the evangelist: either the Prince methodology can change or project managers can become a rare breed and can become scrum-masters,” says Harris.

Difficulties with Prince aside, there’s little doubt that agile is going to be the way forward. More and more organisations are adopting it as a way to run projects and, as some of the old guard retires, there will be less resistance from established programmers.

Despite his run-ins with Prince, Harris is still very involved with agile development, revelling in the freedom it gives him. Although, he says, that he’s never worked in a wholly agile environment. David Norton endorses this view, a hybrid approach is becoming popular, he says.

This growing move, however, should not be the go-ahead for organisations to simply crowbar in agile methodology. It’s an approach that requires firm leadership, a clear vision and total buy-in from all parties.

Gartner’s Norton describes one company that has adopted exactly the right approach to ensure senior management buy-in. “JP Morgan Australia senior managers have installed Kanban boards for themselves. One of them told me ‘as a business guy, I needed to show by example'.”

There is no reason why new development projects need revert to waterfall but the business culture has to alter first: without this, companies will be stuck in the old ways. ®

Similar topics

Narrower topics

Other stories you might like

  • Twitter founder Dorsey beats hasty retweet from the board
    As shareholders sue the social network amid Elon Musk's takeover scramble

    Twitter has officially entered the post-Dorsey age: its founder and two-time CEO's board term expired Wednesday, marking the first time the social media company hasn't had him around in some capacity.

    Jack Dorsey announced his resignation as Twitter chief exec in November 2021, and passed the baton to Parag Agrawal while remaining on the board. Now that board term has ended, and Dorsey has stepped down as expected. Agrawal has taken Dorsey's board seat; Salesforce co-CEO Bret Taylor has assumed the role of Twitter's board chair. 

    In his resignation announcement, Dorsey – who co-founded and is CEO of Block (formerly Square) – said having founders leading the companies they created can be severely limiting for an organization and can serve as a single point of failure. "I believe it's critical a company can stand on its own, free of its founder's influence or direction," Dorsey said. He didn't respond to a request for further comment today. 

    Continue reading
  • Snowflake stock drops as some top customers cut usage
    You might say its valuation is melting away

    IPO darling Snowflake's share price took a beating in an already bearish market for tech stocks after filing weaker than expected financial guidance amid a slowdown in orders from some of its largest customers.

    For its first quarter of fiscal 2023, ended April 30, Snowflake's revenue grew 85 percent year-on-year to $422.4 million. The company made an operating loss of $188.8 million, albeit down from $205.6 million a year ago.

    Although surpassing revenue expectations, the cloud-based data warehousing business saw its valuation tumble 16 percent in extended trading on Wednesday. Its stock price dived from $133 apiece to $117 in after-hours trading, and today is cruising back at $127. That stumble arrived amid a general tech stock sell-off some observers said was overdue.

    Continue reading
  • Amazon investors nuke proposed ethics overhaul and say yes to $212m CEO pay
    Workplace safety, labor organizing, sustainability and, um, wage 'fairness' all struck down in vote

    Amazon CEO Andy Jassy's first shareholder meeting was a rousing success for Amazon leadership and Jassy's bank account. But for activist investors intent on making Amazon more open and transparent, it was nothing short of a disaster.

    While actual voting results haven't been released yet, Amazon general counsel David Zapolsky told Reuters that stock owners voted down fifteen shareholder resolutions addressing topics including workplace safety, labor organizing, sustainability, and pay fairness. Amazon's board recommended voting no on all of the proposals.

    Jassy and the board scored additional victories in the form of shareholder approval for board appointments, executive compensation and a 20-for-1 stock split. Jassy's executive compensation package, which is tied to Amazon stock price and mostly delivered as stock awards over a multi-year period, was $212 million in 2021. 

    Continue reading
  • Confirmed: Broadcom, VMware agree to $61b merger
    Unless anyone out there can make a better offer. Oh, Elon?

    Broadcom has confirmed it intends to acquire VMware in a deal that looks set to be worth $61 billion, if it goes ahead: the agreement provides for a “go-shop” provision under which the virtualization giant may solicit alternative offers.

    Rumors of the proposed merger emerged earlier this week, amid much speculation, but neither of the companies was prepared to comment on the deal before today, when it was disclosed that the boards of directors of both organizations have unanimously approved the agreement.

    Michael Dell and Silver Lake investors, which own just over half of the outstanding shares in VMware between both, have apparently signed support agreements to vote in favor of the transaction, so long as the VMware board continues to recommend the proposed transaction with chip designer Broadcom.

    Continue reading
  • Perl Steering Council lays out a backwards compatible future for Perl 7
    Sensibly written code only, please. Plus: what all those 'heated discussions' were about

    The much-anticipated Perl 7 continues to twinkle in the distance although the final release of 5.36.0 is "just around the corner", according to the Perl Steering Council.

    Well into its fourth decade, the fortunes of Perl have ebbed and flowed over the years. Things came to a head last year, with the departure of former "pumpking" Sawyer X, following what he described as community "hostility."

    Part of the issue stemmed from the planned version 7 release, a key element of which, according to a post by the steering council "was to significantly reduce the boilerplate needed at the top of your code, by enabling a lot of widely used modules / pragmas."

    Continue reading

Biting the hand that feeds IT © 1998–2022