Compensating for SOA errors

I did it iWay


John Schlesinger is director of integration Solutions for iWay Software (part of Information Builders Inc) and has a long history in our business.

He’s been working on developing middleware since 1985, both at IBM (he worked on the CICS development team) and at iWay Software, where he’s now responsible for the iWay Business Services Provider. One of the good things about my current job is the opportunity to talk to such people (I wish I’d had such access when I was actually working in IT).

We were talking about “transaction processing” and about whether you can provide something similar in a loosely-coupled service-oriented environment. And, why you don't use 2-phase commit in SOA (basically, it's too slow and clumsy).

So, I was interested to see more-or-less the same points coming up in Mark Whitehorn's piece on Jim Gray - great architects obviously think alike.

The point is that transactions are good in an environment that you have full control over, but even there they have limits. When I was an IMS DBA, we were proud of recovering to the point of failure (and not losing data or referential integrity in the process - one of the benefits of transaction processing; and journaling, of course).

This was certainly preferable to recovering to a week-old database image copy and saying sorry to everybody who now had to re-enter their updates (something that some eCommerce sites seem all too happy with). However, if you send a cheque out of the bank, you can't recall it if something fails - although you can roll back the database updates involved to a consistent synch point. In the general case, if something goes wrong, as John and Jim both say, you sometimes have to run compensating logic. This means that you need to process forward, to correct the effects on the business of whatever went wrong - and get a person involved to sort out any remaining problems and apologise to the people you might inconvenience. So, if you have a ginormous eCommerce system, it had better not go wrong too often, as compensation won't always be trivial.

John expresses some nervousness about the current craze for composite applications built using business process execution languages of various flavours. He suggests checking out the slick demos vendors show you – and asking whether the vendor can demonstrate its error or retry processing and compensation logic. Now I'm nervous too.

But John also points out that the people he meets say that they aren't ever going to use these composite business process applications for critical line of business stuff, but only for admin apps - so now I'm less nervous. Only, I've seen lots of business leaders adopt trendy solutions that don't really work - and then the IT people have to sort it all out.

And you can make such composite applications work - John quotes Merrill Lynch as an example. Its composite applications, however, are designed to work together and compensate for errors correctly - the composite comprises only specific applications designed to fit together explicitly, which is fine, but not exactly the free-and-easy model that service orientation is supposed to enable.

John's approach to integration - which is what most business systems spend most of their time doing - is to push event-driven architectures rather than low-level request/reply solutions; and to firmly separate the application logic from the business integration logic. So, as I see it, you might have conventional application transactions to update the underlying databases (maintaining ACID properties) but you don’t publish them as Web Services. Instead, you publish a business-level service, which uses business level information - and submits any required application transactions - systems of record in the enterprise still often run on big mainframe databases - in the background. If any parts of this fail at the business level, then this event can be detected; and should be corrected at the business level.

iWay does have an ESB and a BPEL modelling tool these days, and I was quite impressed when I saw them at Summit (I was even more impressed by customers waiting for the iWay approach to ESB etc. to appear, because they trusted iWay not to let them down as a partner).

Nevertheless, it's good to hear a vendor recognising that its latest technology doesn’t entirely replace what we have already – and that it has to be used with a certain amount of architectural forethought ®.


Other stories you might like

  • Microsoft Azure to spin up AMD MI200 GPU clusters for 'large scale' AI training
    Windows giant carries a PyTorch for chip designer and its rival Nvidia

    Microsoft Build Microsoft Azure on Thursday revealed it will use AMD's top-tier MI200 Instinct GPUs to perform “large-scale” AI training in the cloud.

    “Azure will be the first public cloud to deploy clusters of AMD's flagship MI200 GPUs for large-scale AI training,” Microsoft CTO Kevin Scott said during the company’s Build conference this week. “We've already started testing these clusters using some of our own AI workloads with great performance.”

    AMD launched its MI200-series GPUs at its Accelerated Datacenter event last fall. The GPUs are based on AMD’s CDNA2 architecture and pack 58 billion transistors and up to 128GB of high-bandwidth memory into a dual-die package.

    Continue reading
  • New York City rips out last city-owned public payphones
    Y'know, those large cellphones fixed in place that you share with everyone and have to put coins in. Y'know, those metal disks representing...

    New York City this week ripped out its last municipally-owned payphones from Times Square to make room for Wi-Fi kiosks from city infrastructure project LinkNYC.

    "NYC's last free-standing payphones were removed today; they'll be replaced with a Link, boosting accessibility and connectivity across the city," LinkNYC said via Twitter.

    Manhattan Borough President Mark Levine said, "Truly the end of an era but also, hopefully, the start of a new one with more equity in technology access!"

    Continue reading
  • Cheers ransomware hits VMware ESXi systems
    Now we can say extortionware has jumped the shark

    Another ransomware strain is targeting VMware ESXi servers, which have been the focus of extortionists and other miscreants in recent months.

    ESXi, a bare-metal hypervisor used by a broad range of organizations throughout the world, has become the target of such ransomware families as LockBit, Hive, and RansomEXX. The ubiquitous use of the technology, and the size of some companies that use it has made it an efficient way for crooks to infect large numbers of virtualized systems and connected devices and equipment, according to researchers with Trend Micro.

    "ESXi is widely used in enterprise settings for server virtualization," Trend Micro noted in a write-up this week. "It is therefore a popular target for ransomware attacks … Compromising ESXi servers has been a scheme used by some notorious cybercriminal groups because it is a means to swiftly spread the ransomware to many devices."

    Continue reading
  • Twitter founder Dorsey beats hasty retweet from the board
    As shareholders sue the social network amid Elon Musk's takeover scramble

    Twitter has officially entered the post-Dorsey age: its founder and two-time CEO's board term expired Wednesday, marking the first time the social media company hasn't had him around in some capacity.

    Jack Dorsey announced his resignation as Twitter chief exec in November 2021, and passed the baton to Parag Agrawal while remaining on the board. Now that board term has ended, and Dorsey has stepped down as expected. Agrawal has taken Dorsey's board seat; Salesforce co-CEO Bret Taylor has assumed the role of Twitter's board chair. 

    In his resignation announcement, Dorsey – who co-founded and is CEO of Block (formerly Square) – said having founders leading the companies they created can be severely limiting for an organization and can serve as a single point of failure. "I believe it's critical a company can stand on its own, free of its founder's influence or direction," Dorsey said. He didn't respond to a request for further comment today. 

    Continue reading
  • Snowflake stock drops as some top customers cut usage
    You might say its valuation is melting away

    IPO darling Snowflake's share price took a beating in an already bearish market for tech stocks after filing weaker than expected financial guidance amid a slowdown in orders from some of its largest customers.

    For its first quarter of fiscal 2023, ended April 30, Snowflake's revenue grew 85 percent year-on-year to $422.4 million. The company made an operating loss of $188.8 million, albeit down from $205.6 million a year ago.

    Although surpassing revenue expectations, the cloud-based data warehousing business saw its valuation tumble 16 percent in extended trading on Wednesday. Its stock price dived from $133 apiece to $117 in after-hours trading, and today is cruising back at $127. That stumble arrived amid a general tech stock sell-off some observers said was overdue.

    Continue reading

Biting the hand that feeds IT © 1998–2022