Delphix dishes out Dynamic Data Platform with masking

Virtualises structured data for copies and cloud migration

Analysis Database copy virtualiser Delphix has relaunched itself as a Dynamic Data Platform supplier of personal virtualised data environments, covering on-premises and public cloud environments and masking out sensitive data.

Originally Delphix, founded in 2008, made a copy of structured data, such as an Oracle database, and provisioned virtual copies to test and dev and others who needed a database copy for their work. Such virtual copy provisioning was faster and more space efficient than making full-scale copies.

The funding history is:

  • 2009 – $8.5m A-round
  • 2010 – $11m B-round
  • 2012 – $25m C-round
  • 2015 – $75m D-round

That's a total of $119.5m.

Delphix bought Axis Technology in May 2015 and that provided the data masking technology.

CTO Adam Leaventhal left in February 2016. A new CEO, Chris Cooke, replaced founding CEO Jedidiah Yueh in April 2016, with Yueh becoming executive chairman.

VP of engineering Eric Schrock became CTO in March this year, and now Delphix is relaunching itself with a refreshed exec roster and new marketing messages. The Delphix product portfolio is available as a seamless platform, the Dynamic Data Platform (DDP) offering, it says, which features virtualisation, security, management and self-service automation in one place. Data is moved and managed seamlessly – Delphix likes the word "seamless" – between source and target environments, whether on-premises, cloud, or hybrid – and quickly and securely provisioned where required.

It suggests that it is supplying a DataOps environment, sort of like DevOps, although you might think this is taking marketing a little further than it should.

In summary it seems as if the Delphix virtualisation engine now supports more source applications and can be extended to types of files. It runs as a virtual appliance on-premises or in the cloud and builds a metadata-based single repository as an abstraction above the source data stores, and can provision virtual copies of some or all of this data, with sensitive data masked out by the new masking engine.

Databases and apps

Essentially DDP runs as a virtual appliance and copies data from a set of sources – database data, file system data, and application binaries – into a kind of master data set, from which it can provision copies.

It is an efficient user of copy data space, SVP for products Patrick Lightbody explains, because: "The core technology is built on top of the ZFS file system, which gives us the ability to clone, branch, and snapshot data sets without taking any significant storage overhead. The result is that if you wanted to give 100 developers their own personal production instance to work with, you'd see nearly 100x storage savings with Delphix.

"Dedupe capabilities are inherit in the underlying ZFS filesystem, which allows us to make copies with zero additional storage overhead. Only when a user writes a unique data block to their copy is any additional storage consumed."

The Delphix Virtualisation Engine inside DDP is quite app-specific, as it has to understand the structure of each source application’s data store structure. It supports many databases: Oracle, DB2, AP ASE SQL Server, Postgres, and more*, plus multiple packaged and custom business applications: Oracle EBS, SAP and PeopleSoft, etc. SAP HANA support is in beta.


The platform can handle any type of file, so long as it's in a file system that Delphix can connect to. NFS and iSCSI access protocols are supported.

Lightbody said: "We support connecting to particular folders and virtualising all files included. These are for Linux, Unix, and Windows systems. In addition to a long tail of custom files, we also have customers that take database backups from things like Postgres and MySQL and load them into our platform."

For applications: "We can provide data to applications, generically. This includes connecting to and providing active copies of data. In addition, as the application binaries are frequently needed with the data, Delphix supports virtualizing, versioning and provisioning the binaries alongside the data."

We're told: "Since Delphix provides active copies of data (predominantly databases), customers can use whatever BI tools are already in use. For example, customers have used Tableau and others against SQL-compliant databases. It's just a normal database connection to the downstream tools."

The DDP provides extensible support for arbitrary files, with Delphix providing "a toolkit such that customers, partners, or our services team can extend the file support. For example, to add scripts to load data into a non-supported database."

Pods and replication


Delphix POD scheme

The personal virtual data environments are called pods. Delphix claims these can be generated from multiple underlying data stores, giving users access to self-service capabilities to manage their data environments. They feature single-click refresh, point-in-time recovery, versioning, bookmarking and sharing.

The cloud

Supported clouds are AWS, Azure and the IBM cloud.

Data is replicated to the cloud in form by having a Delphix engine on-premises and in the target cloud. There has been an AMI of Delphix available to run in AWS for a little, and equivalent Azure support has just been added.

Can other clouds be supported? Lightbody said: "Because we are a virtual application, we can technically be deployed on almost any hypervisor platform. We've had customers deploy us in a wide range of places that we hadn't initially certified for (OpenStack)."

He says the replication "is our proprietary technology that we developed to deliver first time and on-going data changes (i.e., as a database is updated) across data centres, geographies, or clouds."

"Our replication technology... works with any data sources loaded onto our platform, giving you a consistent replication strategy regardless of underlying database vendor."

We're told customers moving data to the cloud can move massive amounts of data once but still refresh it, synchronise it, from on-premises or hybrid sources, which speeds up cloud adoption and operations.

Once data is in the cloud: "Customers can use the data however they would like, typically connecting to the data sources as regular connections (JDBC or ODBC)."

What about encryption? Lightbody said: "Our masking engine uses algorithms to do one way (masking) or reversible (tokenization) encryption of the data. These are applied as a customer determines is best."

Other copy data management products

How does Delphix compare to other copy data management products such as Actifio, Catalogic and Cohesity?

LIghtbody says: "They are one of a number of Copy Data Management (CDM) tools. None of them leverage something like ZFS (one of our core technologies), which gives us the ability to do filesystem snapshots.

"Instead those tools typically use the (infrequent) snapshots that come from the database itself. The result is that it takes much longer and more storage overhead to do all the things we just provide out of the box: refresh databases to the reflect the latest production data, reset the database state back to a point in time, or create branches of the database to match the branches of development.

"In addition to our virtualisation technology being a unique differentiator, the presence of our masking engine seamlessly integrated into our platform is a standout capability: nobody else in the CDM space or elsewhere [has it]. The result is that the data can be masked and cloned prior to leaving a secure data environment and then made available for a larger number of data consumers to use with little additional storage overhead."


Delphix was primarily a structured block-based data storage virtualiser and copier. This has been extended to covering less structured data in the sense of files.

Its technology is now simpler to obtain and offers something Delphix says is unique; personalised virtual (and masked) data environments for data consumers for faster application development, cloud migration and governance projects.

This is in data management territory, structured/unstructured data management territory. It differs from unstructured data management, as espoused by Rubrik and Cohesity, by not including data protection. There is also no analytics capability being mentioned and Delphix isn't talking (much) about business continuity and disaster recovery.

Yet Delphix is now set on a course that will bring it increasingly into competition with other data management players. It may hope that its structured data-handling capabilities will give it an edge over competitors lacking that. ®

*For each of the database families, there are OS, hardware, version and configuration options (e.g. Oracle Exadata, SQL Server Clustered, DB2 Blu, etc.) Delphix database product support details can be found here. Customers can connect to databases outside of the core Delphix support by integrating with toolkits and/or using the filesystem capability.

Other stories you might like

  • NASA's InSight doomed as Mars dust coats solar panels
    The little lander that couldn't (any longer)

    The Martian InSight lander will no longer be able to function within months as dust continues to pile up on its solar panels, starving it of energy, NASA reported on Tuesday.

    Launched from Earth in 2018, the six-metre-wide machine's mission was sent to study the Red Planet below its surface. InSight is armed with a range of instruments, including a robotic arm, seismometer, and a soil temperature sensor. Astronomers figured the data would help them understand how the rocky cores of planets in the Solar System formed and evolved over time.

    "InSight has transformed our understanding of the interiors of rocky planets and set the stage for future missions," Lori Glaze, director of NASA's Planetary Science Division, said in a statement. "We can apply what we've learned about Mars' inner structure to Earth, the Moon, Venus, and even rocky planets in other solar systems."

    Continue reading
  • The ‘substantial contributions’ Intel has promised to boost RISC-V adoption
    With the benefit of maybe revitalizing the x86 giant’s foundry business

    Analysis Here's something that would have seemed outlandish only a few years ago: to help fuel Intel's future growth, the x86 giant has vowed to do what it can to make the open-source RISC-V ISA worthy of widespread adoption.

    In a presentation, an Intel representative shared some details of how the chipmaker plans to contribute to RISC-V as part of its bet that the instruction set architecture will fuel growth for its revitalized contract chip manufacturing business.

    While Intel invested in RISC-V chip designer SiFive in 2018, the semiconductor titan's intentions with RISC-V evolved last year when it revealed that the contract manufacturing business key to its comeback, Intel Foundry Services, would be willing to make chips compatible with x86, Arm, and RISC-V ISAs. The chipmaker then announced in February it joined RISC-V International, the ISA's governing body, and launched a $1 billion innovation fund that will support chip designers, including those making RISC-V components.

    Continue reading
  • FBI warns of North Korean cyberspies posing as foreign IT workers
    Looking for tech talent? Kim Jong-un's friendly freelancers, at your service

    Pay close attention to that resume before offering that work contract.

    The FBI, in a joint advisory with the US government Departments of State and Treasury, has warned that North Korea's cyberspies are posing as non-North-Korean IT workers to bag Western jobs to advance Kim Jong-un's nefarious pursuits.

    In guidance [PDF] issued this week, the Feds warned that these techies often use fake IDs and other documents to pose as non-North-Korean nationals to gain freelance employment in North America, Europe, and east Asia. Additionally, North Korean IT workers may accept foreign contracts and then outsource those projects to non-North-Korean folks.

    Continue reading
  • Google opens the pod doors on Bay View campus
    A futuristic design won't make people want to come back – just ask Apple

    After nearly a decade of planning and five years of construction, Google is cutting the ribbon on its Bay View campus, the first that Google itself designed.

    The Bay View campus in Mountain View – slated to open this week – consists of two office buildings (one of which, Charleston East, is still under construction), 20 acres of open space, a 1,000-person event center and 240 short-term accommodations for Google employees. The search giant said the buildings at Bay View total 1.1 million square feet. For reference, that's less than half the size of Apple's spaceship. 

    The roofs on the two main buildings, which look like pavilions roofed in sails, were designed that way for a purpose: They're a network of 90,000 scale-like solar panels nicknamed "dragonscales" for their layout and shimmer. By scaling the tiles, Google said the design minimises damage from wind, rain and snow, and the sloped pavilion-like roof improves solar capture by adding additional curves in the roof. 

    Continue reading
  • Pentester pops open Tesla Model 3 using low-cost Bluetooth module
    Anything that uses proximity-based BLE is vulnerable, claim researchers

    Tesla Model 3 and Y owners, beware: the passive entry feature on your vehicle could potentially be hoodwinked by a relay attack, leading to the theft of the flash motor.

    Discovered and demonstrated by researchers at NCC Group, the technique involves relaying the Bluetooth Low Energy (BLE) signals from a smartphone that has been paired with a Tesla back to the vehicle. Far from simply unlocking the door, this hack lets a miscreant start the car and drive away, too.

    Essentially, what happens is this: the paired smartphone should be physically close by the Tesla to unlock it. NCC's technique involves one gadget near the paired phone, and another gadget near the car. The phone-side gadget relays signals from the phone to the car-side gadget, which forwards them to the vehicle to unlock and start it. This shouldn't normally happen because the phone and car are so far apart. The car has a defense mechanism – based on measuring transmission latency to detect that a paired device is too far away – that ideally prevents relayed signals from working, though this can be defeated by simply cutting the latency of the relay process.

    Continue reading
  • Google assuring open-source code to secure software supply chains
    Java and Python packages are the first on the list

    Google has a plan — and a new product plus a partnership with developer-focused security shop Snyk — that attempts to make it easier for enterprises to secure their open source software dependencies.

    The new service, announced today at the Google Cloud Security Summit, is called Assured Open Source Software. We're told it will initially focus on some Java and Python packages that Google's own developers prioritize in their workflows. 

    These two programming languages have "particularly high-risk profiles," Google Cloud Cloud VP and GM Sunil Potti said in response to The Register's questions. "Remember Log4j?" Yes, quite vividly.

    Continue reading
  • Rocket Lab is taking NASA's CAPSTONE to the Moon
    Mission to lunar orbit is further than any Photon satellite bus has gone before

    Rocket Lab has taken delivery of NASA's CAPSTONE spacecraft at its New Zealand launch pad ahead of a mission to the Moon.

    It's been quite a journey for CAPSTONE [Cislunar Autonomous Positioning System Technology Operations and Navigation Experiment], which was originally supposed to launch from Rocket Lab's US launchpad at Wallops Island in Virginia.

    The pad, Launch Complex 2, has been completed for a while now. However, delays in certifying Rocket Lab's Autonomous Flight Termination System (AFTS) pushed the move to Launch Complex 1 in Mahia, New Zealand.

    Continue reading
  • Alibaba Cloud adds third datacenter in Germany
    More Euro-presence than any other Chinese company, but still nowhere near Google or AWS

    Alibaba has pulled ahead of its Chinese rivals in Europe with the opening of a third datacenter in Germany.

    The company said the Frankfurt datacenter serves cloud computing products to Europe and "adheres to the highest security standards and the strict compliance regulations set out in the Cloud Computing Compliance Controls Catalog (C5) in Germany."

    The addition brings Alibaba Cloud to a network of 84 availability zones in 27 regions worldwide. The company's first European cloud center arrived in Frankfurt in 2016.

    Continue reading

Biting the hand that feeds IT © 1998–2022