Wednesday Apr 07, 2010

Helia secures MySQL with ZFS

ParisLabs is a French Web 2.0 startup, that came out of the TELECOM ParisTech Entrepreneurs incubator. ParisLabs develops and markets a SaaS platform for building networking sites, built off a Java / MySQL stack. It is being used, among others, by the French-speaking professional networking site Helia, kinda Facebook meets Monster. Helia stood out of the pack last year and is now reaching 300K monthly unique visitors as of March 2010 --we wish them a continued success!

Paris Labs currently hosts the Helia service on a dedicated server at Dedibox, a leading French hoster. With a rapidly growing database, Helia needs to make frequent backups, to be able to recover from a disaster. So far, Helia had been using mysqldump to export the data into flat files. The exported files are then zipped, and sent over to a remote server. Apart from being a completely manual process, this process has a major downside: exporting a large database with mysqldump can take a long time, during which the database is stopped, putting the entire site off-line. Also, recovering a database after a disaster from dumped SQL files is a long process, which would create even more downtime for the service.

As a member of the Sun Startup Essentials program, ParisLabs connected with the Sun-Oracle ISV Engineering team to come up with a solution that would create an acceptable security level for their data backup strategy, with minimum service downtime and minimum hardware/software additions. We ruled out, to start with, the option of setting up a slave MySQL server to act as a hot backup, which meant a more complicated architecture, more administration and a bigger infrastructure cost that the start-up could not afford. Instead we explore the possibility to leverage the novel ZFS filesystem included in Solaris 10.

[Read More]

Thursday Sep 10, 2009

Sun powers Symeos online identity management platform

"Thanks to Sun technology, we are continuing to bring innovative identity management solutions to market and driving growth."
Hervé Prot, CEO, Symeos

Specialized in Web services security, Symeos provides online identity management, federated authentication services and single sign-on technologies for customers across multiple industries, including banking and finance. With the support of Sun, Symeos has developed a new scalable identity management product called EGO to support the more than 10 million expected users.

Read the whole story at  to learn how the combinaison of Sun systems, storage and software reduced the Symeos development cost by 60%, delivered a 99.999% infrastructure availability and improved Web application server performance by 92%. Symeos is a member of the Sun Startup Essentials program.

Friday Oct 31, 2008

Zones + ZFS = Zen

The US Center for Disease Control (CDC) BioSense data warehouse for national bio-surveillance undergoes nightly updates from an SQL server to a (data mart) SAS® SPD Server which is made available to the researchers community each morning. During that time, the SPD Server goes offline. As data volume grows, nightly updates may eventually spill into the next business day, so when in 2007 CDC upgraded their server to a Sun Fire 2900 system, they knew that a simple processor upgrade would not be enough in the long run. The solution of replicating SPD Server domains was however complex (software redesign) and/or costly (full server/storage duplication).

Enter Zones and ZFS. Zones, a.k.a. Solaris Containers, are an operating system abstraction for partitioning Solaris systems --they are kinda lightweight logical instances-- allowing multiple applications to run in isolation from each other on the same physical hardware. ZFS is a new kind of filesystem that provides simple administration, transactional semantics and immense scalability. A ZFS snapshot is a consistent point-in-time image of a filesystem. A clone is a writable copy of a snapshot. Solaris creates ZFS clones quickly using no additional disk space to start with. Both Zones and ZFS were technological innovations originally introduced with Solaris 10.

Leveraging Zones and ZFS, the following solution was designed for CDC. ZFS clones of the Biosense 1TB datasets can be created within minutes in a separate Solaris Container, where one can run a second read-only instance of the SPD Server with no modifications of config files or metadata, since Zones appear as brand new Solaris instances to applications. Zones & ZFS combined are solving CDC's problem very elegantly (built-in Solaris features, 4-hour proof-of-concept!), effectively (maintenance window is confined) and at no incremental cost (no extra server/storage, no SPD Server metadata redesign). In addition, the SAS admins are able to define access rights such that the few SAS programmers can update the live SPD Server in the global zone while the general scientific community accesses the cloned data.

Maureen Chew from Sun's ISV Engineering presented this work at the SAS Global Forum 2007 in Orlando, FL. Check out her paper and presentation for more details.

Friday Oct 24, 2008

Fast, reliable, cheap: pick 2? ZFS brings all!

Today's post is the first instance of an on-going series of technology adoption proofpoints. They are short real-life success stories about our application partners leveraging Sun technologies and innovation to create value for the end-customer. They will be, for the most part, the result of our developer support work at ISV Engineering. Unless there had been some public coverage of that work, proofpoints will be anonymized; only the industry and application segment will be identified --so you can still relate them to your own market and customers. So there we go...

After a server crash at a major European bank, two companies got a phone call; Sun because the logo is on the box, and the ISV whose application --a SWIFTnet messaging platform-- was running on it. The call came very quickly because the crash had led to corrupted data. Our joint investigation showed that one VxFS extend --the bank was using the Veritas File System 4.1-- contained old/bad financial data mixed with correct data. The problem was believed to happen after a new VxFS extend was allocated but before its metadata was written. By default, VxFS does not zero newly-allocated extends. For business environments where data integrity is critical, Veritas recommends the mount -o blkclear option that guarantees that uninitialized data does not appear in a file. That solution induced however an 15% performance loss with the application, unacceptable for the customer, and increased disk footprint of the C-ISAM (embedded database) data files.

The Solaris 10 operating system and ZFS filesystem was tested as an alternative solution and used as is with no additional flag. Due to its guaranteed data integrity, application data was found 100% correct after a stringent series of (20) crash tests. The application performance increased by 10% with ZFS compared to VxFS. In addition, the application's cold recovery process, which is started after a power failure, was taking only 15 seconds on ZFS when all C-ISAM database files have been checked. Finally, it was demonstrated that the ZFS built-in snapshot mechanism could be used to implement a Point-in-Time solution eliminating the need of expensive storage with snapshot capabilities.

As a result of this joint engineering work, the ISV listed ZFS as the recommended filesystem to all its customers. Based on this recommendation, customers have migrated to Solaris 10, from earlier releases of Solaris on Sparc, or are planning to do it. Based on ZFS, which is an integral part of the (free) Solaris and OpenSolaris distributions, the ISV solution is more competitive, guaranteeing data integrity --equals higher availability-- and reducing cost of ownership --no VxFS license, no expensive storage-- while delivering full performance.


How open innovation and technology adoption translates to business value, with stories from our developer support work at Oracle's ISV Engineering.



« June 2016