Tasty Systems Engineering: Thumper, ZFS and Lots of Data
By stern on Jan 02, 2007
Only New Year's resolutions to reduce my intake of junk foods would lead to parallels between sucrose engineering and storage systems. I digress from a valuable engineering discussion -- the systems engineering parallel is that the composition of products often yields a new system with characteristics outside the scope of any one of the components taken by itself.
A few weeks ago, I hosted a spirited taping session with Jeff Bonwick, Distinguished Engineer, co-creator of the ZFS filesystem, and CTO of the storage business unit at Sun, Bill Moore, the hardware architect for the X4500 server (also known as "Thumper") and Bob Sokol, fellow Jersey resident and Chief Architect for our Media and Entertainment industry group. Our design roundtable covered how and why Thumper came into existence as a systems product (the peanut butter), why ZFS is the ideal filesystem for it, allowing us to solve for improved reliability, performance and ease of management at the software layer (the chocolate), and how it applies to those industries with some of the most intense and largest-scale data management requirements (ice cream as entertainment).
The podcast of our attempts to contain the data explosion is now available as part of our Innovating@Sun series.