Thursday Jul 23, 2009

Open, Robust and Performant Preservation/Archival - First Steps

As part of the Sun Open Archive for Digital Repositories effort, Sun has been working closely with Fedora Commons to develop and characterize performance of Fedora on Sun (OpenSolaris, ZFS, Sun Storage 7000 appliances, Sun Storage JBOD storage).

The first phase of performance testing and configuration validation was completed recently, with encouraging performance observed from Fedora, running on OpenSolaris 2008.11 and using RAID0 ZFS Pools. Much, much more testing is needed (and is underway at this writing), but much of what we've seen so far bests any Fedora performance testing done to date.

There's quite a compelling case to be made with the combination of Sun hardware and open source OS and application stack, so we're pretty excited about this work.

Check out the attached documents:

  • Poster presented by Sun and Fedora Commons at Open Repositories '09
  • FInal version of this first performance testing document released this month - ingest and access performance of Fedora on OpenSolaris, ZFS and JBODs

Monday Jun 15, 2009

Archival and Preservation: Open Source and Open Archive

One of the more exciting and interesting projects I've been involved with this year centers around Sun's Open Archive systems for Digital Repositories - the use of Open Source software and Sun off-the-shelf hardware to implement world-class data preservation/archival systems. For those of you who remember Sun's Honeycomb archival hardware, this new architecture represents a truly open alternative approach - based on Fedora Commons' offering, OpenSolaris, Sun's X64 servers, JBOD disk arrays and (soon) Unified Storage Systems.

One of the first efforts Sun ISV Engineering contributed to involved sizing and performance testing of Fedora atop OpenSolaris, ZFS and JBODs. The results are both encouraging and impressive, and provide myriad follow-on testing opportunities. I've attached the first draft of test report here.


Wednesday May 20, 2009

Repositories!!

Open Repositories 2009

Greetings from Open Repositories 2009, the premier Open Source Archival and Repositories conference. Sun has a strong presence here, with lots of good interactions, and an exciting rollout of our Open Archive solution....

Oh. Wait. You say you don't know what a Repository is? You say it sounds like an embarrassing, unmentionable over-the-counter medication. Well, soothe thyself, gentle reader, it's nothing like that. Think of a repository as an online Library. A huge collection of digital data or documents. As human beings continue to create petabytes (1PB = 1 million GB) of data each and every day, it not only has to live somewhere, but almost always requires long-term storage. Forever. For the ages. A Real Long Time.

The trick, you see, is not just in storing the stuff. We can do that. We can stream data to disk and tape and optical media and eventually holographic cubes (oh, wait, I'm getting ahead of myself). The real Interesting Thing is not just storing it, but being able to intelligently access this data days, months or decades later. Intelligently. Quickly.

That's why we're here, along with developers, archivists and software architects. Sun is working closely with the Fedora (Commons) community, as well as University of Prince Edward Island. Look for more postings this week on this in greater detail. Until then, the gracious hospitality of downtown Atlanta awaits...



About

Main Sequence: 1) an astronomy term denoting the lifecycle of a majority of known stars. 2) err @ Sun/Oracle: long-time (since 1988) Sun/Oracle veteran, still shining in an ever-changing high-tech universe

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today