Monday Nov 10, 2008

A new Networked Appliance is the Appliance Appliance for Storage and IT

Going against the establishment or trying to redefine standards in an industry is always hard.  While believers encourage you the industry critics are happy to knock you down.  For the critics as Dale Carnegie says: "Criticisms are disguised complements."  Today after lots of encouragement, hard work and collaboration Sun is announcing it's first wave of OpenStorage appliance solutions built from some pretty compelling systems and software technologies. 

In a nutshell the Sun Storage 7000 Unified Storage System Family offers data services via:

  • - Storage Analytics
  • - VLAN support
    - ZFS Hybrid Storage Pool
    - RAID-Z (5 and 6), Mirrored and Striping
    - Snapshots
    - Clone and clone promotion
    - Snapshot Restore
    - Storage ISV integration
    - NFSv3, v4 service
    - Kernel based CIFS Server
    - iSCSI Target
    - Remote Replication
    - Data Compression
    - Active-Active Clustering
    - Thin Provisioning
    - Virus scanning
    - NDMP Server (Network Data Management Protocol)
    - System Self-Healing
    - ZFS Data Integrity
    - RAID-6 (DP) and optional RAID-6 Across JBODs
    - LACP (Link Aggregation Control Protocol)
    - IP MultiPathing (IPMP)
    - I/O MultiPathing between the Sun Storage 7410 and JBODs
    - Phone home telemetry
    - Multi Browser Interface support
    - Heterogeneous access
    - Role Base Access Control and more...

As true appliances the Sun Storage 7110, 7210 and 7410 offer you a seamless easy to use captive control interface.  It should not matter what is under the covers. But let's take a quick peek under and look at some of the piece parts.  The same piece parts that allow anyone in the opensolaris community to roll your own storage solution.  A great group of folks at Sun have rolled our own storage appliance for sale ($$$) if that is the right solution for you.  Some community members have money but no time and some community members have no money but timeMeet up with them.  The choice is yours and the cost savings are significant for either choice.  However it is pretty difficult to make something very easy and that's where the technical skills of systems and software expertise at Sun differentiates. 

Next up in our recipe is standard commodity hardware.  Nothing special is needed here to add or tweak the configuration.  Software turns the standard hardware into the appliance.  Stock servers with disks and dumb JBOD expansion if you really want to scale. No magic here other than well designed hardware.  Add in components such as SSD/Flash technology to optimize file serving.  Marry it all with very clever file system technology (you know what it is) so performance gains pop.  Intelligence based on a simple flow of:

if ssd_present

then

       begin {optimize ssd}

else

       begin {optimize normal};

That's right an auto sensing file system (click here to see the actual code) for solid state disks no matter how many you may have in your configuration.  Now let's look at one final component. Technology that combines, contains, configures, consolidates and choreographs all this neat stuff into one seamless appliance of fully integrated software and hardware (FISHworks).  The result is analytics for insight and management.  Integrated RAS, fault management and reporting.  Click and point for configuration, management of data services and user management.  Simply easy.

Congratulations are due to too many folks to name here across the systems, software, services, marketing, ops, etc. organizations at Sun.  The most exciting aspect for me is the almost limitless additional services and horizontal scaling that can be realized through the combination of more innovation among systems and opensolaris software.  No matter what model is right for you, as a community member, you can participate or just watch.  It's totally up to you.

As the graphic shows above we've put all hands in for a job well done.

Enough of the quick peek of what is under the covers, just get it and try it out and let us know what you think.  A select set of community members have been working with us for a while and see the glass both ways.  We have been listening too... that is why we took some extra time.



Wednesday Oct 29, 2008

NDMP, SNIA, FOSS, DATA, EASY, COOL, GIVE, TAKE

The Network Data Management Protocol (NDMP) is a standard developed to address the interoperability of backup with  multi vendor network attached storage (NAS).  Less than a year ago some storage vendors worked with SNIA and created a technical Work Group (TWG) to further extend the NDMP standard through software development.  Initial NDMP TWG members include: EMC, NetApp, Hitachi Data Systems, Pillar Data Systems and Sun Microsystems.  The TWG membership made significant code contributions of the NDMPv3 reference implementation code base.  The end result was to create a complete, robust software development kit (SDK) that can be used to to implement NDMPv4 of the standard.

Sun as a member of the SNIA TWG for NDMP has now made available via opensolaris.org it's implementation of the NDMP Server.  As of build 102 (snv_102) the NDMPv4 source code is available.

The  significance here is not so much the evolving protocol but rather multiple vendors, regardless of their business model, promoting open storage networking solutions for the industry.  This collaboration through SNIA promoting not only open standards but open sourced software is what customers expect from all storage vendors today.  The challenge is to get all of the storage vendors to contribute to the collaboration, contribution and evolution of open storage solutions.

Job well done Mark Carlson and Reza Sabdar.


Thursday Dec 06, 2007

NDMP The Protocol, It's All About The Storage...

Why talk about an industry standard protocol called NDMP (Network Data Management Protocol).  I agree by itself it is a low level medium that is a check box item in the world of storage.  However it is an important piece of plumbing that enables your "house" to function.  Numerous software storage applications, particularly backup software and tape products, utilize this protocol for providing services.  While it is analogous to other storage protocols such as iSCSI and FCoE it is "the" protocol when it comes to basic backup.  Pretty sophisticated backup software choices are out there all driven by this basic protocol.  This includes multiple configuration choices such as local backup, 3-way and DAR. 

  • SUN is a working member of the SNIA community to advance the adoption of industry standards. We will be contributing source code to the SNIA effort to help update the SNIA software from NDMP v3 to NDMP v4.

  • SUN is fostering its own OpenSolaris Storage Platform community in cooperation with SNIA and other industry standards bodies to implement and enhance storage industry standards.

  • SUN plans to incorporate the SNIA software being created by the NDMP software TWG into OpenSolaris when it is approved by the SNIA membership.

The storage stack of OpenSolaris keeps getting stronger.  While NDMP is a robust service for backup, when it comes to management of massive amounts of data your mileage may vary.

 

 

 

 

 

 

 

 

While the above picture shows the NDMP protocol in application it does not speak to the entire pyramid structure on the right.  Backup can help you with the performance/cost curve of storage classes, but true storage archive management (SAM) is the one storage application that can automatically manage multiple tiers of storage according to policies crafted by the environment.   Policies are usually driven of of the metadata (the data on the data that you store) which allows you to move data between classes of storage (e.g. expensive FC disks, cheaper SATA disks and magnetic tape) based on file size, access frequency, creation date, etc.  OpenSolaris has released initial SAM/QFS code sources and will continue to do so until the entire SAM/QFS code base is available to the community.  Equally exciting are the OpenSolaris projects ADM and MMS which are bringing storage archive management to the ZFS file system.  Couple all these activities together make one extremely busy storage community working with OpenSolaris.  Given all the technologies are open source code bases you have the ability to leverage with your own code even if it is proprietary.  Fueling the opensource community benefits not only better innovation but more customer choice as well.

 

 

Friday Oct 26, 2007

FISH -n- CIFS

There is motivation when skeptics like to preach that there is no way <substitute here> is going to happen.  Examples include come from behind victories in sports, new discoveries in science and cures for disease.  Good intentions are one thing, but following through on those intentions is a bit more difficult. 

The storage community at opensolaris.org has been busy this past year with community members that include partners, industry standard bodies and numerous code contributions.  The community has been on a journey to continue to enhance, integrate, develop, share and invent technologies applicable to traditional storage and more importantly hybrid storage solutions of today and tomorrow.  The Storage Platform for OpenSolaris Distributions has just had some recent contributions.  Keep in mind these contributions to the community are free, open and not proprietary.  Code is not read only, but available for modification, improvement and bi-directional sharing according to the opensolaris licensing terms.

Recent additions of code and new opensolaris projects include:

  • Kernel based CIFS server (Build 77).  That's right-- designed in as a first class citizen of the os with a kernel based protocol, tightly coupled with NFSv4, VFS, ZFS and Active Directory.  Windows Interoperability.  Another complimentary open sourced solution along side our friends from the SAMBA community.  This service leverages the os and its capabilities.  Need infinite snapshots of your CIFS files?  Want file compression?  Strive for encryption of your data?  Not a problem.  ZFS provides these data services IN the file system.  The kernel based CIFS server source code will post here today.  Need help with source code management tools click here.

  • NDMP service.  Table stakes for backup applications.  The code will be binaries only until the SNIA working group members complete their efforts.

  • Virus Scan service.  Another service that is tightly integrated with the kernel CIFS server and the ZFS file system.  This service provides ICAP protocol support for off-board virus scan engines.

  • NFSv4 Mirror Mounts.  NFSv4 Clients can now automatically mount shared file systems on a NFSv4 Server.

The above new Opensolaris project pages will be posting in the next few weeks so stay tuned.

Adding more and more content to the storage stack of opensolaris may raise some questions of what can be done with this stack.  Well first off it enables better integrated hybrid storage solutions.  The x4500 "Thumper"with Solaris has enabled new thinking storage solutions by leveraging the hardware and software unique capabilities.  One can continue on this journey and enhance the unique hardware and software capabilities.  In fact think of it as Fully Integrated Software and Hardware on a repetitive basis.  The tighter you integrate the incremental features, the more compelling solutions with commodity components using an enterprise open sourced os one can build.  I would think that if you could provide a software heath kit of an open sourced software stack to appeal to the masses you may have something worth investigating.

Come and participate.  Opensolaris is transforming itself from open storage solutions, xVM to Solaris install revisited also known as "Indiana." 

How can you pass up FISH -n- CIFS well prepared? Help spread the word.

About

The blog of Bob Porras - Vice President, Data, Availability, Scalability & HPC for Sun Microsystems, Inc.

Search

Categories
Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today