Friday Mar 27, 2009

Sun talks out Cloud: Open Cloud Platform

Sun's Open Cloud Vision unveilled: Open Cloud Platform, an open infrastructure powered by Java, MySQL, OpenSolaris, and Open Storage software technologies.  Open APIs, Open formats and Open source.

On March 18th, at CommunityONE aka CloudONE, Sun unveiled the open cloud platform for powering public and private clouds. We also  announced that we are building our own Public Cloud. This will include a Storage and Compute Cloud. Our Cloud will be compatible with Amazon S3 and EC2 at the API level. Meaning, we will provide S3 and EC2 compatibility APIs in addition to our own, hence enabling an easy migration from Amazon services to Sun Cloud. All clouds - public, private or hybrid, built on Sun's Open Cloud platform will be interoperable and there will be minimal vendor lockin given the cloud platform will be built on open standards and APIs.

Storage Cloud:  The Sun Cloud Storage Service is a set of web service APIs and WebDAV protocols that provide open standard based, on-demand, programmatic access to highly scalable storage infrastructure via the Internet, (" the cloud "). With the Sun Cloud Storage Service you will get:

  • Ability to store and retrieve data in multiple data formats
  • Programmatic web services API operations and administration control, using industry standard that don't lock you in
  • Ability to clone and snapshot volumes
  • Ability to mount cloud drives via multiple WebDAV clients including DavFS
  • AWS S3 compatibility

At the CommunityONE conference, Zmanda' CEO Chander Kant showcased Amanda Enterprise (AE) and Zmanda Cloud Backup (ZCB) integration with Sun Cloud APIs to provide customers with backup and recovery solutions for the Sun Cloud that combine fast installation, simplified management, enterprise-class functionality and the benefit of using open formats to ensure that customers are not locked into a vendor to recover archived data. Zmanda engaged with us to get a Storage Account and were able to complete the integration in less than one week for both S3 and WebDAV set of APIs.

Compute Cloud: The core of the Sun Compute Service is the Virtual Data Center (VDC), based on capabilities acquired when Sun bought Q-layer in January.  VDC is a self service UI for Orchestration and Provisioning of resources. It provides everything developers need to build and run a cloud-based data center, including an integrated interface to stage an application that runs on either the OpenSolaris, Linux or Windows operating systems. The VDC enables you to design applications from pre-built components using drag-and-drop, deploy to cloud, monitor, manage and reconfigure the system, and is compatibile with programmatic APIs. The data center  abstraction layer allows for seamless encapsulation of system architecture of an application, and ability to model, save and deploy entire system into a cloud.

At CommunityONE, Sun's Cloud Computing CTO, Lew Tucker demonstrated a functional virtual data center in the cloud, running the Wikipedia and Facebook design patterns. He showed how to build a VDC using the drag-and-drop GUI interface as well as the Sun Cloud RESTful APIs.

Ref. Fig. left: The tool's left pane lists the different sorts of gear/virtual machine images (VMIs) that you might put into your data center as drag-and-dropp'able objects. The objects can be Linux servers, Windows servers, Solaris servers, firewalls, Web servers, load balancers, caching servers, databases, networking switches and so on. Some are standard configurations that Sun will offer. Others will be built by the Sun Cloud community and published in a catalog that you can use. On the right is a blank pane representing an empty cloud that's waiting for you to drop your personalized virtual data center into.

What happens next could not be simpler. You start picking up servers, switches, firewalls, etc., and you just drop them into the cloud. Then, you connect them. Certain objects like servers can be configured. For example, you can describe a server's processor attributes (GHz rating, core count, memory, etc.) and the resulting pay-as-you-go cost depends on that configuration. More cores, more memory, more GHz... more cost. The VDC is automatically asigned one public IP and the servers in the vLAN get private IPs. The diagram on the left shows the typical Facebook design pattern built using the VDC.

A replay of the demo is available here.  We are blown away by the interest in our Cloud and everyone's eagerness to give us their Credit Cards to get access to the Services TODAY.  We can't wait to roll this out this summer! In the meantime, please keep the feedback coming.


Wednesday Nov 05, 2008

Barack Obama and MySQL

It is widely acknowledged that Barack Obama put together the best minds and team together to run his campaign. One of the proof points is that his website www.barackobama.com was driven by MySQL! 

From Jonathan's blog:
http://blogs.sun.com/jonathan/

" On behalf of Sun Microsystems, I would like to offer my sincerest congratulations to President elect Barack Obama. What an extraordinary accomplishment.

I would also like to extend my congratulations to his web team for having chosen MySQL as the platform behind their election web site, BarackObama.com. "


Sunday Nov 02, 2008

Sun's Cloud Computing Portfolio

Update: Sun has expanded its Cloud Computing portfolio with the recent acquisition of Qlayer, a cloud computing company that automates the deployment and management of both public and private clouds.  The Q-layer organization, based in Belgium, is now part of Sun's Cloud Computing business unit which develops and integrates cloud computing technologies, architectures and services.

Cloud computing is about managing petascale data. Sun's server and storage systems can radically improve the data-intensive computing emerging in the cloud. Some clouds are closed platforms that lock you in. Sun's open source philosophy and Java principles form the core of a strategy that provides interoperability for large-scale computing resources. Sun's virtualization solutions for advanced high-performance computing deployments are integrated with Solaris and Web 2.0 technologies such as Java and MySQL.

Check out Sun's Cloud Computing Porfolio below:

  • MySQL is almost the defacto database of choice powering the web-scale next-generation of database driven web applications in the cloud. Cloud computing solutions for MySQL makes it easy to develop, deploy, and manage your new and existing MySQL-backed applications in a virtual computing environment. The MySQL Enterprise for Amazon EC2 subscription is a comprehensive offering of database software and production support to deliver applications on Amazon EC2 with optimal performance, reliability, security, and uptime. For the first time, organizations can now cost-effectively deliver database driven web-scale computing in the "cloud", fully backed by the MySQL database experts at Sun. You can learn more about it here


  • The Webstack from Sun is the optimized open source software stack and is bundled with latest release of OpenSolaris 2008.11. It is pre-configured to have the most popular applications (Apache, PHP, MySQL) to work seamlessly out of a Solaris box. By using Solaris with these binaries in a Cloud, you can enjoy the best levels of performance, while also reducing your time-to-service.
  • Performance is one of the key metrics that users are skeptical about in the cloud. White its not a critical criteria, they still want to be able to profile their applications running in the cloud. Netbeans  provides plugins to profile your application on Amazon EC2. Check out the steps here on how to use Netbeans for profiling your application in the Cloud. You can learn more on this at the Cloud Computing Bootcamp on Nov. 19 2008.  

  • Virtualization is key to enabling a Cloud Computing environment. The Sun xVM portfolio offers a simple and efficient way to leverage a heterogeneous, virtualized environment:
    • xVM Ops Center Discover, provision, update, and manage globally dispersed IT environments from one console
    • xVM VirtualBox Build, test, and run applications on one desktop or laptop for multiple OS platforms side by side
    • xVM Server Securely and reliably virtualize systems and services in a Windows, Solaris OS, or Linux environment
    • Sun VDI Software Securely access a virtual desktop from nearly any client on the network

Further, Solaris 10 includes the Containers technology which is an implementation of operating system level virtualization technology first made available in 2005 as part of Solaris 10. A Solaris Container is the combination of system resource controls and the boundary separation provided by zones. Zones act as completely isolated virtual servers within a single operating system instance. By consolidating multiple sets of application services onto one system and by placing each into isolated virtual server containers, system administrators can reduce cost and provide all the same protections of separate machines on a single machine, hence making it a perfect technology for the Clouds.

  • Besides the product portfolio, Sun is also offering services in the Cloud Computing space.
    • Zembly is a service from Sun hosted on Network.Com which is a place to create social applications, together.  At Zembly, you easily create and host social applications of all shapes and sizes, targeting the most popular social platforms on the web like Facebook, Meebo, iPhone, Google Gadgets etc. And, you do it along with other people, using just your browser and your creativity, and working collaboratively with others.
    • Project Kenai is the foundation for the connected developer of tomorrow. It allows you to freely host your open source projects and code. Find and collaborate with developers of like mind and passion from around the globe.
    • Project SocialSite, is an open source ( CDDL/GPL2) project for building Widgets and Web Services that make it easy for you to add social networking features to your existing web sites, including the ability to run OpenSocial Gadgets and have them backed by the same social graph.
    • Project Caroline is an advanced R&D project at Sun Microsystems. It is a hosting platform for development and delivery of dynamically scalable Internet-based services. It is designed to serve an emerging market of small and medium sized software-as-a-service (SaaS) providers.


  • Sun is offering Open Solaris on Amazon EC2 OpenSolaris, which comes with tools such as ZFS and Dynamic Tracing (D-Trace), are offered for free, in contrast to some Linux offerings that cost money. ZFS allows instant rollback and continual check-summing capabilities, something developers have found lacking in the EC2 platform.  In addition, Sun is offering several popular EC2 images like Drupal, Roby on Rails, Apache, Tomcat etc. For the entire list, click here.


  • Sun is running several promotions for  hosting Facebook and OpenSocial applications on OpenSolaris free for 1 year with some of our cloud computing partners like Joyent. For more details, check out our Startup Essentials program.

Stay tuned for more to come from Sun in this space.

Monday Oct 27, 2008

Open Solaris + MySQL + ZFS Success Story in Production at SmugMug

SmugMug , a photos and videos publishing site, goes into Production on Open Solaris + MySQL + ZFS. Check out this story on why a Linux geek decided to move his site from Linux To Open Solaris.

Don MacAskill, chief geek and CEO of SmugMug says"  ZFS is the most amazing filesystem I’ve ever come across. Integrated volume management. Copy-on-write. Transactional. End-to-end data integrity. On-the-fly corruption detection and repair. Robust checksums. No RAID-5 write hole. Snapshots. Clones (writable snapshots). Dynamic striping. Open source software. " He is also excited about the CoolStack 5.1 stack available in Open Solaris along with MySQL.

Full Story on SumgMug Powered by  Open Solaris  and  MySQL

http://smugmug.com 

<script type="text/javascript">var addthis_pub="geekyjewel";</script> <script type="text/javascript" src="http://s7.addthis.com/js/152/addthis_widget.js"></script>

Monday Oct 20, 2008

Scaling WikiPedia with LAMP: 7 billion page views per month

I recently attended an interesting talk by Brion Vibber, CTO of WikiMedia Foundation, a non-profit organisation that runs the infrastructure for Wikipedia. He described how his team of 7 engineers manages the Wikipedia site that gets on an average of 7 billion page views per month. The highlights from the talk are listed below that included the architecture of the site infrastructure to scale up to the traffic that is received. They are ranked amongst the Top 10 sites in terms of traffic.

The site runs on the LAMP stack and you know what that is:

  • Linux
  • Apache
  • MySQL from Sun
  • Perl/PHP/Python/Pwhatever :-)

WikiMedia runs the site on about 400 x86 servers. Of those, about 250 run the webservers and the remaining run MySQL database. Recently they acquired the OpenSolaris Thumper machines from Sun which they are exploring. Sun Fire X4500 aka Thumper is the World's first Open Source Storage Server running Open Solaris and ZFS. Currently they are using the thumpers for storing the media files using the ZFS file system and they are simply loving it. They have also begun to use the DTrace feature of Open Solaris and cant stop raving about it!!

11/21/08 Update: Link to the recent Press Release WikiMedia selects Sun Microsystems to Enhance Multimedia Experience.

At the core, Wikipedia runs on a very simple system architecture as shown below and given its a non-profit organisation, almost all software is open source and FREE.


Simple is nice but it can be SLOW :-) In order to speedup, the first thing is to add cache in the front end as well as at the backend of the system. On the webfront side, Wikipedia uses the Squid reverse proxy cache for caching and at the backend, they use memcached as shown below:


Squid is a proxy server and  a web cache daemon.. It has a wide variety of uses, from speeding up a web server by caching repeated requests, to caching web, DNS and othercomputer network lookups for a group of people sharing network resources. Squid is good for static dynamic sites like Wiki where the content does not change as often. The public face of a given Wiki page does not change that often, so one can cache at the HTTP level. Wikipedia also uses Squid for geographical load balancing too so that they can use cheaper, faster local bandwidth.

Along with Apache/PHP servers, Wikipedia also uses APC, the alternate PHP caching tool. Since PHP compiles the scripts to bytecode, then throws it away after execution, compilation everytime adds a lot of un-necessary overhead. Hence it is recommended to always use an opcode cache with PHP. This drastically reduces the startup time for large apps.

Another speedup technique used by Wikipedia is memcached. memcached is a general-purpose distributed memory caching system often used to speed up dynamic database-driven websites by caching data and objects in memory to reduce the number of times the database must be read. memcached allows you to share temporary data in the network memory. Even though one needs to go over the network to get the data, the latency is still smaller than disk-based database access. Wikipedia usually stores the rendered pages in the memcached.

After adding all possible cache, next thing is to add CASH! :-) ie add more servers to gain scalability.

Those 250 or so webservers come with plenty of memory. The underutilized memory can be used for memcached and adds up to a big memcached store space.

Further, for getting the speedup at the database level, Wikipedia uses simple sharding techniques. They split the data along logical data partitions, such as subsites that dont interact closely.


They also do functional sharding and split the machines along functional boundaries for speedup.


Next popular technique used by them is Replication to gain speed. They have a master server for all writes and slave servers for most Reads. The secret truth they claim behind configuring the master and slave machines is to make sure the slave machines are faster than the masters as slaves need to keep up with the masters, hence handle writes faster than the master.


As you can see, the beauty of the architecture is that it is SIMPLE and all Open Source and it rocks!


Wednesday Oct 15, 2008

Test Drive MySQL on Solaris 10 for FREE in EZQual Virtual Labs. No Installation, No Cost

MySQL is the defacto database of choice for most WebScale and Cloud Computing deployments.

Every day you go to website like Facebook, CraigsList , eBay, Google, PriceGrabber, Yahoo!, and Zappos, you are touching a page that  uses MySQL.
MySQL's popularity is due in large part to its flexibility. MySQL supports over 20 platforms and scales to handle terabytes of data. And, because MySQL is open source, it can be customized to an application's unique specifications. This flexibility has two-fold benefits for ISVs: MySQL is better able to address their applications' specific needs and it won't impose restrictions on their future development.

Through the Sun Partner Advantage Program(SPA) , ISVs can now leverage Sun's entire portfolio of offerings - including MySQL. The SPA Program connects ISVs with free or deeply discounted technology offerings as well as marketing and sales engagement opportunities so they can deliver their solutions and services to an expanded market.

We have set up a secure, remote, on-line test facility called the EZQual Virtual Lab! designed to make it easier for ISVs to develop, test and qualify applications on Solaris 10 or OpenSolaris and MySQL for free! ISVs can join and get their applications tested and ready for MySQL today in our EZQual lab for Free. The EZQual Virtual Lab features pre-installed SPARC or x86 processor-based Sun servers with Sun Studio Development Tools, Java SE, Sun's Cool Stack, MySQL, Solaris 10, OpenSolaris and more. These servers can be accessed conveniently with Sun's Secure Global Desktop Software.  This is as convenient as it gets. No servers to install, no OS installations; you're ready to go and can sign up today! 

About

alkagupta

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today