Thursday Jan 14, 2010

Sun Grid Engine: Still Firing on All Cylinders

The Sun Grid Engine team has just released the latest version of SGE, humbly called Sun Grid Engine 6.2 update 5. It's a yawner of a name for a release that actually contains some substantial new features and improvements to Sun's distributed resource management software, among them Hadoop integration, topology-aware scheduling at the node level (think NUMA), and improved cloud integration and power management capabilities.

You can get the bits directly here. Or you can visit Dan's blog for more details first. And then get the bits.

Monday Dec 21, 2009

Sun HPC Consortium Videos Now Available

Thanks to Rich Brueckner and Deirdré Straughan, videos and PDFs are now available from the Sun HPC Consortium meeting held just prior to Supercomputing '09 in Portland, Oregon. Go here to see a variety of talks from Sun, Sun partners, and Sun customers on all things HPC. Highlights for me included Dr. Happy Sithole's presentation on Africa's largest HPC cluster (PDF|video), Marc Parizeau's talk about CLUMEQ's Collossus system and its unique datacenter design (PDF|video), and Tom Verbiscer's talk describing Univa UD's approach to HPC and virtualization, including some real application benchmark numbers illustrating the viability of the approach (PDF|video).

My talk, HPC Trends, Challenges, and Virtualization (PDF|video) is an evolution of a talk I gave earlier this year in Germany. The primary purposes of the talk were to illustrate the increasing number of common challenges faced by enterprise, cloud, and HPC users and to highlight some of the potential benefits of this convergence to the HPC community. Virtualization is specifically discussed as one such opportunity.

Wednesday Sep 24, 2008

The Future of Cloud Computing

The cloud computing discussion at this week's High Performance on Wall Street conference stimulated some questions in my mind about the future of cloud computing.

Cloud Computing is currently at a very early stage in that clouds are just starting to appear, each with its own approach and with people now starting to explore how to use cloud infrastructures like Amazon's EC2, AT&T's Synaptic Hosting and others to advantage--both academic experimentation as well as a leveraging of these rented resources by startups, etc., as a fundamental part of their business infrastructure.

Most important, however, is the fact that cloud supply currently far exceeds cloud demand as one would expect in the early adoption stage of a highly-hyped concept. Because of the over-capacity of available resources, one does not currently need to worry about whether cloud resources will be available when you need them. But what happens when that changes?

Speakers at the High Performance on Wall Street conference were sure that as clouds became much more like commodities and resources became more constrained due to increased demand, then free market mechanisms like futures markets would evolve to mediate access to these resources.

If that is true, and it does sound reasonable, how will that change who uses the cloud and how they use it? Will startups be able to build their businesses with cloudy back ends if they must bid for access and utilization on an open market? It isn't clear. Right now, utilization costs for a startup using cloud resources will fluctuate as their business needs fluctuate--more customers, more business, generally more processing and higher rental costs on the cloud. The increased complexity and unpredictability of fluctuating cloud infrastructure costs in addition to fluctuations due to changing business demands may reduce the attractiveness of the cloud approach for these businesses.

Another question. As these shared resources become scarcer, might there be an increased risk that firms could use denial of cloud resources as a strategic weapon against competitors by pre-purchasing significant cloud resources in advance of a competitor's planned use of that resource? Perhaps somewhat farfetched...or perhaps not.

It will be interesting to see how cloud computing evolves as it matures and to see whether these kinds of problems will arise in practice or not. It does seem apparent, however, that the current nascent movement towards cloud computing is bound to get much more complicated in the relatively near future.


Josh Simons


« February 2017