Monday Jun 29, 2009

Sun HPC Software, Developer Edition 1.0 for OpenSolaris

Just couple days ago, Sun announced the Sun HPC Software, Developer Edition 1.0 for OpenSolaris. It's a fully-featured HPC development environment that is distributed as a virtual machine (VM). It is based on OpenSolaris 2009.06 and includes pre-configured:

  • Sun Grid Engine 6.2u3
  • Sun HPC ClusterTools 8.1
  • Sun Studio 12u1
  • Sun Studio IDE Plugins
  • Examples of DTrace and performance analysis
  • Accounting and Reporting Console (ARCo)

The compelling feature for HPC developers is that this VM can add cluster resources from Amazon EC2 when local simulated 3-node cluster is insufficient. See the architecture diagram here.

If you wish to give it a try on VirtualBox rather than on VMware follow this blog post.

Additional links:

Download page
Wiki documentation
Release notes

Wednesday Jun 24, 2009

Sun Grid Engine 6.2u3 Released

The Sun Grid Engine 6.2u3 is yet another product update. This means that besides the bug fixes it introduces several new features. But there is another very important difference to the previous releases. The license has changed!

Without a valid Sun Grid Engine license, evaluation use is only permitted for 90 days. If you want to use Grid Engine after that you need to replace the Sun binaries with unsupported courtesy binaries. However the courtesy binaries do not include the new Amazon EC2 adapter and the SGE Inspect modules.

New features in Sun Grid Engine 6.2u3:

Amazon EC2 Adapter

The Service Domain Manager (SDM) adds connectivity to Amazon Elastic Cloud EC2 and the ability to flexibly add execution hosts as needed on demand.

Initial Power Saving Support

A new power saving scheme in SDM enables the creation of a special resource spare pool in which systems can be powered on or off when added or removed from this spare pool.

Service Domain Manager (SDM) Simple Install

It is now possible to install and run an SDM system with only one JVM per (managed or master) host. Previously, the system was using up to three separate JVMs per host. This new feature simplifies installation, configuration and maintenance.

SGE Inspect

A new Java based Sun Grid Engine Inspect module allows to monitor SGE clusters and the Service Domain Manager (SDM). The similarity to VisualVM or Netbeans is not coincidental.

Exclusive Host Scheduling

Exclusive host scheduling allows users to request that jobs and parallel tasks run exclusively on a host if allowed by an administrator.

Microsoft Windows Vista Display Support

The display_win_gui feature is now fully supported. This feature allows a job to launch a GUI on the currently visible desktop on the Windows host that displays job information. This works only if the job is a native Windows application.

As always, you may test this release in parallel with your old cluster to try out the new features. Optionally, you may use the upgrade procedure (clone configuration method) to install SGE 6.2u3, while keeping all your other cluster configuration settings. See the upgrade video. While the video shows an upgrade from 6.1 to 6.2, it will work the same way for cloning any 6.0u2 or later to 6.2u3.


Additional links:

Download page
Wiki documentation
Release notes
Fixed bugs
Patch matrix

Tuesday Jun 09, 2009

Grid Engine Workshop 2009 (Sep 7-10, 2009)

Grid Engine Workshop 2009 - Sun HPC SW Workshop has the same format as in previous years, i.e. 2.5 days of technology, user and solution provider presentations. It is augmented by a separate SGE Advanced Seminar prior to the workshop and by parallel workshop tracks about OpenStorage and Sun Developer Tools. It also builds on the very successful tradition of having that workshop in a beautiful and charming city of Regensburg, Germany.

Register quickly to take advantage of early bird fees and secure your room at the conference hotel quickly (limited capacity). Also submit your presentation proposals ASAP to apply for further discounts as speaker and to make your work known to the Grid Engine community.

More information at  http://hpcworkshop.com

Thursday Mar 05, 2009

Sun Grid Engine 6.2 Update 2 Available

The new product update of the Sun Grid Engine is now available. It's called simply Update  2, but in addition to many bug fixes, it includes following new features:

GUI Installer

It allows an easy interactive installation of a whole cluster.

See more on the Installing With GUI Installer page.

Microsoft Windows Vista Support

New support for Microsoft Windows Vista Enterprise and Ultimate Edition, Windows Server 2003R2 and Windows Server 2008, both 32 and 64-bit versions).

Job Submission Verifier (JSV)

JSVs allow users and administrators to define rules that determine which jobs are allowed to enter into a cluster and which jobs should be rejected immediately. A JSV is a script or binary that can be used to verify, modify, or reject a job during the time of job submission or on the master host.

See more on the Using Job Submission Verifiers wiki page or jsv man page.

Consumable Resource per Job

Consumable complex attributes can now be configured as per job. Such consumables are consumed as requested and are no longer multiplied by the requested slots. This makes resource requests for parallel jobs much easier to define, especially when using slot ranges.

See more on the Defining Consumable Resources page (Multiplied Resource Requests Versus Non-Multiplied Resource Requests) or complex man page (look for consumable section).

Jemalloc Library (on Linux x64)

Most Linux distributions come with a default memory allocator library which is not as efficient as the open source jemalloc memory allocator library, developed by Jason Evans for FreeBSD 7, and also used by the Firefox 3. Sun Grid Engine 6.2 Update 2 replaces the native Linux malloc library with the jemalloc library on x64 platforms. This has a positive effect on the master host performance in large and high throughput Sun Grid Engine clusters on Linux x64 and reduces the memory footprint up to 20% leading to a significant performance increase.

As always, you may test this release in parallel with your old cluster to try out the new features. Optionally, you may use the upgrade procedure (clone configuration method) to install SGE 6.2u2, while keeping all your other cluster configuration settings. See the upgrade video. While the video shows an upgrade from 6.1 to 6.2, it will work the same way for cloning any 6.0u2 or later to 6.2u2.


Additional links:

Download page
Wiki documentation
Release notes
Fixed bugs
Patch matrix
About

Lubomir Petrik

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today