Saturday Oct 05, 2013

Elasticity: The Biggest Challenge Facing Today's Data Center

Biggest Challenge Facing Data Centers Today

Interview with Brian Bream, Collier IT

Provisioning used to be a hardware activity. It involved heavy lifting. Today, thanks to Oracle's engineered systems, a data center can pre-configure itself to make provisioning a software activity. According to Brian Bream, CTO of Collier IT, instead of pulling a server off the shelf, installing an OS, and applications, then patching and configuring, it's a matter of bringing up the management tool, selecting the image, and hitting Bang! In Brian's experience, elasticity is the biggest challenge facing data centers today, and Oracle engineered systems are a great way to deal with it.

In addition to being Collier IT's Chief Technology Officer, Brian was named instructor of the year not once, but twice, by Oracle University. Get his opinion about the impact of training on the careers of sysadmins.

Related Resources

- Rick

Follow me on:
Blog | Facebook | Twitter | Personal Twitter | YouTube | The Great Peruvian Novel

Monday Jul 29, 2013

How to Bend Bare Metal to Your Will

photo copyright 2013 by Rick Ramsey

The fins on this 1957 DeSoto were shaped during a time when Americans weren't afraid of offending anyone with their opinions, right or wrong. We have, perhaps, grown a little more introspective, a little more considerate, but our cars have paid the price. They all look alike. Their edges have been worn away by focus groups. They have no personality. They cringe at the sight of their own shadows.

I weep for my adopted country.

Well, if you like classic American cars as much as I do, you may on occasion feel the need to bend bare metal to your will. Here's your chance.

Tech Article: How to Get Best Performance From the ZFS Storage Appliance

Disk storage. Clustering. CPU and L1/L2 caching size. Networking. And file systems. Just some of the components of Oracle ZFS Storage Appliance that you can shape for optimum performance. Anderson Souza shows you how. Go ahead. Give your appliance a pair of tail fins. (Link is in the title.)

Psst:
You can see more unique cars from the Golden Age of American Automobile at the Gateway Automobile Museum. If you can't get to the border between Utah and Colorado to appreciate them in person, like I was fortunate enough to do, you can enjoy them through your browser at http://www.gatewayautomuseum.com/cars-and-galleries/.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Monday Jul 22, 2013

Learning a Little About Hadoop

some rights reserved by timitrus

According to Wall Street & Technology, skills for managing BigData systems are in short supply. Jokes about the NSA bogarting sysadmins aside, you might want to know something about the technology that enables BigData, even if you don't plan to launch a career in that field. The more I learn about it, the more I think it's going to be a component of every data center in a few years. Including the local bagel shop.

"Would you like cream cheese on your Bagel, Mr. Smith, like you had at 10:00 am on Dec 12, or would you prefer Orange Marmelade like your friend Mauricio just ordered at our Cleveland store?"

Hadoop Tutorials

Fari Fayandeh, a tech manager at a data warehousing company in Virginia, put together a list of books and tutorials to get you started. He was kind enough to post it on the Oracle Solaris group on LinkedIn. After ordering an Iced Caramel Machiatto at Starbucks.

Link to Hadoop Tutorials

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Monday Jul 15, 2013

Migrating from SUSE Linux to Oracle Linux - System Initialization

The iptables service defines rules for handling packets on a Linux system. It's usually a good idea to disable this service during installation of a Linux update to prevent malicious code from being installed by angry cats (image removed from blog). Once the update is installed securely, you can define the iptables rules and once again enable the service.

To find out, before you install an update to Oracle Linux, whether the iptables service is enabled, use the list option to the chkconfig command. It displays the status of Linux services at boot time. For example:

# chkconfig -- list
abrtd 0:off 1:off 2:off 3:on 4:off 5:on 6:off
acpid 0:off 1:off 2:off 3:off 4:off 5:off 6:off
atd 0:off 1:off 2:off 3:on 4:on 5:on 6:off
...
...
iptables 0:off 1:off 2:off 3:off 4:off 5:off 6:off
...
...
SUSE Linux to Oracle Linux: Guide for System Administrators
17
...
...

To check the status of only the iptables service, pipe in a little grep:

chkconfig -- list | grep iptables

This is just one of the tips provided by Manik Ahuja and Kamal Dodeja in their OTN technical article, ....

Tech Article: How to Initialize an Oracle Linux System

This is the first in a series of articles that outline the major steps in migrating from SUSE Linux to Oracle Linux. It focuses on registering your system, downloading the latest version of Oracle Linux, and performing some basic initialization steps. Stay tuned for more articles.

Tech Article: How to Initialize an Oracle Linux System

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Tuesday Jul 09, 2013

The Case for Running Oracle Database 12c on Oracle Solaris

You may have already seen some of these individually, but here are several resources that explain why Oracle Database 12c runs so well on Oracle Solaris and SPARC.

Oracle Solaris 11 + SPARC

Interviews with experts, videos, architectural papers, technical articles, and other resources to help you understand the optimizations between the OS and hardware layers that make Oracle Solaris and SPARC such a winning combination. link

Oracle Solaris 11 + Oracle Database 12c

A deeper dive into the optimizations and capabilities of Oracle Solaris that make it such a good platform for Oracle database 12c. link

Oracle Solaris 11 + Oracle Stack

A high-level overview of the optimizations in Oracle Solaris 11 that make it an excellent platform for the entire Oracle stack. link

Article: How Oracle Solaris 11 Makes Oracle Database So Fast

A technical explanation of the optimizations that make Oracle Database run so fast on Oracle Solaris 11. Memory, critical threads, kernel acceleration, virtualization and resource management, and much more. By Ginny Henningsen. link

Screencast: Outliers

In this screencast, Jon Haslam describes how the Oracle Database and Oracle Solaris engineering teams worked together to integrate DTrace and V$ Views to provide a top-to-bottom picture of a database transaction I/O -- from storage devices, through the Oracle Solaris kernel, up to Oracle Database 12c itself. With this end-to-end view, you can easily identify I/O outliers -- transactions that are taking an unusually long time to complete -- and use this comprehensive data to identify and mitigate storage system problems that were previously extremely hard to debug. link

And Don't Forget ...

WebCast: Introducing Oracle Database 12c

Oracle prez Mark Hurd and friends will be talking about the pluggable databases capability in Oracle Database 12c’s new multitenant architecture. No, they do not let you pause a running database with a cork, unfortunately, but they do make it easy to consolidate onto the cloud. Topics covered:

  • Simplify database consolidation
  • Automatically compress and tier data
  • Improve database and application continuity
  • Redact sensitive data
  • And as an added bonus, hear Tom Kyte’s “Top 12 Features of Oracle Database 12c.”

It's on Wednesday, July 10, 2013 at 9 a.m. PT / 12 p.m. ET. link .

Blogs with Solaris-related Content

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Friday Jun 21, 2013

How Oracle Solaris Makes the Database Scream

Few things are as satisfying as a screaming burnout (image removed from blog). When Oracle Database engineers team up with Oracle Solaris engineers, they do a lot of them. Here are a few of the reasons why.

Article: How the OS Makes the Database Fast - Oracle Solaris

For applications that rely on Oracle Database, a high-performance operating system translates into faster transactions, better scalability to support more users, and the ability to support larger capacity databases. When deployed in virtualized environments, multiple Oracle Database servers can be consolidated on the same physical server. Ginny Henningsen describes what Oracle Solaris does to make the Oracle database run faster.

Video Interview: Why Is The OS Still Relevant?

In a world of increasing virtualization and growing interest in cloud services, why is the OS still relevant? Michael Palmeter, senior director of Oracle Solaris, explains why it's not only relevant, but essential for data centers that care about performance.

Interview: An Engineer's Perspective: Why the OS Is Still Relevant

Sysadmins are handling hundreds or perhaps thousands of VM's. What is it about Solaris that makes it such a good platform for managing those VM's? Liane Praza, senior engineer in the Solaris core engineering group provides an engineer's perspective.

Interview in the Lab: How to Get the Performance Promised by Oracle's T5 SPARC Chips

If you want your applications to run on the new SPARC T5/M5 chips, how do you make sure they use all that new performance? Don Kretsch, Senior Director of Engineering, explains.

Interview: Why Oracle Database Engineering Uses Oracle Solaris Studio

The design priorities for Oracle Solaris Studio are performance, observability, and productivity. Why this is good for ISV's and developers, and why it's so important to the Oracle database engineering team. Taped in Oct 2012.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Thursday Jun 20, 2013

Hands-On Labs + Proctors = Genius

If Albert Einstein (image removed from blog) had attended OTN's virtual sysadmin days, he wouldn't have gotten so old figuring out his Theory of Relativity. Thanks to the relentless advance of technology, you can outsmart Einstein from the comfort of your own office. See below.

OTN Virtual Sysadmin Day - July 2013

It's free - register here

We held our first ever virtual sysadmin day for North America on January 15 of this year. Almost 600 sysadmins attended and over 80% of them remained online for the duration of the event. Which means they found it a good use of their time. If you missed that one, we're doing another one in July. Oddly enough, we chose the same date and time: the 15th at 9:00 am PT. Which is at exact same spot of the Earth's rotation, but on the other side of the sun and closer to our upcoming collision with Adromeda.

That galactic fender-bender aside, we have updated some of the hands-on labs about Oracle Solaris and Oracle Linux that we presented at our in-person sysadmin days, and we added three new labs about Oracle VM:

  • Deploying Infrastructure as a Service
  • How to Virtualize and Deploy Oracle Applications Using Oracle VM Templates
  • Creating an x86 Enterprise Cloud Infrastructure

Details here.

The event is free, but you do need to register. And there's a little homework involved. Nothing too complicated. We just expect you to have VirtualBox installed and the proper images already imported before we begin class. You'll see the instructions after you register.

When was that again?

Monday, July 15 at 9:00 am Pacific Time. (Time converter here.)

Register here

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Friday Jun 07, 2013

How to Get Started Using DTrace on Oracle Linux

I. hate. slow. code. (Image removed from blog.)

We all hate slow code. Bunch of princesses is what we've become. During the American Civil War, they had to deliver their text messages by horseback! It took weeks! And half the time, they got blown off their horse by a cannonball to the neck!

Today? Today we have to have our stuff back in milliseconds, or we start tweeting about it. So, if you're developing or deploying applications, how do you keep them performing at the speed to which we have become accustomed? DTrace, of course.

"But I'm a Linux guy," you say. "I don't DO Oracle Solaris."

That's fine. The folks at Oracle Solaris are not only wicked smart, they are generous. Now you can use DTrace on Oracle Linux. Let me point out, by the way, that DTrace is just as useful for sysadmins as it is for developers. In this video, taken a couple of years ago, Brendan Gregg explains how sysadmins can make their deployed applications run faster even after the developers who wrote them pushed back the last bits of their code:

Video Interview: How to Improve the Performance of Deployed Applications Using DTrace

Brendan Gregg describes the best ways for sysadmins to tune deployed applications to get more performance out of them in their particular computing environment.

Bonus: More info about Brendan Gregg plus links to his personal and professional blogs.

If you'd like to try DTrace on Oracle Linux, here are some resources to get you started.

What DTrace Probes Are Available on Oracle Linux?

If you are running Oracle Linux 6 with the DTrace-enabled Unbreakable Enterprise Kernel Release 2 (2.6.39), you can run this command to list all the DTrace probes available on your system:

dtrace -l

If you are not running that version of Oracle Linux, you can download it from the ol6_x86_64_Dtrace_latest channel on the Unbreakable Linux Network (ULN). For more info about installing and configuring DTrace, see the DTrace chapter in the Oracle Linux Administrator's Solutions Guide for Release 6.

For each probe listed by dtrace -l, the output includes a name, the portion of the program where it resides, and the Oracle Linux kernel module that does the probing. Once you have that, go to Chapter 11 of the DTrace Guide to find out what each probe does.

Article: How to Get Started Using DTrace on Oracle Linux

DTrace is a powerful tool, and it can do some amazing things. But it's not that difficult to get started doing simple things. You can build up from there. In this article, Richard Friedman gives you a high-level overview of DTrace and its major components:providers, modules, functions, and probes. He explains how you can use either one-liner commands on the command line, or write more complex instructions in scripts, using the D language. He provides simple examples for each. It's a great way to get your feet wet.

Article: How to Get Started Using DTrace on Oracle Linux
Bonus: Brendan Gregg's one liners for DTrace (some of the existing DTrace one-liners will require modification to work on Oracle Linux).

The DTrace Book

You can get all the info you need about DTrace through the Dynamic Tracing in Oracle Solaris, Mac OS X, and FreeBSD, by Brendan Gregg and Jim Mauro. Of course, you can also buy your own paper or electronic copy through any of the major retailers. (We're working on getting a good discount for the book, but you'll have to subscribe to the OTN Systems Community Newsletter to find out about it.)

Bonus:How the DTrace book got done, by Deirdre Straughan

DTrace Forums

Lots of developers and sysadmins are using Dtrace and posting their questions and tips on the DTrace Forum. Here's an example of one conversation:

Q: Unexpected output of dtrace script
m1436 wrote a dtrace script to monitor the bytes returned by the read() system call to the user programme, but was getting strange results. He includes the dtrace script and the strange output.

A: kvh responds, explaining that the problem m1436 encountered is the result of a common misconception about copyin(). "It is intended to be used to copy content of userspace memory into a scratch buffer so that it can be accessed directly from within kernel space (where the DTrace core executes). That said, it is often interpreted as somehow being equivalent to malloc() whereas in reality it actually works like alloca() instead. So, what you are seeing is basically the artifact of the scratch buffer being overwritten with other data. ... in order for this to work, you should do things a bit differently.

The DTrace forum always has great discussions. Let me know if you find any that are worthy of highlighting. And good luck!

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Tuesday May 28, 2013

What If I Want to Update Just Java?

Sometimes all you want to update is Java, and not your entire Oracle Solaris environment. But Java is packaged as part of the Oracle Solaris systems software, and Oracle recommends that you update all the system software at once, since it was tested together.

What can you do?

How to Update Only Java in Your Oracle Solaris Environment

by Peter Dennis and Alta Elstad

This article describes how to update one piece of software that is constrained by an incorporation without altering any other software that is constrained by that incorporation, and still end up with a supported system. This article by Peter Dennis and Alta Elstad explains how to do that. It focuses on Java, but you can use the same technique for other software.

More Information About Oracle Solaris Packaging

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Tuesday Apr 30, 2013

How to Build A Cloud for Family and Friends Using Oracle Solaris 11

image copyright 2013 by Rick Ramsey

When we talk about cloud, we tend to focus on The Cloud. Enterprise. Government. Scalable. Fast. Big. Bigger. Fastest. That's all wicked impressive, but it's not something I can do on a rainy Saturday afternoon. Now, I like and use Dropbox. There are other easy-to-use cloud services out there similar to Dropbox. But my Inner Geek wants his own cloud. Something modest and unassuming. Itty bitty, even. Just for fun. Kinda like putting a race cam on my Ducati 748: I don't need one, but I want to see if I can do it. Turns out it's nowhere near as involved as installing a race cam on a Ducati. And you don't need to get your hands greasy. Suk Kim, Oracle ACE Director, shows how.

How to Build a Web-Based Storage Solution Using Oracle Solaris 11

by Suk Kim, Oracle ACE Director

Combine AjaXplorer, Oracle Solaris 11.1, and Apache Web server to build a cloud-based storage service that is similar to Dropbox. These are the main tasks ... Install Oracle Solaris 11.1. Configure ZFS storage. Install the Apache and PHP packages. Set up Security. Connect to the client. Check ZFS compression and deduplication. That's all it takes. Suk Kim provides the instructions.

(In case it's not clear that the link is in the heading, Laura, you can also click here)

Suk Kim is an Oracle Ace Director for Oracle Solaris in South Korea. He is also chairman of the Korea Oracle Solaris User Network, manager of Oracle Solaris TechNet, manager of the Solaris School community, an adjunct professor at Ansan University, and a senior system and security consultant at NoBreak Co., LTD.

Follow Suk Kim here:

About the Cloud Picture

I took it from my house in Colorado in the summer of 2011 with a cheap Sony camera. 2013 has brought a snowy Spring to Colorado (next storm, on May 1, will drop 6 inches of snow on us), so it's likely we'll see a lot more of these storms in May, June, and July. I need to spring for a better camera so you can see how spectacular these storms are in the high country.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Friday Apr 26, 2013

Three Goodies About the ZFS Storage Appliance

Today we have three goodies about the ZFS Storage Appliance to share (image removed from blog):

Video Interview: The Top Capabilities of ZFS Storage Appliance Explained

Nancy Hart describes her favorite capabilities about the ZFS Storage Appliance, and Jeff Wright explains how each of them works. They cover Hybrid Columnar Compression, Direct NFS (makes data transfer more efficient), Remote Direct Memory Access, Oracle Intelligent Storage Protocol (database aware of the storage and vice versa), DTrace Analytics to optimize deployments, and more.

Blog: My Personal ZFS Storage Appliance Crib Sheet

We recently published some articles about really cool ways to use the ZFS Storage Appliance, so I spent a little time looking into the darned thing. It's easy to find out what the ZFS Storage Appliance does, but more difficult to find out what its components are. What can I yank out and replace? What can I connect it to? And what buttons and levers can I push? Or pull. So I put together this crib sheet. If you didn't grow up in The Bronx, see wikipedia's definition of crib sheet.

3D Demo

Pop the doors open, pull out the disk shelves, find out what's inside each one. Great demo, and you're at the controls.

Additional Resources

For more technical resources about the ZFS Storage appliance, use any of the four tabs on OTN's Technical Resources Center. And, to see other blogs about Oracle's storage products, select the "Storage" tab under Categories in the right margin, or click here.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Thursday Apr 18, 2013

Why Solaris Loves Python

It's not well known that Oracle Solaris 11 includes a healthy dose of Python code, and that Solaris engineering uses Python tools. These four videos provide more of the story.

How Oracle Solaris 11 Uses Python

Oracle Solaris 11 installation tools use Python to access C libraries more quickly and easily than if they were coded in C. Drew Fisher explains why the Solaris engineering team chose Python for this purpose, what he personally likes about it, and what it implies for the future of Solaris development.

Why Is Oracle Solaris Engineering Looking for Python Developers?

Martin Widjaja, engineering manager for Oracle Solaris, describes the development environment for Oracle Solaris and why Oracle wants to hire more Python developers to work on Solaris.

Why I Started Developing In Python

David Beazly was working on supercomputing systems at Los Alamos National Laboratory when he began to use Python. First, he used it as a productivity tool, then as a control language for C code. Good insights into Python development for both systems developers and sysadmins from the respected author.

How RAD Interfaces In Oracle Solaris 11 Simplify Your Scripts

Every time a new release of Oracle Solaris changes the syntax or output of its administrative commands, you need to update any scripts that interact with those commands. Until now. Karen Tung describes the RAD (Remote Administration Daemon) interfaces that Solaris 11 now provides to reduce the need for script maintenance.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Tuesday Apr 16, 2013

Evaluating Oracle Solaris and Oracle Linux From Your Laptop

Evaluating Oracle Linux From Inside VirtualBox

After importing your Oracle Linux virtual image, you can use the yum install command to download additional packages into your Linux environment. Yuli explains how.

But what's really cool about evaluating an OS from inside VirtualBox is that you can assign each virtual image a unique IP address, and have it communicate with the outside world as if it were its own physical machine on the network. Yuli describes how to do this, and also how to install guest additions to, for instance, share files between the guest and host systems.

Evaluating Oracle Solaris 11 From Inside VirtualBox

In this article Yuli shows you how to create and manage user accounts with either the GUI or the CLI, how to set up networking, and how to use the Service Management Facility (SMF) to, for instance, control SSH connections to the outside world.

Both article cover the basics to get you started, but also very valuable are the links that Yuli provides to help you move further along in your evaluation.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Thursday Apr 04, 2013

The Screaming Men of Finland and Oracle SPARC Chips

source

In response to the release of Oracle's SPARC T5 and M5 chips, which are dramatically faster than those of IBM, IBM responded by saying that speed was not as important as other qualities. Forbes begged to differ:

Forbes Article: For Big Data Customers, Top Performance Means High Speed And Low Cost

Assuming you agree, you'll be interested in some dyno runs of not only our SPARC chips, but also our applications running on them. Did I say dyno runs? I'm sorry, I meant benchmarks.

World's Fastest Database Server

Oracle’s new SPARC mid-range server running Oracle Solaris is the fastest single server for Oracle Database:

  • Oracle’s SPARC T5-8 is the fastest single server for Oracle Database
  • Oracle's SPARC T5-8 server has a 7x price advantage over a similar IBM Power 780 configuration for database on a server-to-server basis.
See Benchmarks Results Here
Why Oracle Database runs best on Solaris

World's Fastest Server for Java

As you might expect, Java runs fastest on Oracle servers.

SPECjEnterprise2010 Benchmark World Record Performance
SPECjbb2013 Benchmark World Record Result
Why Solaris is the best platform for Enterprise Java

Optimizations to Oracle Solaris Studio COmpilers

The latest release of Oracle Solaris Studio includes optimizations for the new SPARC chips in its compilers. Larry Wake has more:

Blog: Oracle Solaris and SPARC Performance - Part I

I'll Optimize Yours If You Optimize Mine

Since the Solaris and SPARC engineers get along so well, they have each optimized their technologies for each other:

SPARC Optimizations for Oracle Solaris
Oracle Solaris Optimizations for SPARC

Happy Burnouts.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Wednesday Apr 03, 2013

Miss MoneyPenny and the Oracle Solaris 11 Provisioning Assistant

source

In the following video, Bart Smaalders, from the Oracle Solaris core engineering team, explains why they decided not to provide a direct upgrade path from Oracle Solaris 10 to Oracle Solaris 11, and the best way for a data center to perform an indirect upgrade.

VIDEO INTERVIEW: Why Engineering Did Not Provide a Direct Upgrade Path to Oracle Solaris 11

Miss MoneyPenny to the Rescue

If you saw Skyfall, you probably noticed two things. First, that the latest Miss Moneypenny is a lot more interesting than past Miss Moneypennies. Second, that she's always there when 007 needs her.

Just like Oracle Solaris 10.

Oracle Solaris 10 has just released a nifty tool called Oracle Solaris 11 Provisioning Assistant. It lets you run the automated installer from Oracle Solaris 11 on a Solaris 10 system. That means you can set up an IPS (Image Packaging System) repository on your Solaris 10 system, and use it to provision one or more Solaris 11 systems.

In fact, if you have already set up a JumpStart server on your Solaris 10 system, you can use it to provision the Solaris 11 systems. Kristina Tripp and Isaac Rozenfeld have written an article that explains how:

TECH ARTICLE: How to Use an Existing Oracle Solaris 10 JumpStart Server to Provision Oracle Solaris 11 11/11

Note:
The Provisioning Assistant only provisions Solaris 11 11/11 systems. It does not provision Solaris 11.1, and there are no plans to extend its functionality to provision future releases of Oracle Solaris 11. Once you have set up your Solaris 11 system, use its automated installer to provision systems with the Solaris 11.1 or future releases. For more info, see the Upgrading to Oracle Solaris 11.1 documentation.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Wednesday Mar 27, 2013

Why Become a Solaris Sysadmin?

On the one hand Oracle is telling you that Solaris is the key component of the Oracle stack, that we've been investing heavily in it, and that it provides the best platform for managing the stack. Watch these videos:

On the other hand, we are telling your boss to buy our engineered systems because they'll not only reduce the complexity of managing the data center, but they'll need fewer sysadmins to run them.

So, which is it?

Video Interview: Why Become a Solaris Sysadmin?

I asked Larry Wake, Solaris old-timer. Tell me what you think of his answer.

Video Interview: Why Become A Solaris Sysadmin?.

A year or two ago, Justin asked Marshall Choy a similar question. Watch that video here:

Video Interview: Impact of Engineered Systems on the Sysadmin

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Tuesday Feb 26, 2013

Performance Tuning an Exalogic System

source

I tend to get annoyed at my engineering pals for designing performance into automobiles such as the Chevy Corvette, instead of letting the driver feel the satisfaction of increasing performance by improving his or her technique. Many sysadmins feel the same about their craft. But as the story of Paul Bunyan demonstrates, we must adapt or die.

In a previous post I discussed how Exalogic changes the way you handle provisioning. In this post, I'll focus on the way Exalogic changes the way you handle performance tuning. First, the optimizations that are already done for you, then the optimizations you can still perform yourself.

Performance Optimizations Designed Into Exalogic

Because Oracle engineering knows the exact details of the environment in which each component is operating, Oracle has configured Exalogic components to use the internal network, memory, and storage for optimum performance, availability and security. It employs two types of optimizations:

Generic Optimizations (Exabus)

These optimizations will benefit any software running on the Exalogic machine, whether Oracle or 3rd party, in physical or virtual environments. The collection of Exalogic–specific optimizations are referred to as Exabus. The purpose of Exabus is primarily to integrate Infiniband networking seamlessly into all the hardware, software, and firmware distributed throughout the system. Examples include:

  • Changes to the firmware and drivers in the network switches that increase performance by skipping protocol stack conversions
  • Use of Exalogic solid state disk caching to increase the speed and capacity of local (shared) data read and write operations, such as JMS queues and run time metadata.
  • Built in high availability at network and storage levels
  • Native Infiniband integration with any other engineered systems, such as additional Exalogic machines, ZFS storage appliances, or Exadata Database machines.
  • The ability to define Infiniband partitions, which ensure application isolation and security.

Optimizations to Run-Time Components

Oracle has engineered optimizations for Exalogic directly into Oracle WebLogic Server (WLS), Coherence, and Tuxedo. They benefit any application running on those software components, but they can only be activated on the Exalogic platform. They address performance limitations that only become apparent when the software is running on Exalogic's high-density computing nodes and very fast Infiniband switches. Examples include:

  • WebLogic Server session replication uses the SDP layer of IB networking to maximize performance of large scale data operations. This avoids some of the typical TCP/IP network processing overhead.
  • Cluster communication has been redesigned in Coherence to further minimize network latency when processing data sets across caches. Its elastic data feature increases performance by minimizing network and memory use in both RAM and garbage collection processing.
  • Tuxedo has been similarly enhanced to make increasing use of SDP and RDMA protocols in order to optimize the performance of inter–process communications within and between compute nodes.

Tuning You Can Perform on Exalogic

Benchmarks and other tests show that applications that run well on Oracle middleware will run better on Exalogic. The degree to which they run better will be affected by how well optimised they are to take advantage of the Exalogic system, as well how well the Exalogic components are set up to balance resources.

However, if your workloads or configurations change, you may need to tune your Exalogic. Here are some general notes, extracted from the Exalogic: Administration Tasks and Tools white paper.

Tuning the Middleware

At the middleware and application level most of the standard options and techniques are available to you. WebLogic Server, JRockit, Coherence and iAS, etc. operate as they do on traditional platforms.

As for the rest of the Exalogic platform, Oracle's recommendation is: leave it alone.

Tuning The Platform

Exalogic manages itself, so you don't need adjust it unless you are sure that something needs changing. This is a major change in approach, since you are used to spending considerable time tweaking your systems to accommodate the needs of different groups. Knowing exactly when and how much (or how little) to tune an Exalogic system is a big topic, but here are some general guidelines.

  • Because Exalogic has such a high density of compute resources across such a fast network, small configuration changes can have a large impact.
  • Try out your changes in a test environment, first. Make sure its resources, configurations, and workload match those of your production system as closely as possible. Oracle Application Replay is a good tool for assessing the impact of configuration and infrastructure changes on the performance of your applications. Give it a try.
  • Focus on reducing response times for users and applications. If response time is not a problem, you probably don't have an issue to resolve, regardless of internal alerts and indicators you may be noticing.
  • Capture the right performance baselines ahead of time so you can compare the results of your tuning to them.

Tuning the Infrastructure

Storage, Infiniband, and OS are set up during initial configuration, so further tuning is not usually needed. If you need to review the kernel settings, network bonding, and MTU values, or perhaps the NFS settings, use Enterprise Manager. Finding the optimum changes tends to be an iterative process that varies with application workload.

Tuning the Middleware Runtime Environment

Ensure that Exalogic optimizations for WLS Suite are switched on (see MOS note 1373571.1), since they affect replication channels, packet sizes, and the use of the SDP protocol in the Infiniband networks.

Oracle Traffic Director is currently a unique feature of Exalogic, so is not available on other platforms. You can alter traffic routing rules for each application at any time. As workloads change and grow this is likely to be a key tuning task.

Tuning the Applications

At present you can tune business applications just as you would on traditional platforms. One possible side effect of running your business applications on Exalogic is that its enhanced performance may unmask poorly tuned applications or poorly written customizations.

For More Information

For more information, read the Exalogic: Administration Tasks and Tools white paper.

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Tuesday Feb 19, 2013

Provisioning Oracle Exalogic: What's Involved

source

In this interview from 2012, Marshall Choy explains to dear old Justin how Oracle's engineered systems and optimized solutions will impact the job of a sysadmin.

I was just reading a recently published Oracle White Paper that goes into a little more detail...

"While the core middleware or applications administration role is largely the same as for non-Exalogic environments, significantly less work is required to manage storage, OS, and networks. In addition, some administration tasks are simplified."

That sounded interesting, so I kept reading. Here is an excerpt of what it says about provisioning.

Provisioning New Environments

Provisioning is done so frequently in some organizations that it's almost a continuous effort. Exalogic was designed as a multi-tenant environment in which many applications and user communities can operate in secure isolation, but all running on a shared compute infrastructure. As a result, provisioning environments for development, testing or other projects is simply a case of re-configuring these existing shared resources. And it takes hours rather than weeks.

The typical steps involved are:

  1. Storage – using the ZFS BUI
    1. Create NFS v4 shares
    2. Define Access Control List
  2. Compute nodes – via standard OS commands
    1. Decide which nodes are to be used for this project. In the current Exalogic X3-2 machines each node has 16 processing cores and 256 GB RAM. For each node:
      1. Create the root OS user, if it does not already exist.
      2. Add a mount point entry for the shared storage to the /etc/fstab file and issue the mount command to enable access to it from the compute node.
  3. Network – using the Exalogic IB subnet manager
    1. Identify IP addresses for the compute nodes to be used. Add any new virtual IP addresses to be used to ensure middleware high availability.
    2. Define new virtual network interfaces (VNICs) to enable connections to Exalogic from the rest of the data Center.
    3. Associate the pre-set external facing IP addresses to the VNICs.
    4. Define Exalogic Infiniband partitions to create secure groups of compute nodes / processors.

No physical cabling is required as network configuration is defined at the software level. In the event of a major failure, however, you may need to re-image the OS on some or even all compute nodes as a faster alternative to restoring from backup.

This whole process should take no more than an hour, after which a new, fully functioning compute platform is available for the project. It does not require any other data Center resources.

Further details are available in the Exalogic Enterprise Deployment Guide

I'll keep reading it and sharing some nuggets here. See the entire paper.

- Rick

Follow us on:
Blog | Facebook | Twitter | YouTube

(psst! and don't forget to follow the Great Peruvian Novel!)

Monday Feb 18, 2013

Three Oracle VM Hands-On Labs On OTN

source

We put the hands-on labs from the virtualization track of the OTN Virtual Sysadmin Days on OTN.

Lab 1 - Deploying an IaaS Environment with Oracle VM

Planning and deployment of an infrastructure as a service (IaaS) environment with Oracle VM as the foundation. Storage capacity planning, LUN creation, network bandwidth planning, and best practices for designing and streamlining the environment so that it's easy to manage.

Lab 2 - How to Virtualize and Deploy Oracle Applications in Minutes with Oracle VM

How to deploy Oracle applications in minutes with Oracle VM Templates. Find out what Oracle VM Templates are and how they work. Deploy an actual Oracle VM Template for an Oracle application. Plan your deployment to streamline ongoing updates and upgrades.

Lab 3 - Deploying a Cloud Infrastructure with Oracle VM 3.x and the Sun ZFS Storage Appliance

This hands-on lab will demonstrate what Oracle’s enterprise cloud infrastructure for x86 can do, and how it works with Oracle VM 3.x. How to create VMs. How to migrate VMs. How to deploy Oracle applications quickly and easily with Oracle VM Templates. How to use the Storage Connect plug-in for the Sun ZFS Storage Appliance.

By the way, the picture of that ranch in Colorado was taken by my good friend
Mike Schmitz. See more of his photography here. Follow it on Facebook here.

- Rick

Follow us on:
Blog | Facebook | Twitter | YouTube

(psst! and don't forget to follow the Great Peruvian Novel!)

Friday Feb 15, 2013

Sysadmins Rejoice! OVM 3.2.1 Includes a Full-Featured CLI

Remember this famous scene from English History? The French accent of the castle guard was so thick I couldn't understand him, but I think that at one point he said "I spit on your graphical user interface." Proof that sysadmins were alive and well in the time of King Arthur.

CLI Documentation

Sysadmins will have cause to taunt English royalty a second time because the command line interface (CLI) of the recently released Oracle VM 3.2.1 has been expanded to include all the capabilities of the (ptui!) graphical user interface (GUI). That means scripts. Boo-yah! It supports public-key authentication, too. Find docs here.

Other Cool Stuff

Oracle VM Manager used to manage only your x86 virtual machines. Now it manages your SPARC systems, too. Create server pools, create virtual machines, and manage networking and storage in the same way, using the same tool. Details here.

You can use MySQL as your backend repository. Just use the Simple installation, which will locally install the default MySQL database that is packaged with the Oracle VM Manager installer. Details here.

You can install the osv-support-tools meta-package for easier integration with Oracle support tools. (sudo is now part of osv-support-tools.) Details here.

More Resources

- Rick

Follow us on:
Blog | Facebook | Twitter | YouTube

(psst! and don't forget to follow the Great Peruvian Novel!

About

Contributors:
Rick Ramsey
Kemer Thomson
and members of the OTN community

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
12
13
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today
Blogs We Like