Friday Feb 13, 2015

How to Build a Software Defined Network with Oracle Solaris 11





Before software engineers got so freakin' smart, we used to pay a special type of sysadmin to fiddle with the cables and switches at the back of our racks. They were mean, they were hunch-backed, and their fingers were stained with nicotine.

Those were the good old days. Today, network administrators wash their clothes and and sit at desks. And they use something called "software defined networking." I looked it up in the Urban Dictionary, but there was no listing for it. Which is just as well because if you ask me ...

Software Defined Networking = voodoo magic






A Little Bit About Software Defined Networking

Software Defined Networking is the equivalent of doing your homework the week before it's due. I mean, who does that? Well, the Solaris engineers at Oracle do, for starters. Talk about annoying! They started this trend back in the early days of Oracle Solaris 11. Instead of visiting Rufus in the basement server room, they designed this infrastructure that makes it possible for them to put dibs on networking resources from the comfort of the local Starbucks.

In other words, instead of Rufus yanking cables out of one box and hooking them up to another, you can simply change the cable routing by keyboard, so to speak. And assign them to virtual compute nodes. And configure all kinds of aspects about each network, including Service Level Agreements, an implement of Trotskyist-Leninist Totalitarianism if there ever was one. All without waking Rufus.

Orgad Kimchi, our fearless explorer of real-world Solaris, horsed around with not only the software defined networking capabilities of Oracle Solaris 11, but its latest features, which, in his words provide "greater application agility without the added overhead of expensive network hardware." The SDN features in Oracle Solaris 11.2 now:

  • Enable application-driven, multitenant cloud virtual networking across a completely distributed set of systems
  • Allow network service-level agreements (SLAs) at the application level
  • Provide cloud-readiness, thanks to the OpenStack distribution include in Oracle Solaris 11
  • Integrate tightly with Oracle Solaris Zones.

Tech Article: How to Build a Software Defined Network Using Elastic Virtual Switches

In Oracle Solaris 11.2

Orgad starts by walking you through the steps to set up SSH authentication and the Elastic Virtual Switch controller. Then he shows you how to configure both compute nodes, the four Solaris zones, and their virtual networks. He wraps up by showing you how to test the entire configuration to make sure it's working the way you want. Orgad writes from real-world experience, so you can trust his recommendations.



About the Photographs

I snapped the picture of the lamp at Stovepipe Wells, and the picture of Linda Lu, my 2008 Harley Davidson Softail Custom, while riding through Death Valley, California in the Spring of 2014. To get a better feel for the strange vastness of Death Valley, click on the image below to go to Wordpress, then click on the Wordpress image to enlarge it.



- Rick

Follow Rick on:
Personal Blog | Personal Twitter | Oracle Community Profile
  Follow OTN Garage on:
Blog | Community Discussions | Web | Facebook | Twitter | YouTube

Friday Sep 19, 2014

Latest Hands-On Lab by Orgad Kimchi: How to Set Up a Hadoop 2 Cluster with Oracle Solaris

If you're going to San Francisco, be sure to wear some flowers in your hair. Especially if it's for Oracle OpenWorld. And while you're there, don't miss Orgad Kimchi's latest hands-on lab.

Lab: How to Set up a Hadoop 2 Cluster with Oracle Solaris

In his own words ...

"This hands-on lab presents exercises that demonstrate how to set up an Apache Hadoop 2 (YARN) cluster using Oracle Solaris 11 technologies such as Oracle Solaris Zones, Oracle Solaris ZFS, and Unified Archive. Key topics include the Hadoop Distributed File System (HDFS) and the Hadoop MapReduce programming model. It also covers the Hadoop installation process and the cluster building blocks: NameNode, Resource Manager, History Server, and DataNodes. In addition, you will see how you can combine the Oracle Solaris 11 technologies for better scalability and data security and will learn how to enable a HDFS high-availability cluster and run a MapReduce job."

I'll try to convince Orgad to eventually make that lab available to those who of us who can't afford the tickets to Oracle OpenWorld.

More Gems from Orgad

Orgad regularly writers terrific articles that show you how to put Oracle Solaris technologies to use in the real world. Here are a few of them:

About the Photograph

I took the photograph of a streetcar in San Francisco while sneaking out of the Oracle Solaris reunion I was attending in April of 2014.

Rick
Follow Orgad Kimchi:
Twitter
  Follow Rick on:
Twitter | Personal Blog
Follow OTN Garage on:
Web | Facebook | Twitter | YouTube

Friday Jul 11, 2014

What Can You Do With Data Link Multipathing (DLMP)?

When I first learned about high availability, it was something you provided by creating one or more copies of the operating environment on separate servers. Sometimes on different continents. If the server in Canada failed, the server in Ireland would take over.

Then I found out about Real Application Clusters. Wait, I asked myself, weren't applications invented for the sole purpose of field-testing the OS? Why do test programs need high availability? Haven't these people heard of Oracle Solaris Cluster?

Well, to my great disappointment there are plenty of different approaches to high availability. Just like there are plenty of different approaches to virtualization. And, as you might imagine, you can combine the two.

For instance, if you're going to build a cloud infrastructure using the virtualization capabilities in Oracle Solaris 11, you might as well allocate your network resources to the virtualized environment, as well. And so, you'd probably find yourself creating virtual switches, routers, cards, and what not. Well, what happens if all those virtual networks, which are really just one physical network, go down?

Bjoern Rost, Oracle ACE, provides a nice explanation of a Solaris feature that didn't get a lot of attention when it was released: Data Link Multipathing (DLMP) and DLMP aggregation. DLMP aggregation allows you to combine virtual network interfaces from different physical network interfaces into high availability clusters. You can also use these clusters to improve load balancing, as Bjoern explains in his blog post.

Orgad likes DLMP, too. So much, in fact, that he took a break from reconfiguring the International Space Station so his kids could control it from their XBox, and wrote an article explaining how to apply DLMP to a virtual network. Two articles, in fact.

Tech Article: Using DLMP to Add High Availability to Your Network in Oracle Solaris 11.1

by Orgad Kimchi

How to combine virtual NICs from different physical NICS into a DLMP aggregation assigned to a zone, and configure the aggregation to provide failover for the zone, using Oracle Solaris 11.

Tech Article: Doing More with DLMP

by Orgad Kimchi

You can give an Oracle Solaris 11 zone exclusive access to a physical NIC. Although that approach can ensure that particular zone has full access the entire bandwidth of the NIC, it does leave NIC and the entire network exposed to security breaches. Unless you use DLMP's Link Protection capability. Orgad explains how to do that, as well as enabling resource management for your Oracle Solaris 11 virtual network, improving the availability of an NFS server, and more.

About the Photograph

Lou Ordorica and I took off early a few weeks ago to get in some twisties before the crowds showed up. We stopped at The Last Shot on the Peak to Peak highway to grab a late breakfast/early lunch. While we were there a few more bikes showed up.

- Rick
Follow Rick on:
Personal Blog | Personal Twitter
  Follow OTN Garage on:
Web | Facebook | Twitter | YouTube

Monday Dec 16, 2013

Why I'm Going Straight to Hell

Article: Performance Analysis in a Multitenant Cloud Environment

by Orgad Kimchi

My little brother and I used to drive our Sainted Mother mad with this game at bed time. We'd wait till she was stressed out, then throw something big, like a softball, against the wall. Being a worry-wart, she'd come into the room to find out which one of us had fallen out of his bed and broken his arm. We both pretended to be fast asleep, of course, and had already recovered the soft ball.

Perplexed, she would return to the kitchen. A short while later, we would throw the bat against the wall. After the initial boom against the sheetrock, it would clatter on the ground, making a sound similar to a mother's precious child cracking his skull on the cement steps in front of the house. Quickly one of us would recover it, tuck it under the sheets, and then we'd both return to our previous sleeping positions.

Little did we know, as we pushed our mother closer to the edge of Insanity, that our techniques would be adopted by virtualized environments the world over. As Orgad explains in the article above, as each virtualization product abstracts computing resources for isolation or other purposes, it creates a little brother. If something goes boom in the night or, if your environment starts hanging, how do you figure out where the problem is?

It's a super article, and well worth your time. If Mom had read it, we would have woken up inside an anthill, with only our heads sticking out so she could listen to our screams while she sipped a cup of Darjeeling.

Article: Performance Analysis in a Multitenant Cloud Environment

Performance analysis in a virtualized multitenant cloud environment is difficult because of the abstraction layers. How do you find the physical system resources that are overloaded? Orgad Kimchi explores four examples that show how you how with the built-in Oracle Solaris 11 tools.

Other Content By Or About Orgad

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Tuesday Dec 03, 2013

Life Could Be A Dream (Hadoop Hadoop)

Hey nonny ding dong, alang alang alang
Boom ba-doh, ba-doo ba-doodle-ay

Oh, life could be a dream (hadoop)
If I could take you up in paradise up above (hadoop)
If you would tell me I'm the only one that you love
Life could be a dream, sweetheart
(Hello, hello again, hadoop and hopin' we'll meet again)

Tech Article: How to Set Up a Hadoop Cluster Using Oracle Solaris Zones

by Orgad Kimchi

Apache Hadoop helps you process large amounts of data on multiple computers that are clustered together. Oracle Solaris zones are easy to clone and manage as a cluster. Oracle Solaris 11 has great network virtualization capabilities. Orgad walks you through all the steps required to combine these three technologies into an easy to manage big data cluster.

Blog: How to Host a Hadoop Cluster on a SPARC T4-2 Server

by Jeff Taylor

After reading Orgad's paper (see above), Jeff Taylor decided to give Orgad's suggestion a try. He had to configure an Oracle SPARC T4-2 server to store and process two types of data. One type was critical and sensitive data that required ACID transactions and had to be stored in an Oracle Database. The other was high-volume/low-risk data that had to be processed using Apache Hadoop and stored in HDFS. In this blog post he details how he used Oracle Solaris zones.

Video Interview: Why Run Hadoop on Oracle Solaris?

with Orgad Kimchi

Orgad Kimchi provides three technical reasons why you should run Hadoop on Oracle Solaris. Taped at Oracle OpenWorld.

Lyrics to Hadoop Hadoop

by the Crew Cuts

Hey nonny ding dong, alang alang alang
Boom ba-doh, ba-doo ba-doodle-ay

Oh, life could be a dream (ha-doop)
If I could take you up in paradise up above (ha-doop)
If you would tell me I'm the only one that you love
Life could be a dream, sweetheart
(Hello, hello again, ha-doop and hopin' we'll meet again)

Oh, life could be a dream (ha-doop)
If only all my precious plans would come true (ha-doop)
If you would let me spend my whole life lovin' you
Life could be a dream, sweetheart

Now every time I look at you
Something is on my mind (dat-dat-dat-dat-dat-duh)
If you do what I want you to
Baby, we'd be so fine!

Oh, life could be a dream (ha-doop)
If I could take you up in paradise up above (ha-doop)
If you would tell me I'm the only one that you love
Life could be a dream, sweetheart

Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da
Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da
Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da, ha-doop!

Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da
Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da
Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da, ha-doop!

Every time I look at you
Somethin' is on my mind
If you do what I want you to
Baby, we'd be so fine!

Life could be a dream
If I could take you up in paradise up above
If you would tell me I'm the only one that you love
Life could be a dream, sweetheart
(Hello hello again, ha-doop and hopin' we'll meet again) doop ha-doop

Hey nonny ding dong, alang alang alang (ha-doop)
Ba-doh, ba-doo ba-doodle-ay
Life could be a dream
Life could be a dream, sweetheart!

Life could be a dream
If only all my precious plans would come true
If you would let me spend my whole life loving you
Life could be a dream, sweetheart

(dee-oody-ooh, ha-doop, ha-doop)
(dee-oody-ooh, ha-doop, ha-doop)
(dee-oody-ooh, ha-doop, ha-doop)
Sweetheart!!

See the Crew Cuts on YouTube

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

About

Contributors:
Rick Ramsey
Kemer Thomson
and members of the OTN community

Search

Archives
« April 2015
SunMonTueWedThuFriSat
   
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
  
       
Today
Blogs We Like