Friday Sep 19, 2014

Latest Hands-On Lab by Orgad Kimchi: How to Set Up a Hadoop 2 Cluster with Oracle Solaris

If you're going to San Francisco, be sure to wear some flowers in your hair. Especially if it's for Oracle OpenWorld. And while you're there, don't miss Orgad Kimchi's latest hands-on lab.

Lab: How to Set up a Hadoop 2 Cluster with Oracle Solaris

In his own words ...

"This hands-on lab presents exercises that demonstrate how to set up an Apache Hadoop 2 (YARN) cluster using Oracle Solaris 11 technologies such as Oracle Solaris Zones, Oracle Solaris ZFS, and Unified Archive. Key topics include the Hadoop Distributed File System (HDFS) and the Hadoop MapReduce programming model. It also covers the Hadoop installation process and the cluster building blocks: NameNode, Resource Manager, History Server, and DataNodes. In addition, you will see how you can combine the Oracle Solaris 11 technologies for better scalability and data security and will learn how to enable a HDFS high-availability cluster and run a MapReduce job."

I'll try to convince Orgad to eventually make that lab available to those who of us who can't afford the tickets to Oracle OpenWorld.

More Gems from Orgad

Orgad regularly writers terrific articles that show you how to put Oracle Solaris technologies to use in the real world. Here are a few of them:

About the Photograph

I took the photograph of a streetcar in San Francisco while sneaking out of the Oracle Solaris reunion I was attending in April of 2014.

Rick
Follow Orgad Kimchi:
Twitter
  Follow Rick on:
Twitter | Personal Blog
Follow OTN Garage on:
Web | Facebook | Twitter | YouTube

Friday May 16, 2014

Orgad Strikes Again

"And while you're at it, use the Unified Archive to deploy a cloud in a box."

Orgad is too smart. Or maybe, he does what Einstein claims to do:

"It's not that I'm so smart, it's just that I stay with problems longer."
- Albert Einstein

How to Set Up a Hadoop 2.2 Cluster on Oracle Solaris 11.2

Technical Article by Orgad Kimchi

Figuring out how to set up a Hadoop 2.2 Cluster helps keep Orgad challenged on those late nights when, after a few too many shots of Joov, he strikes up a casual game of chess with Deep Blue. As he explains,

"Setting up a Hadoop cluster on Oracle Solaris 11.2 gives you fast provisioning via zone cloning, best I/O performance from ZFS compression, and rapid provisioning with the Unified Archive."

But setting up a Hadoop cluster and configuring its failover capabilities (yawn) is just not enough to keep Orgad interested. Nope. To stay awake he has to toss in a neat little trick at the end of his article: how to use the Unified Archive in Oracle Solaris 11.2 to create a cloud-in-a-box that you can deploy in a variety of environments.

I don't know what Orgad does between midnight and 2:00 am, but in case you want to take a guess, here are more gems from Orgad:

About the Photograph

Photograph of plant killed by Mrs. Ramsey taken by Rick Ramsey in Colorado

- Rick
Follow Rick on:
Personal Blog | Personal Twitter
  Follow OTN Garage on:
Web | Facebook | Twitter | YouTube

Monday Dec 16, 2013

Why I'm Going Straight to Hell

Article: Performance Analysis in a Multitenant Cloud Environment

by Orgad Kimchi

My little brother and I used to drive our Sainted Mother mad with this game at bed time. We'd wait till she was stressed out, then throw something big, like a softball, against the wall. Being a worry-wart, she'd come into the room to find out which one of us had fallen out of his bed and broken his arm. We both pretended to be fast asleep, of course, and had already recovered the soft ball.

Perplexed, she would return to the kitchen. A short while later, we would throw the bat against the wall. After the initial boom against the sheetrock, it would clatter on the ground, making a sound similar to a mother's precious child cracking his skull on the cement steps in front of the house. Quickly one of us would recover it, tuck it under the sheets, and then we'd both return to our previous sleeping positions.

Little did we know, as we pushed our mother closer to the edge of Insanity, that our techniques would be adopted by virtualized environments the world over. As Orgad explains in the article above, as each virtualization product abstracts computing resources for isolation or other purposes, it creates a little brother. If something goes boom in the night or, if your environment starts hanging, how do you figure out where the problem is?

It's a super article, and well worth your time. If Mom had read it, we would have woken up inside an anthill, with only our heads sticking out so she could listen to our screams while she sipped a cup of Darjeeling.

Article: Performance Analysis in a Multitenant Cloud Environment

Performance analysis in a virtualized multitenant cloud environment is difficult because of the abstraction layers. How do you find the physical system resources that are overloaded? Orgad Kimchi explores four examples that show how you how with the built-in Oracle Solaris 11 tools.

Other Content By Or About Orgad

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Tuesday Dec 03, 2013

Life Could Be A Dream (Hadoop Hadoop)

Hey nonny ding dong, alang alang alang
Boom ba-doh, ba-doo ba-doodle-ay

Oh, life could be a dream (hadoop)
If I could take you up in paradise up above (hadoop)
If you would tell me I'm the only one that you love
Life could be a dream, sweetheart
(Hello, hello again, hadoop and hopin' we'll meet again)

Tech Article: How to Set Up a Hadoop Cluster Using Oracle Solaris Zones

by Orgad Kimchi

Apache Hadoop helps you process large amounts of data on multiple computers that are clustered together. Oracle Solaris zones are easy to clone and manage as a cluster. Oracle Solaris 11 has great network virtualization capabilities. Orgad walks you through all the steps required to combine these three technologies into an easy to manage big data cluster.

Blog: How to Host a Hadoop Cluster on a SPARC T4-2 Server

by Jeff Taylor

After reading Orgad's paper (see above), Jeff Taylor decided to give Orgad's suggestion a try. He had to configure an Oracle SPARC T4-2 server to store and process two types of data. One type was critical and sensitive data that required ACID transactions and had to be stored in an Oracle Database. The other was high-volume/low-risk data that had to be processed using Apache Hadoop and stored in HDFS. In this blog post he details how he used Oracle Solaris zones.

Video Interview: Why Run Hadoop on Oracle Solaris?

with Orgad Kimchi

Orgad Kimchi provides three technical reasons why you should run Hadoop on Oracle Solaris. Taped at Oracle OpenWorld.

Lyrics to Hadoop Hadoop

by the Crew Cuts

Hey nonny ding dong, alang alang alang
Boom ba-doh, ba-doo ba-doodle-ay

Oh, life could be a dream (ha-doop)
If I could take you up in paradise up above (ha-doop)
If you would tell me I'm the only one that you love
Life could be a dream, sweetheart
(Hello, hello again, ha-doop and hopin' we'll meet again)

Oh, life could be a dream (ha-doop)
If only all my precious plans would come true (ha-doop)
If you would let me spend my whole life lovin' you
Life could be a dream, sweetheart

Now every time I look at you
Something is on my mind (dat-dat-dat-dat-dat-duh)
If you do what I want you to
Baby, we'd be so fine!

Oh, life could be a dream (ha-doop)
If I could take you up in paradise up above (ha-doop)
If you would tell me I'm the only one that you love
Life could be a dream, sweetheart

Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da
Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da
Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da, ha-doop!

Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da
Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da
Ha-doop ha-doop Ya-da-da Da-da-da Da-da-da Da, ha-doop!

Every time I look at you
Somethin' is on my mind
If you do what I want you to
Baby, we'd be so fine!

Life could be a dream
If I could take you up in paradise up above
If you would tell me I'm the only one that you love
Life could be a dream, sweetheart
(Hello hello again, ha-doop and hopin' we'll meet again) doop ha-doop

Hey nonny ding dong, alang alang alang (ha-doop)
Ba-doh, ba-doo ba-doodle-ay
Life could be a dream
Life could be a dream, sweetheart!

Life could be a dream
If only all my precious plans would come true
If you would let me spend my whole life loving you
Life could be a dream, sweetheart

(dee-oody-ooh, ha-doop, ha-doop)
(dee-oody-ooh, ha-doop, ha-doop)
(dee-oody-ooh, ha-doop, ha-doop)
Sweetheart!!

See the Crew Cuts on YouTube

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

Monday Jul 22, 2013

Learning a Little About Hadoop

some rights reserved by timitrus

According to Wall Street & Technology, skills for managing BigData systems are in short supply. Jokes about the NSA bogarting sysadmins aside, you might want to know something about the technology that enables BigData, even if you don't plan to launch a career in that field. The more I learn about it, the more I think it's going to be a component of every data center in a few years. Including the local bagel shop.

"Would you like cream cheese on your Bagel, Mr. Smith, like you had at 10:00 am on Dec 12, or would you prefer Orange Marmelade like your friend Mauricio just ordered at our Cleveland store?"

Hadoop Tutorials

Fari Fayandeh, a tech manager at a data warehousing company in Virginia, put together a list of books and tutorials to get you started. He was kind enough to post it on the Oracle Solaris group on LinkedIn. After ordering an Iced Caramel Machiatto at Starbucks.

Link to Hadoop Tutorials

- Rick

Follow me on:
Blog | Facebook | Twitter | YouTube | The Great Peruvian Novel

About

Contributors:
Rick Ramsey
Kemer Thomson
and members of the OTN community

Search

Archives
« March 2015
SunMonTueWedThuFriSat
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
    
       
Today
Blogs We Like