Thursday Jul 26, 2007

Standalone LDoms Box

After being asked many times "How do I install a guest LDom" I decided to give a recipe that does not need an external jumpstart or netboot server. You will not find a 101 on LDoms here, the target audience are experienced Solaris admins with a basic knowledge on LDoms. And, please, do read this recipe as a recipe: if I cook I take a recipe as an idea on how to prepare a meal, it's not the law, but don't blame the author if you do something different.
I recommend to have a look at the Logical Domains Page on sun.com for additional information and links to all required software
The main ingredients we'll use are
  • a T2000 with an internal DVD
  • Solaris install media, at least Solaris 10 11/06 and the Patches 124921-02, 125043-01, and 118833-36 (A recent Opensolaris should work too)
  • LDoms capable firmware and the SUNWldm package
  • Knowledge of the "Beginners Guide to LDoms"
Let's get started:
  1. flashupdate your box to a LDoms firmware, should be a 6.4.x on "showhost version -v"
  2. Install Solaris, I usually install full shot. If you'd like to install less, make sure you've got the SUNWldomu package (some clusters don't install it)
  3. Install SUNWldm (the LDom CLI package), enable the following SMF services: ldmd, vntsd, and drd
  4. Make sure, that the framework works and check the configuration of your control domain (your system might have been LDomified before and have a "more-than-one guest" already running, if so, do a "ldm use-set factory-default" to return to default)
  5. Reduce the control domain to 1 core, 1GB, and no MAUs. You might go for more resources on the service and control domain.
  6. Setup virtual I/O infrastructure: One private virtual (installation) switch (will generate a vsw0 interface on the control domain) and a virtual switch on every physical interfaces and at least one virtual disk service. vsw0 will become the interface we'll run our JET server on
  7. "init 6" the control domain
  8. Check if the virtual infrastructure is set up properly, pay special attention to the instance the private is running on (the private switch can be identified my the "mode=routed" line), I'll assume it'll be vsw0
  9. Configure and start a private network on vsw0 (e.g. "echo 192.168.1.1 > /etc/hostname.vsw0; init 6" (persistent across reboots) or "ifconfig vsw0 192.168.1.1 plumb")
  10. Install JET, make rarpd listen on vsw0. Add the Solaris DVD to JET. JET is no prerequisite, but administering without JET is not the easiest thing to do. Get it here
  11. Configure guest LDoms, all having one network interface in our private switch. Life becomes easier if you configure that interface first. It then becomes the first network interface in your LDoms OBP. The rest is up to you, but I'd like to recommend two things: give it 1G at least to make Solaris happy, and choose the MAC addresses for the externally reachable interfaces manually from the 00:14:4F:FC:00:00 ~ 00:14:4F:FF:FF:FF range. Choosing the MAC adresses manually makes moving a LDom from one system to another easier, as the MAC address can stay the same
  12. Prepare a JET template for the guest, with the MAC address of the interface on the private network
  13. net-install the guest LDom, some people define devaliases for all virtual interfaces although that's not necessary (and I'm usually to lazy to do it) If you followed my recommendation the install interface is the first one in the show-nets listing on the OBP, choose this one, and start installation boot \^y - install
  14. After the installation has finished the private virtual network interface can be removed from the guest
About

Before Sun was acquired by Oracle I was about 12 yrs in pre-sales covering SPARC and Solaris. Today I work in a field role in Oracle Microelectronics and focus on SPARC performance, including working and presenting at customer sites all over EMEA

Search

Categories
Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today