By Scott McNeil on Feb 14, 2014
Accelerate Database Testing for Improved Agility and Cost Savings
Discover how SPA Quick Check helps to:
Accelerate Database Testing for Improved Agility and Cost Savings
Discover how SPA Quick Check helps to:
Oracle Exadata Database Machine is the ideal consolidation platform for Enterprise Database Cloud and Oracle Enterprise Manager provides the most optimized and comprehensive solution to rapidly setup, manage and deliver Enterprise Clouds. Clearly, very significant innovations have been delivered via Exadata X4, Enterprise Manager 12c and Database 12c in Cloud Computing space and customers can start realizing benefits from this combination of most powerful and unique enterprise database cloud solution in industry.
As per OracleVoice blog on Forbes.com: "Why Database As A Service (DBaaS) Will Be The Breakaway Technology of 2014":
"Database as a Service (DBaaS) is arguably the next big thing in IT. Indeed, the market analysis firm 451 Research projects an astounding 86% cumulative annual growth rate, with annual revenues from DBaaS providers rising from $150 million in 2012 to $1.8 billion by 2016."
In this blog post, I will walk through the steps aiming to simplify DBaaS Setup on Exadata and also describe automation kits available to achieve the following rapidly -
There are 2 separate automation kits that are provided with EM 12c, first kit is for enabling rapid monitoring and management setup of Exadata stack in EM 12c and second kit is for rapid setup of DBaaS -
1) Deploy EM 12c site or use existing site - If you do not have existing EM 12c R3 setup, you can use EM Automation Kit for Exadata for installing EM 12c R3 Plug-in update 1. This kit is available via patch 17036016 on My Oracle Support(MOS) and can be used to deploy EM 12c latest release. Refer to Readme of patch and MOS note "Obtaining the Oracle Enterprise Manager Setup Automation kit for Exadata (Doc ID 1440951.1)" for additional details. Please note that this will setup EM12c Oracle Management Service along with Management Repository. It can be deployed on a single m/c or OMS and OMR can be setup on different machines.
2) Deploy EM 12cR3 agents and required plug-ins on Exadata Machine - Agent kit is also part of the same EM Automation Kit for Exadata and can be used for deploying agents and plug-ins on Exadata stack. Refer to MOS note "Obtaining the Oracle Enterprise Manager Setup Automation kit for Exadata (Doc ID 1440951.1)" for additional details. Best practice is to use most recent version of Agent kit and also deploy latest plug-ins. Patch details for respective platform are described in the MOS note.
Agent kit script will require Java 1.6.0_43 or greater version on database node where this script is being run. Agent kit script will need to be run as root OS user on Exadata db node, however JAVA_HOME and PATH with JAVA_HOME/bin should be set up as agent OS owner, so these OS env variables need to setup in profile of agent OS owner.
Agent Automation kit helps with achieving following -
Note - In case of Exadata X4, ensure you have the EM 12cR3 latest Bundle patch(released in January 2014). Refer to following MOS notes -
Enterprise Manager 188.8.131.52 Bundle Patch Master Note (Doc ID 1572022.1)
Enterprise Manager for Exadata Plug-in 12cR3 Bundle Patch Bug List (Doc ID 1613177.1)
3) Discover Grid Infrastructure and RAC targets – Above setup script will discover Targets Cluster, Grid Infrastructure, RAC database and listener targets. Discover Grid Infrastructure, ASM and RAC targets manually if required.
4) Please note that this setup script will not discover Oracle Exadata Database machine target in EM 12c. You need to discover the machine using following steps
5) Setup Database Cloud Using Rapid Start Kit - Once you have setup Exadata management in EM 12c, next step is to setup database cloud. Refer to Rapid Start Kit for setting up cloud for both DBaaS and Pluggable DBaaS/PDBaaS. This kit will help achieve the following -
Here are brief steps for setting up Database Cloud using Rapid start Kit, available in EM Agent Kit 184.108.40.206.0, after login to Exadata machine first DB node as EM 12c agent owner
Note: Currently Rapid Start kit for DBaaS makes use of 220.127.116.11.0 Database "Exadata Data Warehouse"
Profile available out-of-box.
However you can create your own DBCA based Profiles and customize the
dbaas_cloud_input.xml. Also if you need to
use RMAN backup based or Snap clone based profile, you can to login to EM12c SSA Portal as SSA Administrator, to create the profile and setup service template.
At this stage, you will be able to manage and deliver your Exadata powered enterprise database cloud using EM 12c.
The Italian National Institute of Astrophysics (INAF) has selected Oracle to store, analyze and manage scientific data generated from the European Space Agency's Gaia mission. The mission sets out to provide in-depth 3-D mapping of the Milky Way galaxy over the course of the next 5 years. An estimated 1 petabyte of astronomical data (equivalent to 1 million gigabytes) will be collected and stored in Oracle Database with Oracle Enterprise Manager entrusted to manage the system.
The goal of the Gaia mission will give researchers a better understanding into how the Milky Way was formed and how it has evolved over time. According to Roberto Morbidelli, Scientific Operation Manager at INAF, "Our activity within the Gaia mission will provide a huge volume of information, a very precious heritage of astronomical data that will have to be stored for the whole 21st century and beyond. Oracle has demonstrated in other research contexts that it would be the ideal technological partner to manage scientific projects of this kind of size. Thus we are sure that it will be a successful choice for INAF too. Oracle has been selected for its technology’s reliability, scalability, availability and the appropriate technological evolution planned in the next years; also key was the competence showed by Oracle experts in the development of features useful to our research.”
Oracle Enterprise Manager will be deployed to help manage the multiple Oracle Database instances and Oracle Real Application Clusters. Oracle Enterprise Manager will be used to ensure reliable access to Gaia mission data, allowing for numerous third-party applications and systems that control and verify the correct functioning of satellites and astronomical instruments.
“We are proud to offer our technology to the Gaia mission, an international research project that is of both major importance and high ambition,” said Xavier Verhaeghe, Vice President, Technology & Big Data Oracle EMEA. “INAF’s choice is another confirmation of Oracle’s ability to easily manage the extreme challenges involved in processing petabytes of Big Data."
Happy New Year to all! Being the first blog post of the new year, lets look at a relatively new feature in EM that has gained significant popularity over the last year - EM 12c DBaaS Snap Clone.
The ‘Oracle Cloud Management Pack for Oracle Database’ a.k.a the Database as a Service (DBaaS) feature in EM 12c has grown tremendously since its release two years ago. It started with basic single instance and RAC database provisioning, a technical service catalog, an out of box self service portal, metering and chargeback, etc. But since then we have added provisioning of schemas and pluggable databases, full clones using RMAN backups, and Snap Clone. This video showcases the various EM12c DBaaS features.
This blog will cover one of the most exciting and popular features – Snap Clone. In one line, Snap Clone is a self service way of creating rapid and space efficient clones of large (~TB) databases.
Self Service - empowers the end users (developers, testers, data analysts, etc) to get access to database clones whenever they need it.
Rapid - implies the time it takes to clone the database. This is in minutes and not hours, days, or weeks.
Space Efficient - represents the significant reduction in storage (>90%) required for cloning databases
To best explain the benefits of Snap Clone, let’s look at a Banking customer scenario:
Based on the above scenario, the storage required, if using traditional cloning techniques, can be calculated as follows:
5 Prod DB = 30 TB
5 Standby DB = 30 TB
5 Masked DB = 30 TB (These will be used for creating clones)
6 Clones (6 * 30 TB) = 180 TB
Total = 270 TB
Time = days to weeks
As the numbers indicate, this is quite horrible. Not only 30 TB turn into 270 TB, creating 6 clones of all production databases would take forever. In addition to this, there are other issues with data cloning like:
Snap Clone to the Rescue
All of the above issues lead to slow turnaround times, and users have to wait for days and weeks to get access to their databases. Basically, we end up with competing priorities and requirements, where the user demands self service access, rapid cloning, and the ability to revert data changes, while IT demands standardization, better control, reduction in storage and administrative overhead, better visibility into the database stack, etc.
EM 12c DBaaS Snap Clone tries to address all these issues. It provides:
So how does Snap Clone work?
The secret sauce lies in the Storage Management Framework (SMF) plug-in. This plug-in sits between the storage system and the DBA, and provides the much needed layer of abstraction required to shield DBAs and users from the nuances of the different storage systems. At the storage level, Snap Clone makes use of storage copy-on-write (or similar) technology. There are two options in terms of using and interacting with storage:
1. Direct connection to storage: Here storage admins can register NetApp and ZFS storage appliance with EM, and then EM directly connects to the storage appliance and performs all required snapshot and clone operations. This approach requires you to license the relevant options on the storage appliance, but is the easiest and the most efficient and fault tolerant approach.
2. Connection to storage via ZFS file system: This is a storage vendor agnostic solution and can be used by any customer. Here instead of connecting to storage, the storage admin mounts the volumes to a Solaris server and format it with ZFS file system. Now all snapshot and clone operations required on the storage are conducted via ZFS file system,. The good thing about this approach is that it does not require thin cloning options to be licensed on the storage since ZFS file system provides these capabilities.
For more details on how to setup and use Snap Clone, refer to a previous blog post.
Now, lets go back to our Banking customer scenario and see how Snap Clone helped then reduce their storage cost and time to clone.
5 Prod DB = 30 TB
5 Standby DB = 30 TB
5 Masked DB = 30 TB
6 Clones (6 * 30 TB) = 180 TB
6 Clones (6 * 5 * 2 GB) = 60 GB
270 TB 90 TB
days to weeks minutes
Assuming the clone databases will have minimal writes, we allocate about 2GB of write space per clone. For 5 production databases and 6 clones, this totals to just 60GB in required storage space. This is a whopping 99.97% savings in storage. Plus, these clones are created in matter of minutes and not the usual days or weeks. The product has out-of-the-box charts that show the storage savings across all storage devices and cloned databases. See the screenshot below.
As i said earlier, Snap Clone is most effective when cloning large databases (~TBs). Common scenarios we see our customers best use Snap Clone are:
Its obvious that Snap Clone has a strong affinity to applications, since its application data that you want to clone and use. Hence it is important to add that the Snap Clone feature when combined with EM12c middleware-as-a-service (MWaaS) can provide a complete end-to-end self service application deployment experience. If you have existing portals or need to integrate Snap Clone with existing processes, then use our RESTful APIs for easy integration with third party systems.
In summary, Snap Clone is a new and exciting way of dealing with data cloning challenges. It shields DBAs from the nuances of different storage systems, while allowing end users to request and use clones in a rapid and self service fashion. All of this while saving storage costs. So try this feature out today, and your development and test teams will thank you forever.
In subsequent blog posts, we will look at some popular deployment models used with Snap Clone.
-- Adeesh Fulay (@adeeshf)
Adopting the Cloud Computing paradigm enables service providers to maximize
revenues while driving capital costs down through greater efficiencies of
working capital and OPEX changes. In case of enterprise private cloud, corporate IT, which
plays the role of the provider, may not be interested in revenues, but still
care about providing differentiated service at lower cost. The efficiency and
cost eventually makes the service profitable and sustainable. This basic tenet has to be satisfied irrespective of the type of service-infrastructure (IaaS), platform (PaaS) or software application (SaaS). In this blog, we specifically focus on the database layer and how its lifecycle gets managed by the Service Providers.
Any service provider needs to ensure that:
While the Database Lifecycle Management features of Enterprise Manager have been widely adopted, I feel that the applicability of the features with respect to service providers is yet well understood and hence appreciated. In this blog, let me try addressing how the lifecycle management features can be effective in addressing each of the above requirements.1. Controlling hardware and software population:
Enterprise Manager 12c provides a near real-time view of the assets in a
data center. It comes with out-of-box inventory reports that show the current
population and the growth trend within the data center. The inventory can be
further sliced and diced based on cost center, owner, etc. In a cloud, whether
private or public, the target properties of each asset can be appropriately
populated, so that the provider can easily figure out the distribution of
assets. For example, how many databases are owned by Marketing LOB can be
easily answered. The flux within the data
center is usually higher when virtualization techniques such as server
virtualization and Oracle 12c multitenant option are used. These technologies
make the provisioning process extremely nimble, potentially leading to a higher
number of virtual machines (VMs) or pluggable databases (PDBs) within the data
center and hence accentuating the need for such ongoing reporting. The inventory reports can be also created using BI Publisher and delivered to non-EM users, such as a CIO.
Now, not all reports can always be readily available. There can be situations where a data center manager can seek adhoc information, such as, how many databases owned by a particular customer is running on Exadata. This involves an adhoc query based upon an association, viz. database running on Exadata and target properties, viz. owner being the customer. Enterprise Manager 12c provides a sophisticated Configuration Search feature that lets administrators define such adhoc queries and save them for reuse.
2. Standardization of platform:
The massive standardization of platform components is not merely a nice-to-have for a cloud service provider, it is rather a must-have. A provider may choose to offer various levels of services, tagged with levels such as gold, silver and bronze. However, for each such level, the platform components need to be standardized, not only for ease of manageability but also for ensuring consistency of QOS across all the tenants. So how can the platform be standardized? We can highlight two major Enterprise Manager 12c features here:
The ability to rollout gold images that can be version controlled within Enterprise Manager's Software Library. The inputs of the provisioning process can be "locked down" by the designer of the provisioning process, thereby ensuring that each deployment is a replica of the other.
The ability to compare the configuration of deployments (often referred to as the "Points of Delivery" of the services). This is a very powerful feature that supports 1-n comparisons across multiple tiers of the stack. For example, one can compare an entire database machine from storage cells, compute nodes to databases with one or more of those.
3. Automation of repeatable tasks:
A large portion of OPEX for a service provider is expended while executing mundane and repeatable tasks like backup, log file cleanup or patching. Enterprise Manager 12c comes with an automation framework comprising Jobs and Deployment Procedures that lets administrators define these repetitive actions and schedule them as needed. EMCC’s task automation framework is scalable, carries functions such as ability to schedule, resume, retry which are of paramount importance in conducting mass operations in an enterprise scale cloud. The task automation verbs are also exposed through the EMCLI interface. Oracle Cloud administrators make extensive use of EMCLI for large scale operations on thousands of tenant services.
One of the most popular features of Enterprise Manager 12c is the out-of-box procedures for patch automation. The patching procedures can patch the Linux operating system, clusterware and the database. For minimizing the downtime involved in the patching process Enterprise Manager 12c also supports out-of-place patching that can prepare the patched software ahead of time and migrate the instances one by one as needed. This technique is widely adopted by the service providers to make sure the tenants' downtime related SLAs are respected and adhered to. The co-ordination of such downtime can be instrumented by Enterprise Manager 12c's blackout functionality.
4. Managing Compliance risks:
In a service driven model, the provider is liable in case of security breaches. The consumer and in turn, the customer of the consumer's apps need to be assured that their data is not breached into owing to platform level vulnerabilities. The security breaches often happen owing to faulty configuration such as default passwords, relaxed file permissions, or an open network port. The hardening of the platform therefore, has to be done at all levels-OS, network, database, etc. The security breaches often happen owing to faulty configuration such as default passwords, relaxed file permissions, or an open port. . To manage compliance, administrators can create baselines referred to as Compliance Standard. Any deviations from the baselines triggers compliance violation notifications, alerting administrators to resolve the issue before it creates risk in the environment.
We can therefore see how four major asks from a service provider can be satisfied with the Lifecycle Management features of Enterprise Manager 12c. As substantiated through several third party studies and customer testimonials, these result in higher efficiency with lower OPEX.
Tuesday, December 3 , 2013
Oracle Enterprise Manager 12c Snap Clone allows administrators to create fully functional copies of databases using the copy-on-write capabilities of the underlying storage layer. Users can request databases from Oracle Enterprise Manager 12c's self-service portal and have them provisioned within minutes instead of hours while keeping storage needs to a minimum. Part of Oracle Enterprise Manager 12c Cloud Management Pack for Oracle Databases, Snap Clone can fundamentally improve the efficiency and agility of administrators and QA engineers while saving storage costs and other capital expenses.
Join us for this webcast to learn how Oracle Enterprise Manager 12c Snap Clone can help:
Thursday, November 21, 2013
Save Time and Costs, Reduce Complexity
Database as a service (DBaaS) offers a variety of benefits to help companies improve operations and move faster to the cloud. Using Oracle Multitenant—a new option for Oracle Database 12c featuring pluggable databases—and Oracle Enterprise Manager 12c, companies can make the most of those benefits.
Join us for the webcast and learn how Oracle technology can help:
High Level Steps:
The animation below captures the steps in the wizard. For step by step process and to understand the support matrix check this documentation link.
Explore the functionality!!
In the next blog, will talk about automating rolling Upgrades of Databases in Physical Standby Data Guard environment using Transient Logical Standby.
New Self-Service Driven Provisioning of Pluggable Databases
Today Oracle announced new capabilities that support managing the full lifecycle of pluggable database as a service in Oracle Enterprise Manager 12c Release 3 (18.104.22.168). This latest release builds on the existing capabilities to provide advanced automation for deploying database as a service using Oracle Database 12c Multitenant option. It takes it one step further by offering pluggable database as a service through Oracle Enterprise Manager 12c self-service portal providing customers with fast provisioning of database cloud services with minimal time and effort.
This is a significant addition to Oracle Enterprise Manager 12c’s existing portfolio of cloud services that includes infrastructure as a service, database as a service, testing as a service, and Java platform as a service. The solution provides a self-service mechanism to provision pluggable databases allowing users to request and access database(s) on-demand. The self-service operations are also enabled through REST APIs allowing customers to integrate with third-party automation systems or their custom enterprise portals.
To understand how pluggable database as a service works, watch this quick demo:
The Oracle Enterprise Manager Special Interest Group (SIG) is a growing body of IOUG members who manage or are interested in all aspects of Oracle Enterprise Manager. This IOUG SIG is managed by volunteers and supported by Oracle Enterprise Manager product managers and developers. The purpose of the SIG is to bring relevant information and education through webcasts, discussions and networking to users interested in learning more about the product, and to share user experiences.On October 30th at 10 AM pacific time, Oracle Enterprise Manager SIG is hosting a webcast on "Performance Tuning your DB Cloud in OEM 12c Cloud Control - 360 Degrees". In this webcast, Tariq Farooq , CEO, BrainSurface and Mike Ault, Oracle will provide a tutorial on how to monitor and perform performance tuning of the Oracle database cloud environment.
You will learn how to leverage Oracle Enterprise Manager for tuning,
trouble-shooting & monitoring your Oracle Database Cloud Ecosystem. The
session covers lessons learned, tips/tricks, recommendations, best
practices, gotchas and a whole lot more on how to effectively use Oracle
Enterprise Manager Cloud Control 12c for quick, easy & intuitive
performance tuning of your Oracle Database Cloud.
• Leveraging OEM12c Cloud Control for Oracle DB Tuning/Monitoring
• Limited Deep-Dive on AWR
• Oracle DB Cloud Performance Tuning
• Best Practices for DB Cloud Maintenance/Monitoring
Register Now !
The Oracle Enterprise Manager General session at Oracle Open World 2013 highlighted the efforts of everyday heroes who are driving their IT organizations’ journeys to a more efficient and agile IT. These heroes shared their experiences in deploying and managing large-footprint Oracle stack environments encompassing Oracle Applications, Oracle Fusion Middleware, Oracle Database, and Oracle engineered systems. The session also covered Oracle Enterprise Manager’s own journey as a product in this context and also gave a sneak preview of what’s to come.
Here the is storify highlights from the general session.
Oracle Enterprise Manager Panel Discussion will be the final session on Sunday before the opening keynote. It will
also serve as the EM special interest group (SIG) meeting. It will
be a great opportunity to meet with colleagues,
peers, and subject matter experts to share best practices, tips, and
techniques around Oracle technologies. In addition to the Oracle
usergroup experts, Oracle executives and experts will be available to
answer questions and listen to the user feedback.
If you cannot make it to the session, the IOUG and Oracle Enterprise Manager teams invite you to join a Twitter Chat during this session on Sunday, Sep. 30th from 3:30 PM to 4:30 PM PST. IOUG leaders, Enterprise Manager SIG contributors and many Oracle Users Forum speakers will answer questions related to their experience with Oracle Enterprise Manager and the activities and resources available for Enterprise Manager SIG members.You can participate in the chat using hash tag #em12c on Twitter.com or by going to tweetchat.com/room/em12c (Needs Twitter credential for participating).
Don't forget to join us at the Oracle Enterprise Manager General Session on Tuesday at noon that features many real-world IT heroes who will share their personal journeys with Oracle Enterprise Manager. A full listing of Oracle Enterprise Manager activities at Oracle Enterprise Manager is available at the Focus-on document.
Join us listen to the CTO of SUNY on Deploying Applications in a Private Cloud with Oracle Enterprise Manager at at Oracle Open World on Wednesday, Sep 25 at 10:15 AM - 11:15 AM in #308 , Moscone South.
Don't forget to join us at the Oracle Enterprise Manager General Session that features many real-world IT heroes who will share their personal journeys with Oracle Enterprise Manager. A full listing of Oracle Enterprise Manager activities at Oracle Enterprise Manager is available at the Focus-on document.
This year at Oracle Open World, the Oracle Enterprise Manager General Session features many real-world IT heroes who will share their personal journeys with Oracle Enterprise Manager.
In this highly educational and entertaining general session on Tuesday, Sep 24 from 12:00 PM to 1:00 PM in Room #103, Moscone South, you can learn about the efforts of everyday heroes such as you who are driving their IT organizations’ journeys to a more efficient and agile IT. You’ll hear about the experiences of these heroes in deploying and managing large-footprint Oracle stack environments encompassing Oracle Applications, Oracle Fusion Middleware, Oracle Database, and Oracle engineered systems. The presentation places Oracle Enterprise Manager’s own journey as a product in context and also gives you a sneak preview of what’s to come.
You can join us on twitter during the general session as well .You can join the conversation using hash tag #em12c on Twitter.com or by going to tweetchat.com/room/em12c (Needs Twitter credential for participating).
You will also see the preview trailer of the upcoming Sci-fi movie Cloud Odyssey : A Hero's Quest for the first time in the Oracle Enterprise Manager General Session. Visit the Cloud Odyssey booth (next to the Tap and Brew!)in Moscone West to learn more and join the crew!
A full listing of Oracle Enterprise Manager activities at Oracle Enterprise Manager is available at the Focus-on document.
Latest information and perspectives on Oracle Enterprise Manager.