Monday Jul 02, 2012

AWS EC2 Oracle RDB - Storing and managing my data

When create an Oracle Database on the Amazon cloud you will need to store you database files somewhere on the EC2 cloud. There are basically three places where database files can be stored:
1. Local drive - This is the local drive that is part of the virtual server EC2 instance.
2. Elastic Block Storage (EBS) - Network attached storage that appears as a local drive.
3. Simple Storage Server (S3) - 'Storage for the Internet'.

S3 is not high speed and intended for store static document type files. S3 can also be used for storing static web page files. Local drives are ephemeral so not appropriate to be used as a database storage device. The leaves EBS which is the best place to store database files. EBS volumes appear as local disk drives. They are actually network-attached to an Amazon EC2 instance. In addition, EBS persists independently from the running life of a single Amazon EC2 instance. If you use an EBS backed instance for your database data, it will remain available after reboot but not after terminate. In many cases you would not need to terminate your instance but only stop it, which is equivalent of shutdown. In order to save your database data before you terminate an instance, you can snapshot the EBS to S3.

Using EBS as a data store you can move your Oracle data files from one instance to another. This allows you to move your database from one region or or zone to another. Unfortunately, to scale out your Oracle RDS on AWS you can not have read only replicas. This is only possible with the other Oracle relational database - MySQL. The free micro instances use EBS as its storage.

This is a very good white paper that has more details:
AWS Storage Options
This white paper also discusses: SQS, SimpleDB, and Amazon RDS in the context of storage devices. However, these are not storage devices you would use to store an Oracle database. This slide deck discusses a lot of information that is in the white paper:
AWS Storage Options slideshow

Thursday Jun 07, 2012

Advantages of relational databases over VSAM, ISAM and hierarchical data stores

When migrating companies from legacy environments to the cloud, invariably you run into older hierarchical, flat file, VSAM, ISAM and other legacy data stores. There are many advantages to moving these databases into a relational database structure. The most important which is that most cloud providers run on relational database models. AWS, for example, supports Oracle, SQL Server, and MySQL. The top three 'other reasons' for moving to a relational database are:
1. Data Access – Thousands of database access tools from query creation to business intelligence.
2. Management and monitoring – Hundreds of tools for management and monitoring of the database.
3. Leverage all the free tools from relational database vendors. Free Oracle database tools include:
-Application Express – WYSIWIG browse based application development and deployment.
-SQL Developer – SQL and PL/SQL development. Database object maintenance.
Adding number four based upon feedback:
4. Data quality, integrity, referential integrity and even business logic is embedded in the database.
What is interesting is that Big Data NoSQL databases and XML databases are taking us back to the days of VSAM (key value databases) with NoSQL and IMS (hierarchical) with XML databases?

Monday May 28, 2012

noSQL Hadoop addes ACID with HBase HDFS

noSQL / Hadoop gets ACID and random read access using HBase:
HBase on Apache
However, as this document notes:
1. Relational databases still have many features like typed columns, secondary indices and transactions.
2. Moving from an RDBMS to HBase is not simple. It is an application re-write for the most part.

Wednesday May 09, 2012

Why Integration is done using flat files and FTP ?

Watch this video on why most integration in an organization happens through flat files and FTP:
Enterprise Integration using Flat Files and FTP

Tuesday May 08, 2012

Progress Divesting mainframe integration software

Will be interesting to see which company picks up Progress DataDirect Shadow product:
Shadow for sale

Saturday Apr 21, 2012

Data migration testing - Oracle Flashback Database makes life easier

Whether it is unit, QA, system or development testing using Oracle Flashback database can reduce time and make the process easier
Oracle Flashback for testing on OTN

Monday Apr 09, 2012

Hitachi Data Systems definition of cloud

1. Ability to rapidly provision and de-provision a service. (aka: provisioning)
2. A consumption model where users pay for what they use. (aka: chargeback and showback)
3. The agility to flexibly scale - 'flex up' or 'flex down' - the services without
extensive pre-planning. (aka: elasticity)
4. Secure, direct connection to the cloud without having to recode applications (aka: internet-based)
5. Multi-tenancy capabilitites that segregate and protect the data. (as it says multi-tenancy)

Happen to be I have been talking about 4 of the 5. Did not mention connection to internet as assumed this.

Monday Nov 07, 2011

Oracle Information Integration, Migration and Consolidation - OTN interview part 1

Podcast - Listen here

Physical Vs Virtual in enterprise data centers / private cloud

Interesting article that discusses physical Vs. virtual enterprise data centers. The article discusses physical (Oracle Exadata) data centers. May companies deciding dedicated physical appliances are the best choice for big data applications.

Friday Oct 28, 2011

Migrating to the Oracle Cloud - The approach described

An overview of the migrating to the Oracle cloud 'cookbook' defined in the Migrating to the Cloud book:
Migrating to Cloud Introduction Video

Thursday Oct 13, 2011

Oracle Information Integration and Data consolidation 'in the cloud' Book Link

Was made aware I did not include a link to the book:

Friday Sep 30, 2011

Information Integration, Data migration and consolidation book

The book is now in print:

Friday Aug 26, 2011

Paper Mills as Data Centers

Be interesting to see if this is a growing trend: Looks like an interesting idea since so many paper mills lay empty. Maybe all the mills in Wisconsin and Maine could be converted. Makes sense since these states have a lot of cold air to use for cooling as well.

Migrating legacy client/server and mainframe technologies to the Oracle cloud.


« April 2014