Entries from Oracle Warehouse Builder (OWB) Weblog tagged with 'ETL'

OWB 11gR2 – Bulk File Loading - more, faster, easier

A common problem in warehouses is to load a number of similar files into the database, often the filenames are dynamic so the names cannot be hard-wired, if they are known its easy enough to configure the external table or...

OWB 11gR2 – Architecture Overview

This post gives an overview of the OWB 11gR2 code template framework and runtime infrastructure, the code template framework is a key component in the product's customization and open connectivity capabilities. This framework enables OWB to integrate much more data...

Oracle Warehouse Builder 11gR2

Great news, today Oracle released the Linux x86 and x86-64 versions of 11gR2 for the Oracle Database which includes Warehouse Builder (see Oracle Database 11gR2 here). Nice to finally see all the hard work eventually come to fruition. This has...

Matching Abbreviations and Acronyms

A quick post on how to match data using composite match rules for matching abbreviations or matching acronyms. For example we want to match the following tokens; International Business Machines Intl Bus Machines IBM One of these is a full...

Pattern Matching Conditions

The Oracle database has a range of powerful regular expression based pattern matching functions that can be used to filter and match data, in OWB for example conditions can be used in many places such as filters and joins. This...

Parallel Unload to File

Here we see how to to construct a parallel unload mapping leveraging the Oracle Database parallel table function capabilities to write the results from a PLSQL Ref Cursor to file. The example also illustrates how the table function arguments are...

Writing Master Detail Files

I've seen this question a few times about how to write a master detail file using OWB, so thought a quick post was in order. Here you'll see a technique for writing such files and using the union all and...

Book: Getting Started with OWB 11g

Just got a note on this new book on OWB 11g. Might be a great resource for those working on OWB to augment the user documentation and see someone else's take on the OWB world. Book is here: http://www.packtpub.com/getting-started-with-oracle-warehouse-builder-11g/book Enjoy!...

Why does it take forever to build ETL processes

ETL is a lengthy process... what can you do about it?

File staging using external table preprocessor

Here is a quick write up of how to take advantage of the external table preprocessor feature which was squeezed into the 11.1.0.7 and 10.2.0.5 database patch sets from within OWB. OWB has rich metadata support for file design and...

Headless Operation – OWB code generation, going it alone

There are a few different implementation scenarios for moving designs from OWB into an execution environment, out of the box OWB has a runtime service component which supports deployment and execution of all of OWB's design objects. The standard deployment...

Process Flow Variables – To Quote or Not To Quote

Here is some information on the process flow variable literal quote or not quote query. Its not exactly intuitive, so hopefully this helps! The flow designer has to know what is a PLSQL activity and what is not. Process flow...

Oracle Warehouse Builder for SAP ETL: OWB SAP Application Connector

The OWB SAP connector has been around for several releases now and is a mature product being used successfully by many OWB customers. However, the public documentation on the connector has been rather sparse and in need of a refresh... We recently updated the material to provide a lot more detail on how the connector works and how to use it. You can get the full details here, in the OWB Connector for SAP documentation.

Want to learn more about the HP Oracle Database Machine?

Here is your chance, sign up now to attend the Oracle BIWA Summit 2008 Dec. 2-3. Attend this unique two-day IOUG Business Intelligence, Warehousing and Analytics (BIWA) SIG (www.oraclebiwa.org) event to gain the knowledge and information critical for success in...

Data types - using complex data types in ETL

Not sure this is a widely known fact, but one of the changes we made in OWB 10.2 (and up of course) is the extensive support for complex Oracle data types. Areas such as spatial data will benefit from this...

Comments, questions and the forum

When going through the blog I noticed some comments actually are questions. Not sure if everyone knows, but there is a very active product forum on OTN. The link has changed over the past couple of weeks, so make sure...

Event Based Execution - File Arrival Example

If you want to do truly event based execution based on arrival of a file there is a convenient package supplied with the Oracle database scheduler component that can be used, the package can be downloaded from OTN here. For...

SQL for workspace enablement

As a quick follow up on my post on accessing SQL views in 11g OWB, here is a simple one if you are in SQL Dev or SQL Plus: begin owbsys.wb_workspace_management.set_workspace('workspacename', 'workspaceowner'); owbsys.start_enable_owb_roles; end; Replace the italics for workspacename and...

Sizing an OWB system...

Should I even go here...? Maybe not, but one thing that I thought would be interesting to mention here is an avenue to take when you are struggling with sizing. Yes, this will have loads of disclaimers but might be...

OWB Public Views in 11g Release 1

In OWB 11g the repository is a set of workspaces. In the public views this means you need to set the workspace context.This is not an issue from within a map as the workspace context is set prior to invoking...