Thursday Jan 10, 2013

Data Extraction for Sub-sets of Accounts v2

As a follow-up to my earlier posting in relation to the extraction of sub-sets of data, I have been able to extend the solution to offer the ability to extract larger volumes of data (by spooling each output file to its own output file), and also offer the ability to perform mass purges of data via the same framework. This tool is intended for use with CC&B currently, but the solution should support users extending it to include all OUAF products (as long as the user can link the records back to an Account ID.

Once again, post a comment if you are interested in getting a bit more information in relation to this set of scripts.

Tuesday Feb 21, 2012

Data Extraction for Sub-sets of Accounts.

Migrating sets of data to support testing has been an issue on a number of projects that I have been involved in, with most sites requiring a method of transferring subsets of accounts from Production to other CC&B environments.

The ConfigLab framework supports the ability to perform Account Sync actions, but these have a couple of limitations:

  1. the transfer is expected to be performed via ConfigLab database links, so both CC&B instances must be visible to each other via Database links.
  2. whilst the process is quick for small amounts of accounts (< 100), performance degrades very quickly if large amounts of accounts are scheduled to be processed.
  3. The changes required to ensure that the resulting data does not contain any customer-specific identifiers can be onerous (i.e. difficulty in producing anonymous data).

As a result I have been working on a set of extract tools which will generate SQL insert statements, which can then be zipped and transferred to a separate CC&B instance, to be used when populating the target database (i.e. offsite development, system testing, etc).

This should enable mass transfers, with the only limitation being the resulting size of the resulting SQL script, and your ability to transfer it to the target database.

Drop me a quick comment if you would like more details..

About

Stuart Ramage

I am a Consulting Technical Manager for Oracle Corporation, and a member of the OU Black Belt Team, based in Hobart Tasmania.
I have worked in the Utility arena since 1999 on the Oracle UGBU product line, in a variety of roles including Conversion, Technical and Functional Architect.

Contact me on:

Search

Categories
Archives
« April 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today