Wednesday Jan 22, 2014

New CAM XML Editor v3.1 and CAMV validation release now available

The focus for this release is enhancements, bug fixes and performance improvements for both the CAM editor and CAMV validation engine.

The new CAM Editor V3.1 provides the following improved functionality:

  • Enhanced XSD schema importing especially for HL7, GML, OAGi and NIEM complexities
  • New UTF-8 handling to improve international support in elements and annotations
  • Editor entry of annotations improved and enhanced
  • Better XML example generating details (choice items, negative numbers and repeat limits)
  • Improved xsd:annotations handling during import processing (faster + suppress duplicates)
  • Improved bi-directional data processing using Open-XDX for open data query and update
  • Feature and bug fixes for the CAMV rules engine
  • CAMV now allows mixed content for validation

Available from

Monday Nov 04, 2013

Creating, using and managing XML component dictionaries quick tutorials

XML Component Dictionary capabilities are provided in conjunction with the CAM Editor toolset.  These dictionaries accelerate the development of consistent XML information exchanges using standard sets of dictionary components.

The quick tutorials are aimed at showing the 'how to' of the basic capabilities to jump start use of XML dictionaries with the CAM Editor.

The collection of dictionary tutorials videos run for a total of approximately 20 minutes.  Each video can be reviewed individually also.

Learn how to use the dictionary functions to create dictionaries by harvesting data model components from existing XSD schema, SQL database table schema, or simple Excel / Open Office spreadsheets with tables of components listed.

Also included are tips and functions relating to use of NIEM exchange development, IEPD and EIEM techniques.

These videos should be viewed in conjunction with reviewing the overall concepts and techniques described in the companion video on the CAM Editor and Dictionaries overview.  The approach is aligned with OASIS and Core Components Technical Specification (CCTS) standards specifications for XML components and dictionaries.

Dictionary collections can be stored locally on the file system, or local network, or collaboratively on the web or cloud deployment, or can be shared and managed securely using the Oracle Enterprise Repository (OER) tool.

Also included are techniques relating to the use of the NIEM approach for developing XML exchange schema and IEPD packages.  This includes generating reuse scores, wantlist, and cross reference spreadsheets.

Included in the latest release of the CAM Editor is the ability to use the analyse dictionary tool to determine duplicate components, conflicting component definitions, missing component descriptions and so on.  This ensures high quality dictionary component specifications.  Using the CAM Editor you can also create MindMap models and UML physical models of your dictionary components sets.

For a complete guide to using the CAM Editor see the main YouTube video tutorials website and the CAM Editor website.

Monday Oct 21, 2013

Oracle BPM and Open Data integration development

Rapidly developing Oracle BPM application solutions with data source integration previously required significant Java and JDeveloper skills. Now using open source tools for open data development significantly reduces the coding needed.  Key tasks can be performed with visual drag and drop designing combined with menu selections entry and automatic form generation directly from XSD schema definitions.

The architecture used is extremely lightweight, portable, open platform and scalable allowing integration with a variety of Oracle and non-Oracle data sources and systems.

Two videos available on YouTube walk through the process at both an introductory conceptual level and then a deep dive into the programming needed using JDeveloper, Oracle BPM composer and Oracle WLS (WebLogic Server) along with the CAM editor and Open-XDX open source tools.

Also available are coding samples and resources from the GitHub project page, along with working online demonstration resources on the VerifyXML site.

Combining Oracle BPM with these open source tools provides a comprehensive simple and elegant solution set. Development times are slashed and rapid prototyping is enabled. Also existing data sources can be integrated using open data formats with either XML or JSON along with CRUD accessing via the Open-XDX Java component. The Open-XDX tool is a code-free approach where data mapping is configured as templates using visual drag and drop in the CAM Editor open source tool.  XML or JSON is then automatically generated or processed (output or input) and appropriate SQL statements created to support the data accessing.  

Also included is the ability to integrate with fillable PDF forms via the XML templates and the Java PDF form filling library.  Again minimal Java coding is needed to associate the XML source content with the PDF named fields. 

The Oracle BPM forms can be automatically generated from XSD schema definitions that are built from the data mapping templates.  This dramatically simplifies development work as all the integration artifacts needed are created by the open source editor toolset.

The developer level video is designed as a tutorial with segments, hands-on demonstrations and reviews.  This allows developers to learn the techniques and approaches used in incremental steps. The intended audience ranges from data analysts to developers and assumes only entry level Java skills and knowledge.  Most actions are menu driven while Java coding is limited to simply configuring values and parameters along with performing builds and deployments from JDeveloper and Oracle WLS.  

Additional existing Oracle online training resources can be referenced on Oracle BPM and WLS that cover other normal delivery aspects such as user management and application deployment.

Monday Aug 05, 2013

New CAM v3.0 ships with JSON support and significant performance enhancements

Today we released the new and significantly improved CAM editor toolset along with 3 new companion 'How to' quick videos (see here to view).

The main focus is integrating JSON handling alongside the existing XML capabilities to provide developers with the ability to use either or both from the single set of infrastructure.

This provide JSON developers with the ability to quickly build visual data models, use robust XML content validation services and generate XSD schema and JAXB bindings without having to do all those tasks by hand or know the nuances of complex XSD schema or XML handling.

For XML developers it provides a rapid ability to use JSON as an option in their information exchanges and web service integration for supporting mobile and web-based application needs.

In addition to these new JSON capabilities the existing functionality has significantly improved performance and capability.  The CAMV validation engine now runs up to 20 times faster for large XML validation input and with templates containing setChoice() rules.  For comparison a 500+ rules validation template with large 15MB sample COBie CAD/CAM smart building XML export now runs in 19 seconds instead of previously taking over 9 minutes.

Then the drag and drop dictionary components handling has similarly been significantly improved.  Large sets of components now are inserted in real time with low memory overhead thus dramatically improving the user experience and ability to quickly build information exchanges from XML dictionaries of predefined domain components.  The video shows using the Education domain to rapidly build a StudentDetails report with grades, achievements and student data.

For the Open-XDX open data API toolset we have added bi-directional support.  This means using the same CAM template and the SQL drag and drop interface you can design Update/Insert SQL database web services along with the query services.  Again the focus is on providing simple and rapid application development support.  Example code and resources can be found at our GitHub site while on line demonstrations are available from the site.

Further enhancements include a new Dictionary Evaluation report.  This tool analyzes the XML components in a dictionary and highlights design issues, omissions, duplicates and more that would be extremely tedious to detect by hand.  This allows a development team to collaboratively improve the quality of their core components and their reuse across a project implementation.

Last but not least we have improved the XSD schema importing and exporting resolving a range of complexity nuances not previously handled allow improved accuracy and compatibility with XSD schema.

In summary the new release provides:

o All new JSON capabilities and template type
o Bi-directional data processing using Open-XDX for open data query and update
o Dramatically improved Dictionary components drag and drop
o New report for Dictionary evaluation and analysis
o Significant CAMV rules engine performance improvements
o Better XSD schema importing and exporting

We look forward to seeing the enhanced solutions this helps people deliver to their customers.

Wednesday Mar 27, 2013

New CAM Editor v2.4 release with enhanced Collaboration tools

The focus for this release is improved collaboration support including better dictionary generation, models, reports, spreadsheets and enhancement of the rules entry tools and rules processing. New for this release is support for Italian language localization.

The new XPath conditional rule entry wizard makes XPath rules definition significantly easier for cross-field validations and more. We have also improved the rule handling in the CAMV engine to be more consistent.

For collaboration the locations of dictionaries collections can now be located at a URL, a file system or stored in the Oracle Enterprise Repository (OER). Coupled with this are now the consistent dictionary collections and database connections manager tools for configuration management. Also better generation of dictionaries from spreadsheets and a new spreadsheet to dictionary utility XSLT tool. Dictionary XML component generation has also been improved adding a new Components section to itemize components in dictionaries along with more and more consistent handling for dictionary content types, rules and annotations.

The template evaluation report and NIEM NDR (Naming and Design Rule) checking is improved including better representation terms.

The XSD schema importing and exporting now supports the use of Appinfo tags for application specific detailing of exchange data relationships.

For models we have enhanced the Mindmaps to include color coding of Added and Updated annotations plus SQL DBmappings and choice items.

For reports we have added a new Export to XML option for the popular Tabular Report view. This exported XML is compatible with importing into an Excel spreadsheet or can be custom rendered using a stylesheet or XSLT transformation.

Several enhancements have been made to the CAMV validation engine along with XSD schema generating and annotations handling. For Open-XDX SQL data integration we now have a nifty utility that can generate MySQL database tables from CSV text file data exports.

In summary the new CAM Editor V2.4 provides the following improved functionality:

  • All new XPath rules entry Wizard tool

  • Significantly enhanced Dictionary generation

  • Collaboration support including Oracle Enterprise Repository (OER) and URL locations

  • Better dictionary collection and SQL database connections management

  • Enhanced Mindmap model generating

  • XML export format for Tabular Report View

  • Italian language localization

  • CAMV rules engine improvements

  • New spreadsheet handling utilities

  • More consistent NIEM NDR evaluation

    To download the latest software please see the download site.

    Saturday Jan 12, 2013

    The non-UTF-8 encoding character invalid byte sequences error

    An ongoing issue for XML transactions processing is UTF-8 character conformance. In an ideal world your computer should simply process your information content stream, store it and step on.  XML engineers however have other ideas.

    Content created in Microsoft Excel or Word or in a Web page application on a Windows desktop is by default using the Windows 1252 character set, however often this content ends up in XML document instances labelled as UTF-8 encoding.

    A conforming XML parser such as Xerces will then kick out invalid byte code sequence errors when attempting to process the content.  Turns out the really simple answer is to change the encoding statement in the XML prolog to say "Windows 1252" e.g.

    <?xml version="1.0" encoding="Windows-1252" standalone="yes"?>

    and then retry. Of course if you know you are using a different character encoding substitute that for the Windows-1252 value here instead.

    Now for automated batch processes you will need a simple piece of XSLT to switch / add the correct encoding.

    You can find out more tips and tricks on all this - plus links to XSLT tools to help with this from the CAM Editor wiki page.

    Another issue is simply locating the offending characters inside an XML instance - for that you can use this handy command line grep statement:

    grep --color='auto' -P -n "[\x80-\xFF]" file.xml

    All this then allows you to diagnose potential character set conflicts and hopefully then build smoothly functioning XML interfaces.  For XML content validation you can of course use the CAMV validation engine - and you can find out more on that from this YouTube resource site showing a video on the topic (also included are various NIEM training aspect too).

    Monday Nov 05, 2012

    XML Rules Engine and Validation Tutorial with NIEM


    On the technical XML side the video introduces XPath validation rules and illustrates and the concepts of XML content and structure validation. CAM validation templates allow contextual parameter driven dynamic validation services to be implemented compared to using a static and brittle XSD schema approach.

    The SQL table lookup and code list validation are discussed and examples presented.

    Features are highlighted along with a demonstration of the interactive generation of actual live XML data from a SQL data store and then validation processing complete with errors and warnings detection.

    The presentation provides a primer for developing web service XML validation and integration into a SOA approach along with examples and resources. Also alignment with the NIEM IEPD process for interoperable information exchanges is discussed along with NIEM rules services.

    The CAMV engine is a high performance scalable Java component for rapidly implementing code-free validation services and methods. CAMV is a next generation WYSIWYG approach that builds from older Schematron coding based interpretative runtime tools and provides a simpler declarative metaphor for rules definition.


    Thursday Oct 25, 2012

    SQL to XML open data and NIEM training video posted

    Learn how to build a working XML query/response system with SQL database accessing and XML components from example NIEM schema and dictionary.

    Software development practitioners, business analysts and managers will find the materials accessible and valuable in showing the decision making processes that go into constructing a working XML exchange.

    The 22 minute video available online shows how to build a fully working ULEXS-SR exchange using a Vehicle license search example.  Also included are aspects of NIEM training for assembling an IEPD schema with data models.

    Materials are focused on practical implementers, after viewing the instruction material you can use the open source tools and apply to your own SQL to XML use cases and information exchange projects.

    All the SQL and XML code, editor tools, dictionary and instructions that accompany the tutorial video are also available for download so you can try everything yourself. 

    See to run the video.

    And the open source project web site (sponsored by Oracle) contains all the resources, downloads and supplemental materials.


    Tuesday Oct 09, 2012

    SQL to XML open data made simple

    The perennial question for people is how to easily generate XML from SQL table content?  The latest CAM Editor release really tackles this head on by providing a powerful and simple toolset. 

    Firstly you can visually browse your SQL tables and then drag and drop from columns and tables into the XML structure editor.   This gives you a code-free method of describing the transformation you require.  So you do not need to know about the vagaries of XML and XSD schema syntax.

    Second you can map directly into existing industry domain XML exchange structures in the XML visual editor, again no need to wrestle with XSD schema, you have WYSIWYG visual control over what your output will look like.

    If you do not have a target XML structure and need to build one from scratch, then the CAM Editor makes this simple.  Switch the SQL viewer into designer mode, then take your existing SQL table and drag and drop it into the XML structure editor.  Automatically the XML wizard tool will take your SQL column names and definitions and create equivalent XML for you and insert the mappings.

    Simply save the structure template, and run the Open Data generator menu option, and your XML is built for you.

    Completely code-free template driven development.

    To see this in action, see our video demonstration links and then download the tools and samples and try it yourself.

    Sunday Oct 07, 2012

    New CAM Editor v2.3 with Open-XDX for Open Data APIs

    Creating actual working XML exchanges, loading data from data stores, generating XML, testing, integrating with web services and then deployment delivery takes a lot of coding and effort. Then writing the documentation, models, schema and doing naming and design rule (NDR) checks and packaging all this together (such as for NIEM IEPD use).

    What if there was a tool that helped you do all that easily and simply?

    Welcome to the new Open-XDX and the CAM Editor!

    Open-XDX uses code-free techniques in combination with CAM templates and visual drag and drop to rapidly design your XML exchange. Then Open-XDX will automatically generate all the SQL for you, read the database data, generate and populate the valid output XML, and filter with parameters. To complete the processing solution Open-XDX works with web services and JDBC database connections as a callable module that can be deployed plug and play with your middleware stack, all with just a few lines of Java code (about 5 actually).

    You can build either Query/Response or Publish/Subscribe services from existing data stores to XML literally in minutes. To see a demonstration of using Open-XDX, a MySQL data store and integrating with Oracle Web Logic server please see this short few minutes video -

    There is also a Quick Guide available that provides more technical insights along with a sample pack download of templates and SQL that you can try for yourself.

     To view online demonstrations of using Open-XDX see the site and GitHub resources.

    Head on over to our project resource site to learn more, download the latest CAM Editor and see links to all the resources and materials.

    We look forward to seeing how the developer community is able to jump start information sharing initiatives using this new innovative approach.

    Tuesday Oct 02, 2012

    Dr Dobbs, Mindmaps and XML Design

    Good to see that someone else has picked up on this. Of course we have had this feature in the CAM Editor ( now for over a year - so happy to see mainstream spotting how useful this is as well.

     Plus nice summary of the advantages - see the Dr Dobb's article here.

    Friday Jul 20, 2012

    Is Windows 7 as good as Ubuntu 12?

    Have you made the switch yet, or are thinking about making the switch?  If you are a long term Windows user of course this is a daunting proposition, akin to changing jobs and moving house; so much to think about and then what incentive do you have?  Then what about all those Windows applications you know and need?  More on that shortly.

    An external event was the trigger for myself.  My Windows XP system crashed with the familiar "blue screen of death" that then unseen had corrupted the disk drive boot sector.  Now I had to re-install the whole OS.  The machine was already a "dual-boot" Windows/Ubuntu 10, but I'd only been sparingly using Ubuntu to that point.   So here was my point of decision, so I thought I would give Ubuntu a second try, with the latest release as I knew it at least is a much faster and easier install. 

    Once I had recovered the data off the original hard drive Windows partition using an external USB disk mount device; then the next step was installing Ubuntu 12.04 stable release on a new disk drive.  Download the Ubuntu ISO CD ROM image from the internet, and burn to CD or USB stick, then boot and install (side note: for full 64 bit Ubuntu use the AMD 64 image - don't use the Intel labelled image - those are only 32bit). The install proceeded smoothly - but if you get stuck there are good help resources just a Google search away - simply follow the pattern "Ubuntu 12.04 {error message}".  More side notes - having 8Gig of DRAM in my Dell laptop, I setup a 16Gig swap partition, and used 20Gig for the base root partition size, then allocated the remainder of the new drive (750Gig) to the working home partition.  This gives plenty of space, so don't use smaller sizes as it will limit functionality later.

    So here is Ubuntu 12 running happily on my Dell laptop, but what about all my desktop applications?  The key "go to" applications, Firefox and Chrome web browsers, Thunderbird Email client, Lightning calendaring and more all run natively in Ubuntu and are a simple install from the Software Center Apps library tool in Ubuntu.  Similarly for a whole range of other tools, multimedia, videos, graphics and social applications, including Skype.  Then you can choose from Open Office and the Libra Office suite, and of course the Cloud suites like Google Docs run seamlessly.

    So this only leaves Microsoft Office. For that you will need to download and install the Virtual Box software and then load your Windows 7 boot disk into the virtual box along with then installing your Microsoft Office suite.  Side note for Oracle folks internally - download and install the Oracle virtual box tool from the My Desktop center, you can do this via a VPN connection, and then download and install the Oracle OBI image (connect your machine directly to your network router while doing this step).

    Once the dust has settled on all this installing comes the moment of truth, how well does this all perform really compared to a native Windows 7 install?  In my opinion, the Windows 7 comes in a distant second, so here are some reasons why.

    1) Boot speed and stability of the multi-tasking.  Ubuntu boots in less than 1 minute from cold, and in less than 15 seconds in warm hibernate, or just 3 seconds from sleep mode.   This makes Ubuntu way more flexible and accessible through your working day and travels.  

    2) The Windows 7 virtual box loads faster - about 3 minutes - than Windows natively booting - which on my other laptop takes a full 10 minutes plus to load.  Setting the virtual box to full screen in its own desktop space, you have no idea you are not running Windows natively, except you can instantly toggle to Ubuntu and share files via a networking drive space between My Desktop on Windows and your /Home folder on Ubuntu.

    3)  What about the drag and drop, cut and paste and all that Windows user interface experience? Yes Ubuntu desktop does all that too; remember the MacOS is from the same OS lineage so you have all the same tools.  Plus you have much better multi-tasking and multi-desktop support.

    4) Its not just boot speed - its all the applications as well.  Ubuntu is significantly faster to load and run applications.  And web browsing and applications are similarly much faster.  For example my SmartFTP client on Windows takes at least a couple of minutes to load my web site file system from my hosting service provider.  In Ubuntu the FTP client is native built-in via the Folders tool and it is instantaneous.   Yes, instantaneous; connects, shows me my folders and allows me drag and drop navigation and file management.

    5) Productivity - this all adds up to Ubuntu providing you with significantly more productivity on a daily basis.  Here's some tips and ideas to install and try.   

    6) Disk imaging and backups.  The lesson learned here is that you need high quality disk images of your base configuration along with backups of your working documents on a daily basis.  Here again Ubuntu excels,  using the Redo Backup and Recovery tool you can rapidly disk image your basic system, then clone this to another drive.  Plus Ubuntu has built-in daily backup services tool that actually work without having to buy third party tools.

    The caveat is that this is all not a simple one hour task.  Getting everything configured and installed does require a chunk of time, depending on how comfortable you are with installing and setting up your operating system and tools.  At the end of the day however, it is very much worth the investment particularly if you are a power computer user who expects more from your computer environment.

    Now I'm looking for a high quality "I've made the switch" bumper sticker with a classy Ubuntu graphic logo.  I've order my "Powered by Ubuntu" stickers already for the laptop.

    Footnote:  OSCON 2012 - OSS and the Economy

    Saturday Jul 14, 2012

    CAMV and TEAM Engine (Test, Evaluation, And Measurement) suite development

    The CAMV engine is ideal for rapidly developing Test, Evaluation, And Measurement (TEAM) test suites for XML information exchanges.  The concise CAM rules syntax leverages XPath v2.0 capabilities. This means that rules are declarative along with acting directly on the XML structure and hence this dramatically simplifies rule assertions. 

    Coupled to this is the ability of the CAM Editor visual IDE to automate much of the tasks involved in test suite and Compliance and Interoperability Testing development and implementation.  This includes automatic harvesting of rules from existing XSD schema definitions, automatic generation of XML test instances with realistic test data hints, and generation of HTML documentation of the business rules. Then rule entry wizards simplify the task of rule entry and are accessible via a "right click" popup menu tool directly from the XML instance structure viewer in the CAM Editor IDE. Compliance test rules are implemented in XPath language syntax that can be run interactively in the CAM Editor IDE against XML test instances and results visually diagnosed.  Completed rules templates may then be deployed via ANT scripts as automated test suites for validation of arbitrary XML information exchange samples.  The ANT scripts support use of drop folders, so any test cases dropped into the designated folder will then be inspected and validated against the applicable rules templates.

    For more information on utilizing these techniques and tools, along with sample Test Suites please see the resources site for the CAM tools - and the CAMV Test Suites link.

    Tuesday Jun 12, 2012

    NIEM / LEXS starter kit now available with JAX-WS and JDeveloper examples

    The Oracle NIEM team is pleased to announce the availability of a starter kit to assist in rapidly developing NIEM solutions using Java. The kit uses the LEXS 3.1.4 Search/Retrieve schema as examples.

    You can find out more and download the how to step by step guides along with sample source code from this link here.

    Friday Jun 08, 2012

    CAMツールキットは、XMLビジネス情報交換を開発し、管理するプロセスを劇的に簡素化するための "WYSIWYG"ヴィジュアル構造化エディターを使用して直感的なアプローチを提供する。

    CAMエディターは、XML交換を組み立て、配置するための先端的で、オープンな基本ツールキットである。CAMツールキットは、XMLビジネス情報交換を開発し、管理するプロセスを劇的に簡素化するための "WYSIWYG" ヴィジュアル構造化エディターを使用して直感的なアプローチを提供する。このことは、開発者に、安定し、相互運用性があり、信頼性のある交換のために必要な管理、洞察そして分析を提供する。


    • 構成要素集辞書からXML交換構造をヴィジュアル・ドラッグ&ドロップによる作成
    • XSDスキーマとしてデータモデルをインポート、及び WSDLを生成し又はXML交換を強化
    • NIEM, OASIS, WSDLのようなプロファイルを用いて、 モデル準拠のXMLスキーマの生成
    • スキーマ設計品質評価の評価報告
    • 正規モデル辞書の管理と生成
    • 業界標準 XML枠組みの支援
    • UML/XMIによる交換のモデル化
    • ランタイム実証エンジン “CAMV Java モジュール”
    • コードリストとSQLテーブル検索 評価ツールとランタイム CAMV
    • XPath 表現テンプレートを用いて、業務論理ルールの評価
    • 内容の暗示により、XMLインスタンス例を生成
    • CAMVの “ANT スクリプティング” を用いた XMLテストスーツ
    • XMLエディター及び統合開発環境
    • メニューと書式に関する各種言語の支援

    CAMエディターは、現在のXMLスキーマ交換をより良い互換性を保ってインポート、分析そして反応できる、かつ、ミドルウェアで使用できる。完全なXML交換構造、規則及び文書化の詳細は、OASIS CAM標準XMLテンプレート書式で保存されている。 OASIS CAM は、公開のオープンな標準である。

    CAMツールキットはまた、業務の文書化、相互参照表、モデル、XMLスキーマやテストXMLインスタンス等を支援する加工品を生成する作業を自動化する。このことは、 NIEM, OASIS他のための拡張プロファイルによる情報交換統合のためのNIEM アプローチと互換性がある。


    独立CAMV評価エンジンは、Javaで書かれた、基礎としてOASIS CAM仕様を使用して、XML評価枠組みを実施する。また、サービス指向アーキテクチャー (SOA) と共に統合化のために設計された、CAMV XML評価枠組み支援は、 企業アプリケーション統合 (EAI), LEXS (論理的エンティティ交換システム) や ebXML メッセージングシステムの様な他のメッセージを基礎とする統合化パターンとの使用を支援するものである。



    Not all XML is created equal. XML Orb looks at the challenges of creating information exchanges with XML and NIEM and how this can be made simpler, comprehensible, consistent and reliable.


    « June 2016