X

Information, tips, tricks and sample code for Big Data Warehousing in an autonomous, cloud-driven world

Roadmap Update for Big Data Appliance Releases (4.11 and beyond)

Jean-Pierre Dijcks
Master Product Manager

With the release of BDA version 4.10 we added a number of interesting features, but for various reasons we did slip behind our targets in up taking the Cloudera updates within a reasonable time. To understand what we do before we ship the latest CDH on BDA and why we think we should spend that time, review this post.

That all said, we have decide to rejigger the releases and do the following:

  1. Focus BDA 4.11 solely on up taking the latest CDH 5.13.1 and related OS and Java updates, thus catching up in timelines to the CDH releases
  2. Move all features that were planned for 4.11 to the next release, which will then be on track to uptake CDH 5.14 on our regular schedule

So what does this mean in terms of release timeframes, and what does it mean for what we talked about at Openworld for BDA (shown as a image below, review full slide deck incl. our cloud updates at the Openworld site)?

BDA version 4.11.0 will have the following updates:

  • Uptake of CDH 5.13.1 - as usual, because we will be very close to the first update to 5.13, we will include that and time our BDA release as close to that as possible. This would get us to BDA 4.11.0 around mid December, assuming the CDH update retains it dates
  • Update the latest OS versions, Kernel etc. to update to state of the art on Oracle Linux 6, and include all security patches
  • Update MySQL, Java and again ensure all security patches are included

BDA version 4.12.0 will have the following updates:

  • Uptake of CDH 5.14.x - we are still evaluating the dates and timing for this CDH release and whether or not we go with the .0 or .1 version here. Goal here is to deliver this release 4 weeks or so after CDH drops. Expect early calendar 2018, with more precise updates coming to this forum as we know more.
  • Include roadmap features as follows:
    • Dedicated Kafka cluster on BDA nodes
    • Full cluster on OL7 (aligning with the OL7 edge nodes)
    • Big Data Manager available on BDA
    • Non-stop Hadoop, and proceeding on making more and more components HA out of the box
    • Fully managed BDA edge nodes
  • The usual OS, Java and MySQL updates per the normal release cadence
  • Updates to related components like Big Data Connectors etc.

All of this means that we pulled in the 4.11.0 version to the mid December time frame, while we pushed out the 4.12.0 version by no more then maybe a week or so... So, this looks like a win-win on all fronts.

Please Note Safe Harbor Statement below:

The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Join the discussion

Comments ( 4 )
  • Boris Sunday, April 29, 2018
    Hi Jean-Pierre, thanks for sharing your plans! we love BDA and everything you do to make it better! I would like to understand a bit more about support for Edge nodes (not CDSW one but generic edge node for dev and such) and also about Kafka - is Oracle going to support Kafka with BDA or this is just a convenience without support?
  • Jean-Pierre Tuesday, May 1, 2018
    Hi Boris,

    Regarding Kafka, on BDA (and in cloud) it is included with license and support for all of the the CDH stack. So Kafka is a supported component with your BDA.

    On support for edge nodes, there are a few MOS notes worth reading. We have done a lot of work to make upgrades simpler even with edge nodes. Our long term roadmap has an item on "managed edge nodes" where we would do a bunch more. Is that what you are looking for?

    Thanks,
    JP
  • Boris Tuesday, May 1, 2018
    Thanks Jean-Pierre. This is great to know, we are just exploring Kafka and it made my day knowing that it is supported with BDA. I am really happy we went with BDA vs. home built cluster. Please keep up the great work you guys are doing!
  • Greg Friday, June 15, 2018
    Hi, Jean-Pierre,
    I want to echo Boris' comments regarding Oracle's support for Kafka on BDA. Really great. Curious if you/Oracle have or can recommend any best practices for upgrading BDA where Kafka is running 24x7. Rolling upgrades are (I assume) preferred, but a couple of years ago, when I was working on non-BDA clusters, I was taught that Kafka nodes should be handled with greater care than a normal upgrade, even a rolling one. Recommendation at the time was to take a portion of the Kafka nodes out of service at a time, upgrade them, bring them back online, let the upgrade burn-in for a period of time, then do the remaining servers. Perhaps overly cautious, but I was curious if anyone at Oracle has any best practice recommendations regarding Kafka and availability during upgrades.

    Thanks!
Please enter your name.Please provide a valid email address.Please enter a comment.CAPTCHA challenge response provided was incorrect. Please try again.Captcha
Oracle

Integrated Cloud Applications & Platform Services