Wednesday Apr 22, 2009

Offshore monitoring of windfarms using GlassFish - MySQL Users Conference 2009 Day 3

John Powell from eMapSite stopped by at the Whisper Suite in MySQL Users Conference earlier today to talk about his GlassFish issue. The possible workaround was suggested and then the discussion became interesting on how GlassFish is used for offshore monitoring of windfarms and process weather forecasting data. Hear all about it and watch a flashy demo of their product in this video:

NetBeans, GlassFish, and MySQL is their development stack with a "very positive experience"!

Stay tuned for the stories entry.

And the complete picture album is available at:

Technorati: conf mysqlconf mysql santaclara glassfish netbeans

MySQL Users Conference 2009 Day 3 - Cloud Shootout

I arrived at the MySQL Users Conference just in time for the The Great Open Cloud Shootout.

Kaj Arno was asking questions to the invited panelists shown in the picture above. Here is a partial discussion:

What is cloud ?

Thorsten Fully automatbale computing infrastructure, changes the way production scale deployments operate, saves time/cost, increases reliability
Chander Elasiticity is an important aspect, Can "shoot for the moon without shooting foot", accessing a pool of resources which is infinite from an individual/organization perspective
Monty Much like electricity/network bandwidth, applying that same model to computing resources
Jeremy Virtualization is an important piece
Lew Not new technology, rather a new way of delivery. As a developer, provision the application through the code.

Who is it for ?

Monty It's for you
Thorsten Amazon launched, mostly for geeks. 2007 -> Amazon skeptical and RightScale gets VC funding, 2008 -> some common usage, 2009 -> Top-down from CIOs. Basically everybody, cross-organiation, vertical
Mike Horizontal technology opportunity, starting to see mainstream applications including ISVs/primary line of business, interest/adoption is growing
Chander Definitely growing for ISVs, makes backup sexy, "Even though running a backup company, expected to be entertaining"
Jeremy Power outlets are shaped differently, technology has not matured enough. Next few years standardization will happen.
Monty People will never notice it exists, but able to access the information
Prashant Putting/Sharing the data on cloud

Why use the cloud ?

Monty All of a sudden facebook traffic, leverage a collective of people who are already investing in an effort
Lew Cloud computing based on virtualization
Mike More & more enterprises moving in the cloud, gain durability & resilience which was not an option because of a single data center
Jeremy Legacy apps are easiest to move into cloud, they are better understood and can scale easily
Prashant Cloud is the right approach/dream, not there yet. Traditional apps can be moved into cloud.
Thorsten Flexibility in development and tests, DBA clone another slave server with exactly the same setup to test out schema changes
Monty Spin up EC2 instances, run the tests and shut them down ... everything in approx $1. Give it back to the cloud and make it more efficient for the world in general.
Lew We are making it so affordable, cost can be 10% of what it was before.

Cloud adoption barrier

Chander Performance, a customer requested a refund where they were trying to shove a 1TB in an hour. US is 6Mbps, needs to significantly increase before it can be utilized.
Thorsten Compute needs to move where the data is.
Chander Most businesses will find bandwidth/redundancy limited. Customer always need to customer where not to use cloud and set expectations accordingly

What apps will never move to cloud ?

Lew Financially sensitive applications, owning your own data center
Chander Trust and privacy, it's more about education though. Encryption is going tobe a key.
Jeremy Competitiion, unless other companies battle it out and making it easy to to migrate from one service to other, it'll be difficult. Avoid vendor lockin.

Are there cloud standards ?

Mike Based on open industry standards,  no deep rooted concern in the user community
Thorsten Way to operate across different clouds, API is not the most important level. What is a server ? Can I hibernate it, mount it, how much storage volume is allowed, cross-data center boundary are a better abstraction.
Lew Very early to lock the standards, everybody is currently in a stage of experiementation
Monty Potential downside to premature standardization, too early to jump to standards
Chander Open standards are a definite key to success. S3 fostered innovation.
Thorsten S3 is a good standard but not an open API. It will be doubly nice if it's "free" or "open" or whatever the word is.
Mike Standards dont really matter if the performance cannot be met. When innovating at a rapid rate, it' difficult to make everybody agree upon standards.
Lew At least publish the API where everybody can use them.
Chander Showing backup to Sun cloud, Sun has S3 compatible APIs, also compatible to WebDAV.

Cloud Business Opportunities

Monty You can
Mike Very unique and compelling business opportunity. Amazon Dev Pay: Buy infrastructure on demand, setup your software on AMI, set your own price and then customers can use it, "Software as a Innuity"
Chander Traditional backup vendors will be worried.
Prashant Database on the cloud
Lew Seeing an explosion in the amount of data/compute required, accordingly analytics. Tremendous amount of opportunity when Cassandra & Drizzle are cloud-enabled.
Mike More ISVs in the cloud.
Jeremy How to do performance tuning and optimizations in cloud, do that for major cloud infrastructure.
Monty Freedom to work from anywhere, don't need to be physically at the datacenter, enables multinational consulting
Chander When more clouds become available, it'll be explosion which will happen later this year.

How is cloud measured ?

Jeremy CPU time in terms of use, storage centric clouds pay for integrity
Lew Creating Data centers with loading docks.
Monty Paying for CPU cycle, like mainframe model.
Thorsten Cloud is like mainframe but very elastic.
Chander Billing is not a challenge, storage clouds are better because of pricing, compute is challenging

Databases & Clouds

Thorsten Flexibility of moving to the next volume, master, slave makes is very refreshing
Monty Start out thinking M x N problems, never think about one database instance in cloud, there will be X > 1

And the shootout had to be shutdown because the timing estimates were slightly misjudged

But all in all, an interesting discussion!

Come meet us at the GlassFish booth in the Exhibit Floor. Or you can stop by at room #205 for the Whisper Suite for a more personal and 1-1 conversation.

Technorati: conf mysqlconf mysql santaclara glassfish cloud

Tuesday Apr 21, 2009

MySQL Users Conference 2009 Day 2

I presented on Creating Quick and Powerful Web Applications with MySQL, GlassFish, and NetBeans. The key messages conveyed during the preso are:
  • GlassFish is an open source community and delivers production-quality Java EE compliant Application Server.
  • GlassFish v2 is the Java EE 5 Reference Implementation and GlassFish v3 for Java EE 6. Read complete difference here.
  • Java Persistence API makes it really easy to create database-backed Web applications. It even creates MySQL-specific queries, when possible.
  • The web-based administration console and CLI are powerful GlassFish management tools that meets the need of any IT administrator.
  • NetBeans provides comprehensive and seamlessly integrated tooling for GlassFish. The goal is to make the Eclipse tooling at par with NetBeans.
The slides are available here.

And then notes from some of the sessions I attended:

State of the Dolphin
  • 12+ million users, 70k downloads/day, 1100 MySQL Partners
  • Multiple platforms: LAMP, Windows, Mac, OpenSolaris, Solaris, RedHat, Suse, Ubuntu
  • Multiple Languages: php, Perl, Python, Ruby, Java, C, C++, C#
  • MySQL 5.1: 3 million downloads in 100 days
  • MySQL 5.4 announced: InnoDB Scalalbility, Sub-query optimizations, 59% faster than 5.1, 40% improvement in read/write test, 71% throughput increase
  • InnoDB: Fast index creation (add/drop indexes w/o copying the data), Data compression (shrink tables, to significantly reduce storage and i/o)
  • Embedded InnoDB (announced today): Proven high-performance and reliability and functionality of InnoDB, low-level but powerful non-SQL API for app programmers, operational characteristics needed for stand-alone apps where there is no DBA
  • Dr DBA was awarded "Acquirer of the Year: Oracle" :-)
  • MySQL Cluster 7.0: 99.999% availability, 4.3x higher throughput, 140k+ TPM and 4x less power and consumption than 6.3
  • MySQL Query Analyzer: Continuous query monitoring, find and fix problem SQL code, historical and real-time analysis, drill down into execution statistics

InnoDB: Innovative Technologies for Performance and Data Protection
  • Dr Heikki Tuuri, was professor at Helsinki, founded Innobase, got acquired by Oracle
  • Performance and Data Integrity are basic features
  • Architected and written by one person
  • Full transaction support, Unlimited row-level locking, multi-version read-consistency, automatic deadlock detection
  • Innovative: adaptive hash indexes, insert buffer (performance benefits), doublewrite buffer, InnoDB plugin
  • Oracle/Innobase + Sun/MySQL
Rethinking MySQL, Enter Drizzle
  • Goals
    • Pluggable/Infrastructure Aware
    • Community Developed
    • Multicore/Concurrency (load up 10,000 connections in db)
    • Focus on Web applications/enable others
    • Modernize codebase for manageability (currently C/C++, can we reuse STL and other libraries)
  • Philosophies
    • Have open and well-documented interfaces
    • Have transparent goals and processes, that are communicated publicly
    • Have fun and encourage collaboration
    • Remove barriers to contribution and participation for everyone
    • Enable contributors to build a business around Drizzle
  • Drizzle announced at OSCON last year
    • Translated into 30+ languages since then
    • 7% of developers are from Sun
    • 100+ contributors (>500 on the mailing list), even Postgres and Firebird developers \\
    • Cirrus available now, Aloha next
    • Drizzle Developer Day 2009 scheduled this Friday
    • No patches are contributed back to MySQL Enterprise
    • Will be ready for production deployment Jun 2010
  • References
High Performance Rails and MySQL
  • David Berube: Apress books on "Author Practical Ruby Gems", "Practical Rails Plugins", "Practical Reporting with Ruby on Rails"
  • Finding performance issues in Rails
    • Rails development log
    • eabe_db_tools: Ajax popup- displays query count, query each time for a each query on a page. Will be available on github next week.
    • mysql_slow_log
    • Is it a database problem: Firebug, YSlow, Ping, tracert, etc.
  • Let the database do the heavy lifting instead of Ruby: for example, don't sort in Ruby
  • Deep eager loading: don't load that is not required
  • Use built-int Rails grouping and aggregate functions
  • Caching: simple ootb caching, Cache Fu, MySQL triggers for DB function caching, Rails triggers for other caching
Did you know 1.3 billion emails were sent as part of Obama's election campaign - and all powered by MySQL ? Hear the details from Blue State Digital engineers who created the solution and maintained it:

And you can always read the complete case study.

Some pictures from earlier today ...

And then the evolving picture album is available at:

Come meet us at the GlassFish booth in the Exhibit Floor. Or you can stop by at room #205 for the Whisper Suite for a more personal and 1-1 conversation.

Technorati: conf mysqlconf mysql santaclara glassfish netbeans

Monday Apr 20, 2009

MySQL Users Conference 2009 Day 1 in Photos

MySQL Users Conference started earlier this morning with tutorials. I attended MySQL Cluster Tutorial and part of Scale-Up, Scale-Out, and High Availability: Solutions and Combinations. Both of them were very involving with practical real-life advice.

Here are tweets from the morning of MySQL Cluster Tutorial:

And now the tweets from "Scale-Up, Scale-Out, and High Availability: Solutions and Combinations" session:

Here are some pictures captured during the day:

And tomorrow I present on Creating Quick and Powerful Web Applications with MySQL, GlassFish, and NetBeans.

And then the evolving picture album is available at:

Come meet us at the GlassFish booth in the Exhibit Floor.

Technorati: conf mysqlconf santaclara glassfish netbeans

Thursday Apr 16, 2009

GlassFish and NetBeans at MySQL Users Conference 2009

What is open source, production-quality, supported by a large vibrant community, and comes with full enterprise support ? - GlassFish and MySQL.

Did you know that GlassFish ...
  • is the only open-source Java EE 5 compliant Application Server
  • can be used to deploy Rails, Grails, and Django applications
  • has 13x better price/performance than Dell/HP, and therefore a much lower TCO
  • has an easy-to-use and intuitive web-based administration console
  • has enterprise features like clustering/high availability, .NET-interoperable Web services, ...
Are you attending MySQL Users Conference 2009 and interested to learn how GlassFish and MySQL together provides an ideal deployment platform for all your web applications ?

There are several other advantages which I'll be speaking on Creating Quick and Powerful Web Applications with MySQL, GlassFish, and NetBeans and the coordinates are:

When: April 21, 2009 (Tuesday), 3:05 pm
Where: Ballroom A

You can also find us on the Exhibitor Floor!

Technorati: conf glassfish netbeans mysql mysqlconf santaclara

profile image
Arun Gupta is a technology enthusiast, a passionate runner, author, and a community guy who works for Oracle Corp.

Java EE 7 Samples

Stay Connected


« July 2016