X

Geertjan's Blog

  • October 3, 2013

Maintaining Weather Data with Oracle DB and NetBeans

Geertjan Wielenga
Product Manager

Servei Meteorològic de Catalunya is the public entity
responsible for collecting and storing weather data in Catalonia. The most valuable data comes from weather
stations based throughout the region. Each weather station has
sensors to measure different kinds of variables, such as temperature,
humidity, and pressure.


Weather stations are polled regularly, data is processed, andstored in an Oracle database that contains around 350 million records. The application responsible for the processing and storing of the data is based on the NetBeans Platform.


The figure below shows the configuration panel where a data source is specified for each weather station.




Once configured, weather stations process data in multiple threads, so as to reduce data latency, which is measured
by a datalogger.

The next figure shows how processes are monitored. Via pause and play
symbols, the application shows details such as which threads are working and the time spent on processing weather data.




While processing is taking place, graphical views help visualize the data. The next figure shows a temperature chart from a weather station, visualizing how temperature evolves over time:




In addition, the application is responsible for the storage of data. Different environments are handled, such as "production" and "development" and the program allows for the insertion of records in multiple databases.

The next chart enables the data insertion process to be monitored:




Thanks to the window system that is a standard part of the NetBeans Platform, it is possible to display multiple types of information simultaneously, as a dashboard:

Development tools and technologies: NetBeans IDE, NetBeans Platform, Oracle JDBC driver, Oracle DB, Quartz scheduler, and JFreeChart.

With thanks to Antonio Santiago Pérez, from Servei Meteorològic de Catalunya, who provided all the information above, as well as the screenshots.

Join the discussion

Comments ( 1 )
  • guest Wednesday, December 18, 2013

    Hi, Am looking for further details on how weather data is stored in Oracle Spatial.

    1) Is it the raw data or processed data being stored in database?

    2) Was there any analytical modeling applied on Oracle DB for weather analysis?

    3) What were the data formats that were processed? Is it digital data or HDF ?

    Pl share some thoughts around this.


Please enter your name.Please provide a valid email address.Please enter a comment.CAPTCHA challenge response provided was incorrect. Please try again.