Maintaining Weather Data with Oracle DB and NetBeans

Servei Meteorològic de Catalunya is the public entity responsible for collecting and storing weather data in Catalonia. The most valuable data comes from weather stations based throughout the region. Each weather station has sensors to measure different kinds of variables, such as temperature, humidity, and pressure.

Weather stations are polled regularly, data is processed, and stored in an Oracle database that contains around 350 million records. The application responsible for the processing and storing of the data is based on the NetBeans Platform.

The figure below shows the configuration panel where a data source is specified for each weather station.



Once configured, weather stations process data in multiple threads, so as to reduce data latency, which is measured by a datalogger.

The next figure shows how processes are monitored. Via pause and play symbols, the application shows details such as which threads are working and the time spent on processing weather data.



While processing is taking place, graphical views help visualize the data. The next figure shows a temperature chart from a weather station, visualizing how temperature evolves over time:



In addition, the application is responsible for the storage of data. Different environments are handled, such as "production" and "development" and the program allows for the insertion of records in multiple databases.

The next chart enables the data insertion process to be monitored:



Thanks to the window system that is a standard part of the NetBeans Platform, it is possible to display multiple types of information simultaneously, as a dashboard:

Development tools and technologies: NetBeans IDE, NetBeans Platform, Oracle JDBC driver, Oracle DB, Quartz scheduler, and JFreeChart.

With thanks to Antonio Santiago Pérez, from Servei Meteorològic de Catalunya, who provided all the information above, as well as the screenshots.

Comments:

Hi, Am looking for further details on how weather data is stored in Oracle Spatial.
1) Is it the raw data or processed data being stored in database?
2) Was there any analytical modeling applied on Oracle DB for weather analysis?
3) What were the data formats that were processed? Is it digital data or HDF ?

Pl share some thoughts around this.

Posted by guest on December 17, 2013 at 10:19 PM PST #

Post a Comment:
  • HTML Syntax: NOT allowed
About

Geertjan Wielenga (@geertjanw) is a Principal Product Manager in the Oracle Developer Tools group living & working in Amsterdam. He is a Java technology enthusiast, evangelist, trainer, speaker, and writer. He blogs here daily.

The focus of this blog is mostly on NetBeans (a development tool primarily for Java programmers), with an occasional reference to NetBeans, and sometimes diverging to topics relating to NetBeans. And then there are days when NetBeans is mentioned, just for a change.

Search

Archives
« April 2014
SunMonTueWedThuFriSat
  
12
13
14
18
19
20
21
22
23
24
25
26
27
28
29
30
   
       
Today