Learn about and try @GeoKettle the #OpenSource #Spatial #ETL at @FOSS4G 2011

| Monday, August 29th, 2011 | No Comments »

Event: FOSS4G (Free and Open Source Software for Geospatial) 2011

Workshop: GeoKettle: A powerful spatial ETL tool for feeding your Spatial Data Infrastructure (SDI)

Presentation: GeoKettle, the open source spatial ETL tool : overview, new features and roadmap

Day 1 – Monday, September 12th
GeoKettle: A powerful spatial ETL tool for feeding your Spatial Data Infrastructure (SDI)

Workshop room: Silver
Workshop time: 1:00PM – 5:00PM
Presenter(s): Dr Thierry Badard, Spatialytics

Summary:

A full fledged Spatial Data Infrastructure (SDI) enables dissemination of data and processes in an interoperable way, through standardized web services as WFS, WMS, SOS and WPS. Data and processes are cataloged in a CSW which is used as an entry point of the infrastructure. Feeding and updating such a spatial infrastructure is a repetitive and very time consuming task. An open source spatial ETL tool such as GeoKettle (http://www.geokettle.org) can help in automating numerous complex and repetitive every-day duties that a SDI administrator has to complete. It also avoids delivering data with poor quality as it is possible to perform advanced geoprocessing, data cleansing and error correction in such a tool. This workshop proposes to explore, in a practical manner, all the areas where GeoKettle could be useful for automatically feeding and updating a SDI. Thus, after a short intro to the fundamental concepts and the features provided by this ETL tool, attendees will learn and experiment how is it possible with GeoKettle to: 1) Grab some data from various and heterogeneous sources such GIS files, spatial DBMS, Web services (WFS, SOS, …), social networks, … and transform them in order to feed their SDI with value-added and error prone data. Exercises will rely on PostGIS, GeoServer and the 52 North SOS service. 2) Automatically retrieve some metadata about these different data sources for use and dissemination in a catalog service, such as GeoNetwork. 3) Easily expose some ETL transformations as true Web Processing Services (WPS) in order to disseminate advanced on-line geoprocessing capabilities through their SDI. Exercises will use the 52 North WPS service. At the end, attendees should have a working knowledge of GeoKettle and should be able to design advanced geospatial data transformations in order to automate numerous loading and updating tasks in their SDI.

Day 4 – Thursday, September 15th
GeoKettle, the open source spatial ETL tool : overview, new features and roadmap

Conf. room: Tower Court B
Conf. time: 3:00PM – 3:30PM
Presenter(s): Dr Thierry Badard, Spatialytics

Summary:

Geospatial Business Intelligence (GeoBI) tools (geo-analytical dashboards, reporting and Spatial OLAP) present to users summarized data from operational systems in interactive maps, charts, graphs and reports. They allow decision-makers to analyze data in order to make better decisions. They rely on data warehouses which organise geo-analytical data according to dedicated data structures (e.g. star schemas). They enable a fast navigation in large data volumes in order to not hinder the analysis process flow. Some spatial ETL (Extract, Transform and Load) tools are used to build such data warehouses. GeoKettle, a spatially-enabled version of Pentaho Data Integration (Kettle) is a powerful, metadata-driven spatial ETL tool dedicated to the integration of different spatial data sources for building/updating data warehouses. It is part of the open source GeoBI software stack developed and supported by http://www.spatialytics.org.

At present, different file formats and spatial DBMS are natively supported in read/write modes. It is thus possible to build and feed complex and very large geospatial data warehouses with GeoKettle in these different DBMS. Spatial Reference Systems management and coordinates transformations have also been fully implemented and some dedicated data transformation steps can easily be designed by users as geometric objects and functions can be fully accessed by script.

This talk will present and demonstrate how GeoKettle works and its different powerful features. Based on progressive case study samples, the attendance will learn the basics of GeoKettle and will be able to assess the potential benefits of such a tool for their organisation. It will also be the opportunity to present its new features: read/write support for new data formats and DBMS (GML 3, KML 2.2, GDAL/OGR supported formats, …), OGC SOS and WFS support, cartographic preview, spatial analysis and geospatial data processing capabilities, …

Other interventions of Spatialytics during the week (full agenda here):

Day 4 – Thursday, September 15th
What about the commercialisation of Open Source Geospatial Solutions!
Conf. room: Tower Court B
Conf. time: 10:30AM – 11:00AM
Luc Vaillancourt, Spatialytics

Day 5 – Friday, September 16th
Open Source Business Intelligence (OSBI): Overview and Geospatial Enablement
Conf. room: Tower Court C
Conf. time: 1:00PM – 1:30PM
Mr Luc Vaillancourt, Spatialytics
Dr Thierry Badard, Spatialytics

Leave a Reply