Tag Archive for 'Geodata'

Page 3 of 3

Bye, bye Shapefile?

Thanks to planet geospatial I almost was able to attend ESRI’s International User Conference 2006 without even going to San Diego (and experience those nice travel adventures as others did).

Beside all improvements and new features (btw, can’t wait to see this animation thing demoing somewhere) and bug fixes of ArcGIS, one point called my attention: the File-Based Geodatabase.

Since they can be compressed and are cross platform (Linux, Solaris, and Windows), file-based geodatabases are a good choice for data publishing. Like it did with shapefiles, ESRI is providing an open API that will allow anyone to create and use file-based geodatabases.

Is the File-Based Geodatabase going to be the next Shapefile?

Quite an ambitious project considering that, as far as I know, every piece of software dealing with geographic data is able to read (most of them even to write) a Shapefile. I’m not that long in the GIS business world, but I know the Shapefile as de-facto standard for quick geographic data exchange.

A major advantage of Shapefiles (and the Personal Geodatabase) is that you can access and edit attribute data without the need of a GIS client. In case of Shapefiles just fire up Excel (or any other DBF editor), access, read or change the attributes you want and save them back to the file (if you used Excel, be careful).

Will it be possible with File-Based Geodatabases too?

E.g. while working with ArcReader the non-ArcMap user can open Access and update the whole attribute set without any difficulty. A common and highly appreciated workflow in my environment.

However, in times of increasing importance of easily accessible geographic data the Open Geodatabases concept looks promising:

It is no longer necessary to access geodatabases via ESRI software products; the technology and documentation easily support direct access from other products and systems.

Unusual tasks

Spatial Adjustment It must be the heat wave, otherwise I can’t explain why today I had to accomplish some very unusual, not to say weird, GIS tasks.

One part of our work here is to collect and synchronize data from various regional or federal institutions and produce a national view of certain spatial planning related topics. The bandwidth of responds to our data requests is pretty broad: it reaches from colorful word or excel tables to every digital image format (particularly when it comes to geographic data and maps) you can imagine. GIS compatible data is unfortunately the big exception. The worst, and in the year 2006 still existing, answer you can get is “I send you the data by fax, ok?”.

Adobe Illustrator to ArcMap

During the last days we received some maps done in Adobe Illustrator. For some reasons GIS was ignored and the whole mapping was done exclusively by vector graphic editing. For print-only maps it was ok and we could add the delivered Illustrator files to our graphic outputs. But we needed the data in our Mapserver too.

The workaround I found was to export the features (points and polygons) from Adobe Illustrator to AutoCAD Interchange file (dxf) and then import this AutoCAD files into ArcMap. The import/export allows you to take over the layer information (the graphic elements were organized and grouped into different layers) as attribute like in any other dxf. Completely missing is of course a coordinate system. Once I had all the elements loaded into ArcMap I used the Spatial Adjustment tools to shift the former graphic elements to their right geographic location within my chosen coordinate system. To successfully complete the spatial adjustment you need to know the exact location (e.g. some graphic lines represent a known street network) of at least a few graphic features.
Of course you won’t achieve sub-meter accuracy by this method, but for a first rough import step it was ok. Further spatial adjustments along with other editing steps (such as adding attributes) need to be done on the imported data in order to ensure a certain quality level.

Coordinate system?

Another data set which was meant to be added to the Illustrator data was stored within an Excel table. First I thought great, somebody who understands my needs: the last two columns represented coordinate pairs. Fantastic! I’ll be done in 10 minutes. After the X/Y-import the data just didn’t want to match any coordinate system I knew. Whatever projection parameter I modified, the data just slipped around on my map, always slightly off my existing data (the position of some features was known). It took me the whole morning to figure out what was wrong with the coordinate pairs: every third coordinate pair applied to another coordinate system. I’ve never seen such a data compilation before. After splitting everything up, defining the right coordinate system for each pair and putting them together again I could add this data my maps.

If today’s data struggle wasn’t enough, my PC was behaving sluggish and unmotivated all day long. Must be the heat or a signal to go home now.

Where 2.0 day #1

Where 2.0 audienceIt’s hard to wrap up a whole day at Where 2.0 since it was packed with interesting presentations.

My personal highlights of today were the panel discussion “Social Data Face-Off” and the presentation done by MetaCarta.

I think this was not the last discussion we heard about copyright of data provided by users. Though it was interesting to hear how this issue is handled by various services so far. Beside user data, how is “copied” data like place names and street names from background maps (provided Google, Yahoo!, Microsoft, etc.). Is it legal to pinpoint “San Jose” above a Google Map, getting the coordinates out of the data set Google Map is based on, and name this point “San Jose”, the name which appears on the Google Map and was put there by a third party? Can we be sure that there is no copyright on this data as Di-Ann Eisnor from Platial said?

One way to avoid this kind of uncomfortable questions can be the use of OpenLayers by MetaCarta. They provide a free API to free geodata. If you can’t use Google Maps, Yahoo! Maps or any other available mapping API because of licensing reasons, you should give this BSD licensed API a try. Together with OpenStreetMap it can be a powerful package.

Another fantastic API released by MetaCarta is their GeoParser, which basically parses text for place names them and maps them. I have to try this with our data and studies.

Talks like those about the least cost path calculations doing in GRASS or the raster based demographic data offered a sneak peek into the GIS world for the audience, which is obviously not very familiar with GIS processing and methods. Hey, never forget that behind all those mashups it needs a lot of GIS work in order to build *only* the base-maps. On the other hand, coming from the traditional GIS world, I’m very excited about all this developments going on right now. The growing participative aspect of mapping and geographic information will sooner or later make its way into the world of spatial planning. I’m pretty sure about that.

As Ed Parsons already wrote, the announcement of Google Maps Enterprise solutions probably made some phones ring in certain GIS companies. A big player like Google entering the professional mapping market (additionally to their free geocoder!) will surely lead to some interesting developments.

Let’s start day #2.

Moving towards a national GDI

geoland.atTwo years ago the first version of geoland.at, the geodata network between all 9 Austrian Federal states, was presented.

In Austria the National Mapping Agency is responsible for collecting and maintaining basic geodata such as the official topographic map or the digital cadastre. Within the administration (between NMA and ministries, Federal states, governmental agencies, etc.) this state collected data is going to be sold and licensed. Public funds are making their way from the left state-pocket to the right state-pocket. Of course private companies can buy and license this state collected data as well. By 1st January 2006 a new geodata licensing model became effective. It was a huge step in terms of easing access to and understanding of geodata licensing in Austria. Geodata became affordable even for smaller companies without huge data budgets. Some details still need to be discussed, like multi-user licensing questions or geodata licensing for large umbrella companies. What is still missing, but as far as I know our they are working on it, is online access to geodata via OGC webservices. By now you can only access some maps in an online viewer.

However, geoland.at is the effort to make Federal state collected or maintained geodata publicly available. The online viewer gives you access to 9 data different servers. Geoland.at is based on distributed data management in order to keep the data where it’s going to be maintained and updated. Beside technical aspects and semantic data homogenisation (e.g. river doesn’t mean the same type of flowing water in every 9 states), the political motivation behind geoland.at is far more interesting. Basically the most eastern state has no interest to share any geodata with the most western state. Furthermore there isn’t any legal pressure to do so. The 9 Federal states voluntary agreed within the framework of geodata policy and resulting discussions to build this platform and create thereby a counterpart to the National Mapping Agency.

The new addition on geoland.at is a WMS which gives you access to following layers in your preferred GIS client:

  • Road network (federal roads and highways)
  • Administrative boundaries (municipalities, districts and federal states)
  • Rivers
  • Natura 2000 zones
  • Shaded relief
  • City map in Vienna

I had to add http://www.geoland.at/geolandWMS/service.aspx? to my WMS servers in ArcCatalog to make it work.

Since our work highly depends on state collected geodata (and it’s always very time consuming to get access to) I highly appreciate the recent development of providing geodata through OGC webservices. It allows us to bypass the data delivery process by simply adding a WMS to our maps.

Of course every single Federal state still operates its own online geographic information system, where at least metadata searches through most Federal data sets are possible.

There are probably more advanced GDI’s available in various other countries, but having the political background in mind, geoland.at means a major step towards an Austrian GDI.

Bike trails

BeachcruiserSpring finally arrived in Vienna, sun is shining and I could reactivate my bicycle. Since I go quite often by bike during summer months I decided to start a kind of a “bike project” this year. My bike will serve for another purpose too than just bringing me from point A to B, it’ll track and share the way in-between.

Recent discussions about INSPIRE and free geodata directed my attention to the OpenStreetMap initiative. In my opinion it’s a great idea and I decided to participate. But first a few GPS street tracks for sharing are needed. So I equipped my bike with a Garmin GPSmap 60C. Well, to be honest, it’s rather carrying the device with me than owning a GPS enabled bicycle now. Btw, can somebody recommend a clamp or another good method to mount the Garmin GPSmap 60C on a bike?

The plan is to track every meter I’m going by bicycle during this summer. It allows me to add some more street information of Vienna to OpenStreetMap and I get an interesting picture of how often and which bike routes and streets I’ve chosen. This may sound pretty geeky, actually it is, but I kind of enjoy toying around with geo technology.

The continuously growing picture of my bike trails you can observe online, in my so called bike_trails map.

If you’re interested, this script let me easily display my GPX formated GPS tracks as overlay in a customized Google Map (mashup, to name a buzzword and make some search robots happy). As you can see, the GPS tracks don’t exactly match the Google Map behind. I’m not quite sure which one of both is more inaccurate, Google or GPS…

Talking about INSPIRE

INSPIRELast week started with an interesting email in the PostGIS-list containing a link to Public Geo Data. It’s a campaign aimed to stop the European Parliament from adopting the INSPIRE proposal. Honestly, I was pretty sceptic about that campaign. Of course INSPIRE is not exactly brilliant, but I thought it’s better than nothing, better than the current situation. To make a long story short, I tended to see the glass half full instead of half empty.

Now, one week later and after reading the arguments stated on that site, I see the glass three-quarter empty. Have a close look at this section of the site. Isn’t it simply unbelievable how our public NMAs (National Mapping Agencies) are building back doors side by side where they can leave the directive without guaranteeing access to anything? Anything, ok that’s not quite correct. As far as I remember the text of the proposal they are obliged to make at least metadata publicly available (if thereby intellectual property rights are not violated of course).

Don’t get me wrong. This is not about demanding from our NMAs to give away everything free of charge. I’m well aware that production and maintainance of some of their data is quite cost-intensive. Even if they are fully public funded I would agree that they generate some income by partly licensing their data. Not every single taxpayer takes advantage of geodata to the same degree. As well I understand and agree that access constraints might be a result of national security issues. But enabling access constraints for information created by public authorities just for reasons of intellectual property rights is going way too far!

“the most competitive and knowledge-driven economy by 2010″
(EU heads of state and government, Lisbon, 2000)

If the current INSPIRE proposal will be adopted without any further changes than the Europe based geospatial industry can remove the word “innovation” out of its vocabulary. Why? Well, I’m thinking that a considerable part of innovation is done in “garages”, by small companies or even single developers, where decisions are made fast and uncomplicated and ideas are not blocked by administration. Usually those companies/developers are not blessed with too much budget, so they need some affordable or free data to build and test their geospatial applications, services, ideas, etc.. So which data sources would you consult/suggest in Europe? LANDSAT, VMap0, UNEP, GEOnet Names Server, ESRI Data & Maps (if you call an ArcGIS license your own)… if you can tell me a european one I’ll willingly add it to the list.

Public benefit of public geodata

Last weekend I helped a friend out. His hobby is his website where he and a few others provide information about reptiles in Austria. In one section you can submit information via a form if you have seen a rare species. Once a year this information is handed over to the Natural History Museum in Vienna, all for free of course. Part of the form is information about the place where the animal was found, including coordinates. The user was asked to look up the place in the official topographic map of Austria, paper or online, and enter the sheet number and coordinates, all manually. So I asked him why not embeding something like a Google map where the user can simply click and locate the place. The coordinates would be passed directly to the database. We overworked the form on sunday afternoon, not a big deal, just making use of Google’s API. The feedback of some users was quite impressing.
This friend asked me then why the Austrian Mapping Agency isn’t offering something similar, something simple like this Google map. Well, appearantly it’s part of their policy to keep geodata behind closed doors. They have their own product online where you can view the austrian topographic base map. If you want to embed this map in your website just like we did on this sunday afternoon you’ll have to license it through the “Web-Service License”, a pay-per-click license model. I’m still talking about the topographic raster base map. If I would have told this friend that we have to come to a license agreement with the Austrian Mapping Agency he probably would have answered: “Ok, forget about the map, just add the lat/lon form fields”.
So Google helped us to create a simple non-commercial mapping application for the public benefit (assuming that protection of species is a matter of public interest), something our NMA should do.

What I basically expect from INSPIRE:

  • EU-wide interoperable public geodata
  • guaranteed access to public geodata
  • open access to freely available base maps

I discussed the arguments listed on Public Geo Data and the INSPIRE proposal in my company with my senior. Resulting that I’m allowed to sign the petition as employee of the Austrian Institute for Regional Studies and Spatial Planning – Information services (ÖIR-Informationsdienste GmbH).

If you’re living in Europe you should sign too!

For further reading I recommend the article “Why Europe Needs to Provide its Own Public Geodata” by Jo Walsh.

Vote for Public Maps - Reject INSPIRE!

Geo zeit

Nice to see that a Geodata Portal, respectively a spatial information system, is mentioned at the Fundsachen-Zeit-blog:

“Beeindruckende Abfrage- und Darstellungsmöglichkeiten im UNEP-GEO Data Portal: Its online database holds more than 450 different variables, as national, subregional, regional and global statistics or as geospatial data sets (maps), covering themes like Freshwater, Population, Forests, Emissions, Climate, Disasters, Health and GDP. Display them on-the-fly as maps, graphs, data tables or download the data in different formats.”

Viele Geodaten [Fundsachen]

Actually we are developing various spatial information systems this year. Every single one with another (client/user) approach and different techniques. I’m already pretty curious about how the results will finally be and what’s still more important, if the information systems will be accepted and how intensely they’ll be used…