Sensor Web, Geoprocessing, Security & GeoRM, Geostatistics, Semantics, 3D, Ilwis, Earth Observation

Successful HackDay Münster 2011

January 12th, 2012 @ 09:41 by AnnHitchcock
Posted in 52°North, Communities, Sensor Web

Ifgi recently hosted Münster’s first HackDay to promote contributions to the nationwide “Apps4DE” competition. Between 40 and 60 hackers and thinkers from Münster met throughout the day to discuss “open data” and come up with ideas for Apps which demonstrate the use of public sector information. An opening presentation by Albert Remke was followed by a series of lightening talks about linked science, linked open data, map Apps and Augmented Reality. After several hours of brainstorming and hacking in small groups, the participants presented resulting ideas and small prototypes such as:

  • Family and Recreation App
  • App for Open Sensor Data
  • Linked open data applications for the Bundestag  members and their private activities in the market economy

Several participants also announced that they plan to submit their idea or App as a proposal to the “Apps4DE” competition. In the eyes of the particpants, the Münster HackDay – one in a series of Hackdays promoted by the Open Knowledge Foundation – proved to be a highly successful event!

Organisers: Geonetzwerk Münsterland, 52N, ifgi, con terra, Open Knowledge Foundation

The printed Map

January 9th, 2012 @ 13:47 by MartinSchouwenburg
Posted in ILWIS

Finally back after a long break. Happy new year to all.

Some people have voiced to me some concerns about my remarks about printing of maps in Ilwis 3.8. Or basically the lack of it. So I think it might be  usefull if I explain a little bit better.

First of all the baseline

  • The layout object is gone. It is no more. It has been deleted. No directly printing of maps anymore.
  • The copy of the content of the mapwindow is now realy a WYSIWYG copy. Everything there  will be placed as a 300 dpi image on the clipboard.
So first of all the reason why.
  • The Layout reused (of course) the code for drawing of maps and added its own stuff to it. E.g texts, boxes, scalebar etc. The whole lot of objects we call annotations in Ilwis. These things were only available in the layout, not in the mapwindow.  Layout positioning was quite different from mapwindow positioning due to it being based on paper, not on a screen. To integrate that with the new stuff would of course have been possible but not trivial and cost extra time.
  • The Layout was not very good. Too many quirks, some bugs and limitations. I am a bit hesitant to “port” a system to a new structure and then still find it not very good. Improving it would of course have been possible, but again, it costs time. As cartographic output is not a important part of Ilwis, I find spending lot of time there a bit hard to justify.
  • After some investigation (mainly talking with users here at the ITC), I came to the conclusion that most users wanted their output as part of a larger document. A document were they could combine text, tables and cartographic output in one unit. I say here ‘cartographic output’ and not just a simple copy of the map. A copy is just a plain image with no context, cartographic output is an image that contains spatial annotations giving the image a spatial context.
Judging the requirements and time available I decided that figuring out a whole UI for layout was not worth the trouble. Creating a WYSIWYG copy on the clipboard should be sufficient. You can paste this in any wordprocessor and do whatever you like with it. Printing is certainly one of the things you can do.
Of course I had to recreate a number of annotation elements to give the spatial context. These will now be directly available in the mapwindow.  What will be available is legend, grid/graticule, scale bar, mapborders and north arrow.
People also voiced some concern about the size of the copy. “Wont I get some small screen dump that I can not use to make posters and such!”. Eehm, no. It is a 300 dpi rendering of yout screen, quite large and with high detail. So your picture is sufficient large and has all the detail you could whish.
I might release a beta-3 in the near future. Some extra stuff is in there (and lot of bugs have been removed). Almost all the functionality I want is in there.

Babel

December 12th, 2011 @ 10:01 by MartinSchouwenburg
Posted in ILWIS

Though ILWIS was in theory multilingual from the 2.0 version it was hardly used. I believe there were a (partly?) Italian version and partly Spanish version but they never ended up in the release version and/or were maintained. In the 3.7 this for the first time changed. Thanks to the work of Robin Prest and the money from the Geonetcast project a french translation of the user interface could be made.

The work of mr Prest made me also realize that the existing translation system was cumbersome and difficult to maintain. Oh, it worked, the results are ok. But it is more work than needed and difficult to track changes. Furthermore I found is as a programmer also quite annoying. Basically I had to touch multiple files when adding a string in the code. So one of the goals for the 3.8 was a more comprehensive translation system.

From the GeontetCast project the clear whish was there to have a Spanish and Portugese translation. So it was reasonable to spend some time to make this easier

I had a few goals with the new translation system,

  • The translator should have to touch as few files as possible.
  • The programmer should have to touch as few files as possible
  • Maintainance should be easy
  • The translation files can be changed without needing the change anything in ILWIS.
Fortunately I had come across the Qt platform. For some time I am pondering how to move the Ilwis code base from Windows/MFC to something more modern and platform independent ( enough stuff there for another blog) and in this context I came along the Qt framework. Apart from other nice things they had a suitable translation system in place that I adopted with some modifications for Ilwis.
What basically happens it that every “translateable’ expression in the code is compared to a lookup table that is loaded at startup time of ILWIS. If there is a translation, it will choose the translation. If not it will use the original English phrase. Internally, Ilwis only uses English. The advantage of this system is that I can extend Ilwis without needing to update the translation files each time. Incomplete translation files will simply lead to more non-translated English in the UI. Not ideal, but much better than having nothing at all. Once in a while you update the actual translation files and then everything is cool again.
So how does translating ILWIS works? It is very simple.The language files exist inside a folder in the instalation folder of ILWIS : Resources\Strings. At the moment you will see there a number files with the extension .fr and .sp. French and Spanish translations ( I am not 100% sure if the spanish is already there in the beta-2, it is now). For each language there are three files (I take french as an example). Men.fr, Dsc.fr and string_table.fr. From a technical point ‘Men’ and “Dsc’ could probably be merged but I’ll leave it as they are not that big anyway.
  • Men contain the texts of all the menus except for the operations menu. So when you translate ‘Men’ you will get a translation of all the menus. The men file consists of a number and a string. Each menu item is coupled to the number, and through the number it can find the string. This is a different organization than the ‘string_table’ file(see later) but there are technical reasons for that (never mind). When translating the file take care that the special signs (e.g. ‘&’) als end up in the translation. They have a meaning. The ‘Men’ file is not very large and can easily be translated
  • Dsc ( short for description) is a direct companion of the ‘Men’ file. Basically it contains the description/short explanation of the menu commands that appear on the status-bar below ilwis windows. it is structure and numbering are identical to the Men file.
  • The big translation table is the ‘String_Table’ file. it contains ‘the rest’. So all the forms, operation menu, windows etc.. The structure of this file is different. The file consist of a pair of strings separated by a ‘|’. For example  ”Invalid Map|Mapa Incorecto”. The software, internally, knows of the first english string and simply looks it up in the table constructed of this file to see if their is an (translated) alias. If so, great, it uses it. If not, it will use the internal english version. Note that when translating these texts it is very important to take over all the special symbols. Particual the ones marked with % ( e.g. %S,  %i etc. These are, during execution, filled with internal values. So for example a string “Adding File %S” might become “Adding File MyMap” because that is something that was happening during execution.
    This table is quite big, at the moment around 3700 entries. Not difficult to translate, simply a lot of work,
That is all there is need for translating ILWIS to a ‘local’ language. Ilwis translations have their limitations. When the internals of ILWIS were designed, many years ago, Unicode was in its infancy. It was not considered and still isnt part of Ilwis. So translations are limited to alphabets that uses the extended Ascii table. An annoying limitation these days but it is very difficult to change that (probably for a rewrite of Ilwis).
Ok, nice that we can translate things. But how do we activate a translation? Well, Ilwis contains a form that most people don’t seem to be aware of , the preferences form (under the file menu). In that form you have the ‘General’ page in the tree. That looks like this
In the form you can indicate which language files should be used (based on extension). In this example I have choosen Spanish (.sp). When I press Ok and restart ILWIS it will use the spanish translation. So a contour interpolation form suddenly looks like

A spanish form :) .
Ilwis 3.8 will contain a french and a spanish translation. It is likely that there will also be a portugese translation but that remains to be seen.
One thing. The translation is about the user-inteface of Ilwis, not of the help files. That is far too much work to do for volunteers.

The Losers

December 5th, 2011 @ 09:30 by MartinSchouwenburg
Posted in ILWIS

When implementing such a large operation as we are doing for the 3.8, there is inevitably functionality of the old code that has to be reevaluated. Mostly it is because you want something better, sometimes you have to remove some non performing functionality and sometimes you have to set priorities to determine what must be ported to the new structure and what will be dropped. This blog is about the losers of that judgment.

Printing Maps

Designer : You can’t print maps in 3.8.

Users : What? I think I misunderstood.

Designer : No really, no printing of maps. No layouts.

User : Eeeh, seems to me a big blunder. Everybody wants to print their maps at a certain moment. Stupid programmers!

Well indeed the layout has gone from ILWIS. No direct printing of maps anymore. It was the result from a discussion between me and several users about printing, how it is used and how important it was. The background was of course a setting of priorities. The basic reasoning was: You don’t want to print; you want to use the rendering of a view in a report or some other kind of document. You can combine it with other texts, figures and tables based on that software.  The final result can be printed if needed. In that way you combine the strength of one piece of software (LWIS), rendering spatial data, with the strength of let’s say a word processor (rendering texts/tables + printing) without needing to reinvent the wheel.

As such, this line of reasoning suited me well. I disliked the layouts as being too primitive for real cartographic output. I have never considered ILWIS to be a cartographic package, it’s an analyses package. Sure if you have enough resources it might be feasible to implement such functionality but it certainly has low priority. So the above line of reasoning suited me well, however, it is has two important consequences. First of all ILWIS has to be able to copy the contents of its mapwindow perfectly to the clipboard. Second, that some annotation elements are available in the mapwindow that were previously in the Layout. Elements that are not easily generated by a word processor.

The first task is rather easy. Instead of rendering to the screen, I render to a bitmap of suitable size and put that on the clipboard. At the moment, I render a 300 dpi image to the clipboard. This is quite large and should be sufficient for most documents or posters. I can scale op the image to 600 dpi but that creates a really huge bitmap, so for the moment I leave it at 300 dpi. Note that the image I render is identical to the view you have in your Mapwindow (incl. zoom and such).

The second is somewhat more work, though not overly so. I choose to implement Legend, MapBorder and North Arrow in the mapwindow. In the current internal version, the first two work reasonably well, the third needs to be done. The third one is easy though. I will probably use some ivg file(s) (see earlier blog) and rotate them appropriately. In this way people can add their own arrows and I hardly have to program anything as the ivg rendering is already done with the point maps.

Point graph symbols

The second thing to go was the point graph symbols. You could make a mini graph of the values of an attribute table that appeared at the location of a point. There were a number of types and a lot of properties. Apart from maybe the pie chart they were difficult to read and often quite ugly. Reimplementing them would have been a lot of work for a feature that I judged to be fairly useless ( apart maybe of the pie chart). Now if users can convince me of the usefulness of it, I might reconsider. But for the 3.8 they are out (for the moment).

Labels

Point labels are gone for the moment. I am not completely happy with that, but as such they have been given low priority. Partly this was because it took some time to get the scaling of texts correct, that was quite difficult in OpenGL (needed that in the annotations), partly because a good placement algorithm for labels is not trivial (problems with overlapping labels and such). Now that I have good control over the size of fonts I might implement a simple labeling scheme. We will see, for the moment it not on my list of things to do.

Double click action on maps

In the past you could attach the opening of a document (in the broadest sense) to double clicking on locations. As such this was cool (when it was developed) but at the moment I feel that it is not enough. More can be done here, more should be done. But what? So for the moment I leave it out. Maybe it will reappear in the 3.8 or later, maybe not. It is one of those features that are fun to play around with as programmer but I doubt its priority a bit .

So these things are the main things that will not reappear in 3.8. A shame? Maybe, maybe not. It is not bad sometimes to clean up some features as ‘more’ doesn’t always mean ‘better’.

SenseBox & standardization recommendations for the Internet of Things

December 2nd, 2011 @ 16:31 by ArneBroering
Posted in Sensor Web

At the Internet of Things workshop of the OGC TC meeting in Brussels, we presented the SenseBox project which we are conducting together with the SWSL group at the Institute for Geoinformatics of the Uni Münster.
Besides demonstrating the SenseBox project, we gave recommendations for bringing the Internet (or better Web) of Things field together with the standardization efforts at OGC. Standardized REST APIs for things as well as well-defined JSON encodings for exchanging data about / from things could be an interesting contribution of the OGC to this emerging technology field. Similar suggestions were made by other particiapnts. E.g., Ben Pirt from the Internet of Things platform pachube announced their interest in OGC and standardized protocols for the Internet of Things.

Please find below the presented slides.

« Previous PageNext Page »