Feed aggregator

gvSIG Team: Actualización de plugins para gvSIG 2.4

Planet OSGeo feeds - Wed, 03/14/2018 - 12:43

Tras la publicación de la versión 2.4 de gvSIG se han realizado mejoras en el comportamiento en algunos de los plugins que iban incluidos en ella. A través del administrador de complementos es posible instalar dichas actualizaciones sin necesidad de instalar de nuevo gvSIG.

En algunas de las funcionalidades mejoradas es necesario instalar varios plugins.

Los plugins que se han actualizado son los siguientes:

Funcionalidad

Nombre de los plugins a actualizar (y número de build)

Documento Mapa

  • Document: Layout document plugin, version 2 (BN 2.0.121-140)

Leyenda de mapa de calor

  • Document: Layout document plugin, version 2 (BN 2.0.121-140)
  • Vector legend: heat map (BN 1.0.14-17)

Geoproceso de dispersión de puntos

  • gvSIG-desktop-2.4.0-org.gvsig.shp.app.mainplugin (BN 2.0.220-2767
  • org.gvsig.geoprocess.app.algorithm (BN 2.2.92-2169)
  • org.gvsig.geoprocess.app.sextante (BN 2.2.92-2169)
  • org.gvsig.geoprocess.app.mainplugin (BN 2.2.92-2169)

Algoritmo de Rossmo

  • Rossmo’s algorithm (BN 1.0.0-4)

Una vez se accede al administrador de complementos (menú “Herramientas”) se debe seleccionar la opción de “Instalación por URL”, conectando a la URL que hay por defecto. Después se puede buscar cada uno de los plugins por su nombre e instalarlos (se pueden seleccionar varios a la vez). Finalmente, para que la actualización tenga efecto se deberá reiniciar gvSIG.

GIScussions: FOSS4G UK, a personal view

Planet OSGeo feeds - Tue, 03/13/2018 - 19:20

Last week James Milner and his organising committee staged a brilliant FOSS4G UK at the Geovation Hub.

For the first time in ages I wasn’t organising a FOSS4G (well I did help with some financial bits and pieces), I wasn’t presenting (except for a lightning talk) so I could just hang out listen to interesting speakers and learn some cool stuff in the workshops.

Here is what I enjoyed in roughly chronological order):

Day 1

Joana Simoes of GeoCat gave the first keynote on SDI’s and containerisation – it sounds very techy but it wasn’t difficult to follow and gave a fascinating explanation of why you might want to use containers (in Joana’s case Docker) to create a highly scalable and simple to maintain infrastructure.

First keynote on #InternationalWomensDay at #FOSS4GUK by Joanna from @geocat_bv (cloug SDI as a service) pic.twitter.com/A42jJBfBg6

— Ross McDonald (@mixedbredie) March 8, 2018

The rest of the morning was filled with a QGIS stream which included “QGIS: A Sustainable Open Source Project” by Saber Razmjooei of Lutra, “Publishing MapAction Maps: A QGIS Plugin” by Ant Scott of Astun and MapAction and “QGIS Anywhere” by Martin Dobias of Lutra. As QGIS 3 starts to roll out, you cannot help but be impressed by the increasing ambition and professionalism of the project.

In the afternoon I sat in on Tom Armitage‘s brilliant “Data Visualisation with QGIS” workshop. I am a pretty basic mapper who can just about hack together some data in QGIS, this was a bit of an eye opener. Tom took us on a journey through some of those deep down dialogues – draw effects, layer and feature rendering settings, multiple styles, the Size Assistant. Those of us who managed to keep up made 3 or 4 pretty impressive maps and learnt a lot on the way. Somehow my maps weren’t quite as good as these:

Final prep for #FOSS4GUK
Training booklets
Memory sticks
Stickers
Laptop
Final power up
Lightsaber???

You'd better come along to my talk to find out. pic.twitter.com/sRXQvG9RrH

— Tom Armitage (@MapNav_Tom) March 7, 2018

Learning new viz-tricks in QGIS from @MapNav_Tom #FOSS4GUK pic.twitter.com/4rIc1ccq4o

— Geogoeroe (@geogoeroe) March 8, 2018

Some quick images from the QGIS data visualisation workshop by @MapNav_Tom #foss4guk pic.twitter.com/ceC2PzgFfN

— Tom Wragg (@T_Wragg) March 8, 2018

In the evening there was the now mandatory FOSS4G party at a local pub, great conversations, plenty of wine and beer and absolutely tons of food (much of which breached my healthy eating guidelines). Oh and we managed to get AC Milan vs Arsenal on the big screens so I was very happy with our first win ages.

A well-deserved drink at the Bowler Pub after a long but very good and insightful day at #FOSS4GUK pic.twitter.com/Jm77eYoInM

— Isa (@IsaUlitzsch) March 8, 2018

Day 2


Day 2 started with a superb talk from Jorge Sanz of Carto. Once again it was technical but accessible and although it was based on the capabilities of the Carto product, Jorge emphasised that all of the code was open source and that you could build your own Carto stack rather than using their enterprise service. I’ve been a fan of Carto for a number of years and have proposed it to some clients as a solution. I signed up for a free entry level account a few years back which is a good thing because now they have gone completely enterprise and no longer offer free accounts (boo hoo) to new users. Still if you haven’t got a free Carto account the QGIS2Web plugin by Tom Chadwin is a great and simple free option.

My slides for "@CARTO as a Platform" talk at #FOSS4GUK https://t.co/Ul4d1BVaIC

I had to cover a lot in 25 minutes, happy to answer any questions you may have pic.twitter.com/dnfk3vN0nV

— Jorge Sanz (@xurxosanz) March 9, 2018

Next up was Thomas Starnes of the Royal Society for the Protection of Birds talking about “Open Drones”, this was a fascinating talk particularly for people like me who are so vector centric that we think imagery and 3D are just eye candy.

Great talk by @bio_carta from @Natures_Voice on their use of drones and software like @OpenDroneMap #FOSS4GUK pic.twitter.com/P5yw5bGxzp

— Tom Armitage (@MapNav_Tom) March 9, 2018

Open slides from my #FOSS4GUK presentation 'Open drones: A free and open source workflow for the use of drone imagery in mapping and geospatial applications' using @3DRobotics #MissionPlanner @OpenDroneMap @OpenAerialMap @openstreetmap @WILDLABSNET https://t.co/cZWoqg4UW1

— Thomas Starnes (@bio_carta) March 9, 2018

Then it was off to the Lightning Talks session where I had cobbled together a few thoughts, more questions than answers, on the “Open Communities – we love to hate …”. The theme was that we tend to be tribal and sometimes we can lapse into fundamentalism all of which creates a tension within the community. Sometimes we are more united in our opposition to some other group or camp than we are in furthering our vision for our open community. The ideas are still forming and I plan to explore them further in a couple of talks later in the year (assuming the proposals get accepted).

#FOSS4GUK lightning talks. Are we welcoming, open, inclusive asks @StevenFeldman #gistribe pic.twitter.com/AEq2JjFS0q

— Ross McDonald (@mixedbredie) March 9, 2018

And here's @StevenFeldman asking the right questions at #FOSS4GUK pic.twitter.com/MPb4CrcvPv

— Geogoeroe (@geogoeroe) March 9, 2018

Lightning talks are being kicked off by @StevenFeldman and his very thought provoking stream of consciousness bullshit rant #FOSS4GUK pic.twitter.com/pUcofIT4NI

— Steven Ottens (@stvno) March 9, 2018

The afternoon session on visualisation was all round brilliant. First up was Charley Glynn of the OS introducing their GeoDataViz Toolkit which they have open sourced. This is a great resource with colour swatches, icons, workshops and loads more stuff.

https://twitter.com/MapNav_Tom/status/972110116542668800

Great work by @charley_glynn and the @OrdnanceSurvey DataViz team.. check out their carto toolkit https://t.co/szI1LN2Nd8 #FOSS4GUK

— Ed Parsons (@edparsons) March 9, 2018

This slide would have had Ken Field on his feet cheering from the other side of the planet:

Nuff sed.#FOSS4GUK pic.twitter.com/OIAI7JfzPI

— Ross McDonald (@mixedbredie) March 9, 2018

Oliver O’Brien dazzled us with a colossal collection of code snippets and tricks for OpenLayers

The triangular colour ramp map from @oobr. Whaddayatink?#FOSS4GUK pic.twitter.com/U1uTQc6iJX

— Ross McDonald (@mixedbredie) March 9, 2018

Shout out from @oobr for UTFGrid: feature info without vector tiles #FOSS4GUK pic.twitter.com/jlCMXUlOEv

— Edward Mac Gillavry (@emacgillavry) March 9, 2018

And then we were treated to another tour de force from Tom Armitage riffing on a Star Wars theme. The audience loved it.

@MapNav_Tom and the different composite operations. In @CARTO we have some old materials about this, products evolve but techniques remain. This differenciate technologists from technicians (or button smashers, as @Spatial_Punk likes to say) #FOSS4GUKhttps://t.co/RwsgKfacYQ pic.twitter.com/vk3csr4onv

— Jorge Sanz (@xurxosanz) March 9, 2018

Who needs a laser pointer, when you can point out things with a light saber as displayed by @MapNav_Tom #FOSS4GUK pic.twitter.com/BpBZb9lsfR

— Steven Ottens (@stvno) March 9, 2018

Check out https://t.co/rhvW17I8qw, young padawan, and much you will learn from @MapNav_Tom #QGIS #FOSS4GUK pic.twitter.com/l7C2e22mpV

— Ross McDonald (@mixedbredie) March 9, 2018

Last up was Ross McDonald talking about the different ways to visualise thousands of individual journeys to school.

Using @blender can really turn your maps up to 11. OpenSource #FTW #FOSS4GUK @mixedbredie pic.twitter.com/huLhrSfb33

— Tom Armitage (@MapNav_Tom) March 9, 2018

Data Driven #cartography from @mixedbredie using @postgis #FOSS4GUK pic.twitter.com/8gMBld79R7

— Tom Armitage (@MapNav_Tom) March 9, 2018

Nice talk on 3D spidermaps with QGIS, PostGIS and Blender by @mixedbredie #FOSS4GUK pic.twitter.com/ddA77LqYLH

— Steven Ottens (@stvno) March 9, 2018

 

And then to finish off the afternoon my good friend Peter Batty of Ubisense delivered the closing keynote on “Geospatial Industry Trends”. Peter is a brilliant presenter, makes stunning slides but most of all is always thoughtful and thought provoking. This talk was no exception. Early on we learnt about Ubisense’s use of open source at some of the largest telcos and utilities in the US

"Most of the open source software we've used has been so good we've almost never needed support" (and when there was a major issue it was fixed overnight) @pmbatty #foss4guk

— Ant Scott (@antscott) March 9, 2018

Then Peter compared the effort that has gone into creating OSGeo software with what it took to build the Empire State Building

Who’d have thought?

Just in case the audience were feeling a little exhausted at the end of the two days, Peter strung together an amazing video collection illustrating where we might be in 5 or 10 yers time. He concluded with this provocative (deliberately?) slide

Wrapping up #FOSS4GUK with a future view from @pmbatty pic.twitter.com/HqLaKLOLKN

— (((Steven Feldman))) (@StevenFeldman) March 9, 2018

And that was it, just time for James to wrap up

Lessons learnt at #FOSS4GUK @Geovation pic.twitter.com/8sLEyyvasu

— Isa (@IsaUlitzsch) March 9, 2018

I had one last push to get people to donate to the FOSS4G Travel Programme, during the 2 days we collected $440 to help people travel to Dar es Salaam this summer. You could add to that by clicking on the donate link

And then it was time to go to the pub for a last drink and to say goodbye to new and old friends from near and far until the next time we have a FOSS4GUK (rumour has it that FOSS4GUK 2019 will be hosted somewhere in Scotland next year).

All that is left is to say thanks to the wonderful sponsors who made the event so affordable and who contributed their staff’s time and energy

Apologies to all of the other speakers whose sessions I missed and haven’t mentioned, particularly my pals at Astun.

You don’t have to wait until 2019 to experience the FOSS4GUK goodness. Fortunately there will be several more opportunities this year including FOSS4GNA, FOSS4G France, FOSS4G Europe and of course the big one, FOSS4G2018 in Dar es Salaam.

 

Fernando Quadro: 1º LIVE GeoEspecial

Planet OSGeo feeds - Mon, 03/12/2018 - 21:33

O canal do Luis Sadeck no YouTube irá realizar sua 1º live, e pra esse evento vai reunir nomes como Anderson Medeiros, Felipe Sodré, Jorge Santos, Murilo Cardoso, Narcélio de Sá e este que vos escreve em um bate-papo para falar de assuntos diversos no dia 20/03/2018 as 20:15h. Faça já o agendamento para não perder esse evento!

Se você quiser deixar suas perguntas lá nos comentários do evento ou aqui na postagem, tentaremos responde-las durante a live.

Esperamos por você no dia 20 de março!

GeoSolutions: A WFS 3.0 prototype in GeoServer; are we getting it right?

Planet OSGeo feeds - Mon, 03/12/2018 - 16:00

Dear Reader,

Let us start with a word of caution, this is going to be a rather technical post on the new version of the OGC WFS protocol, so do not expect nice images but rather a technical discussion about protocols, formats and the like. Good news is that you will not see much XML which is 180 degrees change with respect to working with current OGC protocols; although “everybody loves XML” this will make a few people in the GIS community happy (hey JS developer… yes, I am talking to you…). So, if you still haven’t moved away from this post, let’s deep dive into this new creature we are growing.

Our GeoServer technical lead Andrea Aime joined the WFS 3.0 hackathon this week, together with a few well-known names in the OGC and FOSS4G community to build a WFS 3 core prototype for GeoServer, delivered as a community module and available to be tested online for the braves. In the following paragraphs we are going to give some quick feedback from this experience hoping that it will help others to understand where WFS is going as well as out OGC colleagues to keep pushing forward with this effort.

About WFS 3.0

The WFS3.0 core protocol is geared towards the web and simplicity: dominated by (Geo) JSON representations, only supports WGS84 in and out, it’s schema-less, and has limited filtering and paging abilities. Everything else you’re used to see in WFS 1.1 or WFS 2 will be delivered as extensions to the core, that implementors can decide to implement, or not.  The approach is similar to WCS, small core and various extensions, helps getting started implementing the protocol and it’s a lot of help when building custom servers.

Going back to core, the equivalent of a “capabilities” document is split into two, a “contents” document simply listing the available layers, and a “api” document, OpenAPI 3.0 in particular, describing the details of how calls should be made. Eventually, a last set of call can be made to get features, in one of the supported formats (GeoJSON, GML, HTML).

Implementing WFS 3.0 in GeoServer

We joined the hackathon with no previous preparation or code, everything was started from scratch in a new community module. Had it been a traditional OGC specification, implementing the required parts of the protocol would have been “mission impossible”.

Thankfully WFS 3.0 core is pretty simple, while still supporting the basic needs of web clients, and we could leverage some existing facility in terms of spatial filtering, paging and  GeoJSON encoding. Here are a few example links from the GeoServer prototype:

Mind you, those links should be only used to get a feeling, the community module is not a complete nor fully correct implementation of WFS 3.0 core. That said, a couple of experimental clients can already successfully extract data from GeoServer WFS 3.0, including the new GDAL/OGR experimental driver.

Conclusions and Feedback

Generally speaking, working on this WFS 3.0 prototype has been a learning experience (OpenAPI 3 wise, after documenting the GeoServer REST API with Swagger 2.0), and a useful change of pace that will help acceptance and usage of OGC protocols among the current generation of GIS developers, both client and server side.

As far as the protocol itself is concerned, we believe that in order to see this protocol performing in the real world there is still work to be done which might result into extensions to cover what follows:

  • Scalability towards thousands of layers or more, maybe with some way to filter the API document and paging support for the contents document
  • Sorting and random paging support. This is crucial to use this protocol with real world datasets from web clients.
  • CRS and reprojection support, for various reasons, such as relieving clients from reprojection (they could only be interested in web mercator), supporting national laws requiring published data in certain local CRSs, and making sure no un-necessary datum shifts are performed when high precision is required.
  • A CRS extension that clearly specifies axis order used by the server, without having to refer to an external database that may or may not be there. Also, bake that information in responses when possible.
  • Sophisticated filtering, but the easy way… can we propose Extended CQL (GeoServer's own variant) as a base for human friendly filtering? This is has been used and reviewed already in OGC TestBed 13 to implement seamless filtering across WMS, WFS and WCS services ad described in the Fit-for-Purpose Engineering Report.
  • Schema declaration for cases where data actually follows a fixed schema (a must have for build complex filters, too). An OpenAPI schema will do in most cases, but for more complex ones, provide allowance to use XSD (think INSPIRE schemas for example).

Long story short, WFS 3.0 is a step in the right direction that will help spread adoption of a service that has in the past been limited by its complexity. The OpenAPI approach, allowing quick and automatic generation of ad-hoc client libraries should also favour its usage and reduce time to market for solutions based on OGC protocols.

The rich functionality provided by previous WFS versions should however not be ignored, but properly managed into a set of clear and well known extensions. Also, the core should be kept supple and easy to extend, in order to favour the wide variety of vendor extensions out there, helping the best of them to be recognized and shared to the wider community, much like GeoPackage already does.

Last but not least, it is worth to point out that we will perform more work on WFS 3.0 implementation for GeoServer throughout 2018, including adding other extensions, so stay tuned and follow this blog for more info.

And now, since you have read so far, if you are interested in learning about how we can help you achieving your goals with open source products like GeoServerMapStoreGeoNode and GeoNetwork through our Enterprise Support Services and GeoServer Deployment Warranty offerings, feel free to contact us!

The GeoSolutions team,

gvSIG Team: GIS applied to municipality management: Certification and links to the complete course

Planet OSGeo feeds - Mon, 03/12/2018 - 10:40

The certification of the course about Geographic Information Systems applied to municipality management is now available.

This certification period is opened after the publishing of the last modules of the course, but it will be open continuously, so that any user can get it at any moment when they finish the different modules.

To get this certification, a complete exercise must be completed, which includes some of the contents given during the course. Likewise, you must have at least 7 of the 10 existing activities correctly.

The exercise will validate the knowledge acquired during the course and will be evaluated by a tutor.

Apart from the delivery and passing grade of the exercise, the certification will have a minimum cost, necessary to cover the expenses related to the evaluation and certification. This cost will be € 30.

The certification will be issued by the gvSIG Association, and it will consist of two certificates:

  • Course completion certificate, which will include all the information related to the training contents acquired.
  • Official gvSIG User certificate, having completed the 90 credits necessary for this, and which gives the right to get the gvSIG Expert User certificate, passing the credits necessary for its validation, through the courses offered by the gvSIG Association.

The dedication time of the course is about 90 hours.

The exercise to be completed and the cartography to be used can be downloaded from the following link:

The steps to follow to send the exercise, as well as to make the payment in order to get the two certificates are explained in the first section of the practical exercise in detail.

If you haven’t taken the course yet, you can follow the different modules from the following links:

gvSIG Team: GIS applied to Municipality Management: Module 17 ‘gvSIG Mobile (Connection with gvSIG Desktop)’

Planet OSGeo feeds - Mon, 03/12/2018 - 10:38

The video of the seventeenth module is now available, where we will show the integration between gvSIG Desktop and gvSIG Mobile.

From now the certificate of the course about GIS applied to municipality management is available too, following the instructions indicated in this new post.

As we watched in the previous module, gvSIG Mobile plays an important role in the city council management, since it allows us to carry out census, inspections, inventory… management.

From gvSIG Mobile you can manage the inventory of a municipality (litter bins, lampposts, children’s parks …), and if there is an incidence in any of the elements, it won’t be necessary to describe the element to the technicians. The citizens would be able to go directly with their mobile, and locate the lamppost or litter bin to be repaired on the map in an easy way.

In this video we will explain how to create an empty layer in gvSIG Desktop, adding new fields to the attribute table, and we will export it to gvSIG Mobile. With the mobile application we will edit that layer, creating new elements (we can create a point, line or polygon layer), with or without using GPS, and we also can edit its alphanumeric information. Finally, we will export it to gvSIG Desktop in order to perform a more complete analysis.

As we told in the previous module, gvSIG Mobile is available for Android, and it can be downloaded for free from the Play Store.

In order to exchange files between both applications we will use the Spatialite databases, functionality that is available from gvSIG Desktop 2.4.

In a few days there will be a new plugin for that version that will allow to export and import complete projects (with notes, pictures …) between gvSIG Mobile and gvSIG Desktop, as well as to export a tile layer from gvSIG Desktop (an orthophoto or vector file) to gvSIG Mobile to be inserted as background. During the 3rd gvSIG Festival there will be a complete demonstration about the use of these new features.

Here you have the videotutorial of this module:

Related posts:

Gary Sherman: Where's my .qgis3 Folder?

Planet OSGeo feeds - Mon, 03/12/2018 - 09:00

There's been several posts to GIS StackExchange along the lines of:

Where's my .qgis3 folder?

Prior to QGIS 3, the .qgis/.qgis2 folder was found under your home directory. At version 3, the folder has moved to a more standard profile location for your operating system.

There are a couple of ways to determine where the folder is located:

  • Use the Settings->User Profiles->Open active profile folder menu item
  • Use QgsApplication.qgisSettingsDirPath from Python or the console

Here are the "standard" locations for Linux, Mac, and Windows, as found under your HOME directory:

  • Linux:
    • .local/share/QGIS/QGIS3/profiles/default
  • Mac OS X:
    • Library/Application Support/QGIS/QGIS3/profiles/default
  • Windows:
    • AppData\Roaming\QGIS\QGIS3\profiles\default

To get the location of your plugins directory, just add python/plugins to the appropriate location above. For example:

AppData\Roaming\QGIS\QGIS3\profiles\default\python\plugins

From the Settings->User Profiles menu, you'll notice a New profile item. This allows you to have multiple configurations of QGIS 3. Each new profile is created in the same "base" location as listed above. For example:

AppData\Roaming\QGIS\QGIS3\profiles\new_profile

From GIS to Remote Sensing: Minor Update: Semi-Automatic Classification Plugin v. 6.1.1

Planet OSGeo feeds - Sat, 03/10/2018 - 10:04
This post is about a minor update for the Semi-Automatic Classification Plugin (SCP) for QGIS, version 6.1.1.


This update is mainly related to Landsat preprocessing, in particular for the surface reflectance products.

GeoTools Team: GeoTools 19-RC1 Released

Planet OSGeo feeds - Fri, 03/09/2018 - 01:42
The GeoTools team is pleased to announce the release of GeoTools 19-RC1: geotools-19-RC1-bin.zip geotools-19-RC1-doc.zip geotools-19-RC1-userguide.zip geotools-19-RC1-project.zip maven repository As a release-candidate, 19-RC1 is not intended for production systems, however the API is stable and we invite everyone to try upgrading their applications, report any issues, and help out with the

GeoServer Team: GeoServer 2.13-RC1 Released

Planet OSGeo feeds - Thu, 03/08/2018 - 19:59

We are happy to announce the release of GeoServer 2.13-RC1. Downloads are available (zipwar, and exe) along with docs and extensions.

This is a release candidate of GeoServer made in conjunction with GeoTools 19-RC1.

We want to encourage people to test the release thoroughly and report back any issue found. With no further delay, let’s see what’s new, that is, what is there to test!

Isolated Workspaces

The concept of an “Isolated Workspaces” has been added to GeoServer, to allow for reusing a namespace among multiple workspaces. In particular, an isolated workspace allows reuse of a namespace already used by another workspace, but its resources (layers, styles, etc …) can only be retrieved when using that workspace’s virtual services and will only show up in those virtual service capabilities documents.

When reusing a namespace among workspaces, exactly one of those must be non-isolated, and the rest must be isolated; i.e. isolated workspaces have no restrictions in namespaces usage but the existing restrictions still apply for non isolated workspaces.

This is particularly useful for those publishing complex schemas for INSPIRE compliance. For more details, refer to the original proposal.

GeoWebCache REST API

Two new endpoints have been added to the GeoWebCache REST API:

  • /gwc/rest/blobstores:
    • GET /gwc/rest/blobstores for a list of the blobstores
    • GET /gwc/rest/blobstores/{blobStoreName} for details about a single blobstore
    • PUT /gwc/rest/blobstores/{blobStoreName} to create or update a blobstore
    • DELETE /gwc/rest/blobstores/{blobStoreName} to remove a blobstore
  • /gwc/rest/gridsets:
    • GET /gwc/rest/gridsets for a list of the gridsets
    • GET /gwc/rest/gridsets/{gridSetName} for details about a single gridset
    • PUT /gwc/rest/gridsets/{gridSetName} to create or update a gridset
    • DELETE /gwc/rest/gridsets/{gridSetName} to remove a gridset

API docs for these endpoints will be added to the GeoServer documentation shortly. Until then, the request body syntax for PUT requests closely matched the equivalent structures in geowebcache.xml: BlobStores and GridSets.

The ArcGISCache backed layers are now also configurable via the REST API.

This release sees a major reworking of the configuration system in GeoWebCache that will allow for plugging in alternate configuration persistence mechanisms in future. While these changes should be largely invisible to users, it is a huge update that impacts all of GeoWebCache. However, due to these changes, we ask that you please test the embedded GeoWebCache.

UI Improvements

Entering in URLs for data files has been improved with autocomplete – now GeoServer will scan the path that has already been typed, and suggest existing files within that path.

In addition, autocomplete support has been added to a number of dropdowns which contain a long list of values, such as stores or layers. You can now start typing the name of an option, and the visible options will be filtered to match.

Editing raster layer parameters made easier, from a wall a text input fields, to appropriate controls being used depending on the parameter type. Here is a “before and after” comparison:

Finally, error messages are now displayed both at top (as usual) and bottom (new!) in all configuration pages. This should make it easier to locate error messages, especially while editing styles:

 

GeoPackage performance improvements

GeoPackage reading and rendering performance improved significantly, up to two times faster on large datasets full extractions and 50% faster on small bounding box searches, bringing GeoPackage on par with PostGIS. We also have a Google spreadsheet with more details.

Shapefile remains king of full dataset extractions and the fastest data source for pure spatial driven queries.

WFS 2.0 and WMTS 1.0 OGC compliance work

During the past few months we have been involved in OGC Testbed 14 and significantly improved GeoServer compliance with WFS 2.0 and WMTS 1.0. The work involved numerous fixes in GeoServer/GeoWebCache, along with variuos fixes in the CITE tests themselves. The changes were too numerous to backport to the 2.12.x series, so if compliance with these protocols is important it’s time to consider an upgrade to the 2.13.x series. For details see these lists:

Work is still ongoing and a small number of issues are yet to be fixed, we’ll keep you updated.

Support for more PostGIS data types

The PostGIS data store now has simple support for HStore and JSON columns. HStore is returned as a Map and will render as a JSON formatted string field in common WFS output formats, while JSON is read as a string and rendered as-is. In both cases no special query support has been added for those types (but we’d be very happy if someone would work, or sponsor, that functionality too).

Better label position control in map rendering

When setting maxDisplacement on point/polygons the renderer used to search in a circular area around the designated label point.
The new displacementMode vendor option allows to control the positioning by specifying the preferred cardinal positions, as a comma separated list.

Coverage views from heterogeneous bands

Satellite data often comes as a set of heterogeenous resolution bands, due to multiple sensors having different native resolutions. It is yet useful to have all bands packaged on the same coverage, for ease of display (false color setups) and information (GetFeatureInfo). Coverage views now allow to mix those bands, coming from separate files and organized in a image mosaic, in a single multiband coverage view, resampling on the fly with configurable target resolution policies.

Removed OS X installers

Due to lack of resources and interest, the OS X dmg installers are no longer being built. OS X users can still use the system-independent binary.

New community modules and improvements

The 2.13 series comes with a few new community modules, in particular:

  • Do you want to generate GHRSST compliant outputs from GHRSST inputs? Try out the new GHRSST NetCDF output community module.
  • The mongodb community module provides an easy-to-use wrapper around the Ge0Tools mongodb data store, allowing you to publish geospatial data stored in mongodb.
  • There is also a new community module introducing NSG profiles for the WFS and WMTS services.

Existing community modules also got some love, in particular:

  • The WPS download module now allows to download large maps, and also build animations, generating MP4 courtesy of jcodec library. Both processes can (and should!) be invoked asynchronously to better handle long generation times. Here is an example of animation output:
http://blog.geoserver.org/wp-content/uploads/2018/02/response.mp4
  • The WPS download process now also allows control of GeoTiff output structure (tiling, compression) in raw raster downloads, as well as downloading granules part of a heterogeneous mosaic in their native CRS and native resolution
  • Various JDBCConfig and JDBCStore performance improvements, reducing the number of configuration database queries performed for each OGC request. Configuration queries are also consistently logged for further analysis

Note that community modules are not part of the release; instead you can find them in the nightly builds.

Other assorted improvements

New bug fixes and improvements since the beta are featured below, for more information please see the release notes (2.13-RC1 | 2.13-beta):

  • Async WPS does not report wrong output parameters
  • GetFeatureInfo requires high clicking precision when the WMS “max buffer” setting is zero
  • totalFeatures for WFS 2.0 request returns wrong count
  • CoverageStore HTML REST representation points to a coverage named after the store (instead of its actual name)
  • WPSDownload: per-granule resolution on target resolution
  • GeoWebCache fails to compute sub-gridset bounds for layers whose native CRS is wrong/cannot be recognized
  • Regression: GetLegendGraphics renderer lines thicker than they should
  • Backup/restore reports completion too soon
Test, test, test!

Now that you know about all the goodies, please go, download and test your favourite ones. Let us know how it went!

About GeoServer 2.13

GeoServer 2.13 is scheduled for March 2018 release.

gvSIG Team: 8 de marzo: Día Internacional de la Mujer. ¿Y el software libre qué?

Planet OSGeo feeds - Thu, 03/08/2018 - 11:47

Desde la Asociación gvSIG siempre hemos intentado aunar a la componente técnica del proyecto otras que entendemos fundamentales, como es la económica – base de la propuesta del modelo de negocio de la Asociación gvSIG – y la organizativa y social.
Desde esa visión de aplicar los derechos y libertades que otorga el software libre y una base teórica sobre la que poder construir un modelo colaborativo, solidario y basado en compartir conocimiento, uno de los aspectos sobre los que hemos reflexionado ha sido la lucha contra la discriminación de género.

Consideramos que dentro de un movimiento como el del software libre y los valores con los que éste se asocia, la ausencia manifiesta de mujeres debería resultarnos preocupante. Esto ocurre en el mundo del software libre en general, así como en el de la geomática. Y gvSIG tampoco escapa a esta realidad. Las pautas de comportamiento machista están ahí.

Un ejercicio muy sencillo y esclarecedor: revisen las fotos de los últimos congresos a los que hayan asistido. Os costará encontrar a las mujeres.

No sólo hay una ausencia significativa de mujeres, especialmente en la parte del desarrollo de software, sino que prácticamente no se trabaja para crear espacios que favorezcan su integración, y hasta creo que en parte este tipo de reflexiones se consideran innecesarias.
Desde la Asociación gvSIG pensamos que a todos nos toca empezar a trabajar para revertir esta situación.

gvSIG Team: GIS applied to Municipality Management: Module 16.3 ‘gvSIG Online (Connection with gvSIG Mobile and enumerations)’

Planet OSGeo feeds - Thu, 03/08/2018 - 10:39

The third video of the sixteenth module is now available, where we will show how to connect gvSIG Online with gvSIG Mobile and how to create enumerations in gvSIG Online.

Apart from the functionalities available in gvSIG Online we also have the possibility to connect with gvSIG Mobile, the open source GIS application for mobile devices with Android.

Basic editing tools are available from gvSIG Online in our device, even using GPS, as we watched in the previous modules, since it works on a browser. But apart from it we also can work with gvSIG Mobile from our Smartphone, being able to create new geometries and editing their alphanumeric information.

If we have the integration between both applications, one of the main advantages of working in the fields with gvSIG Mobile is that we don’t need internet connection to edit our layers.

From gvSIG Mobile we can connect to our gvSIG Online server, and download the layer that we want to edit on our mobile device. In this way we can edit it without internet connection, a common problem when we are working, for example, in a mountain area where our mobile is out of range. We would edit our layer, being able to use GPS, and in the end we would save changes. Finally, when we had internet connection, we would upload changes to the server.

Once the changes have been uploaded, if the layer was published in any of the projects, the modifications would appear when refreshing.

In this module we will also watch how to create enumerations in gvSIG Online. It will allow us to configure a field with certain possible values, so that it will make fieldwork easy when we are working with gvSIG Online. We can configure some values ​​for a specific field, and when editing the alphanumeric data, in that field we will have a drop-down with the possible values, so that we won’t make any mistake when writing.

Like in the previous module, you can’t perform this exercise directly, since an implementation of the gvSIG Online platform is necessary, but you can see all its functionalities. In the next module we will see the connection between gvSIG Mobile and gvSIG Desktop, which you can do, since both applications are available to download for free.

If you are interested in implementing gvSIG Online in your city council, or in any other organization, you can contact us, writing to this mail address: info@gvsig.com, where we will inform you about it.

Here you have the third videotutorial of this module:

Related posts:

CARTO Inside Blog: Patching Plain PostgreSQL for Parallel PostGIS Plans

Planet OSGeo feeds - Wed, 03/07/2018 - 11:39

CARTO users want to see maps drawn quickly, and drawing maps quickly means rendering every geometry in a table to an output format. By deploying the latest version of PostgreSQL to our infrastructure, we are taking advantage of improved parallel query support to make our maps and widgets go faster.

This would be the shortest blog post of all time except for one inconvenient fact: stock PostgreSQL 10 with stock PostGIS 2.4 doesn’t parallelize spatial queries very well at all.

In particular, for the kinds of routine calculations that CARTO runs, parallel processing doesn’t kick in:

  • Parallel scans still require higher function costs to come into action, even in reasonable cases.
  • Parallel joins on spatial conditions still seem to have poor planning, requiring a good deal of manual poking to get parallel plans.

To get the kind of parallel performance we wanted from PostgreSQL 10 + PostGIS 2.4 we had to tweak both packages a little bit.

  • PostgreSQL required two tweaks to the planner to generate more agressive parallel plans with PostGIS functions in them
  • PostGIS required a simple, yet extensive, tweak to add higher costs over the whole collection of PostGIS functions
PostgreSQL Planner Pain

For users of PostGIS, one of the big surprises (and disappointments) of stock parallel support in PostgreSQL 10 is that the planner only looks at the contents of the WHERE clause when determining if a scan should be parallelized.

-- This MAY be parallelized (if there enough rows) SELECT * FROM mytable WHERE ST_Area(the_geom_webmercator) > 10000

On the other hand, a query with even a very costly spatial function (like a buffer) on the SELECT line (what PostgreSQL hackers call the “target list”) won’t get parallelized no matter how many rows are in play.

-- This WON'T be parallelized SELECT ST_Buffer(the_geom_webmercator, 10) AS the_geom_webmercator FROM mytable

Fortunately for us at CARTO, this behaviour was pointed out on the pgsql-hackers email list only a couple months before we needed a fix.

If I have a slow function which is evaluated in a simple seq scan, I do not get parallel execution, even though it would be massively useful. Unless force_parallel_mode=ON, then I get a dummy parallel plan with one worker.
– Jeff Janes, pgsql-hackers, 2017-07-11

The ensuing discussion led to a revised patch from Amit Kapila of EnterpriseDB that would generate parallel plans for queries that included costly functions in the target list.

We took Amit’s patch and applied it to our PostgreSQL 10 fork, so we can deploy a stable PostgreSQL branch with improved parallelism behaviour for our use cases.

While Amit has continued to revise his patch over the succeeding months, it has not been committed to the main PostgreSQL development tree yet, so there’s no guarantee that PostgreSQL parallel behaviour for costly functions on the target list will improve in version 11.

The High(er) Costs of PostGIS

As a general proposition, the costs of PostGIS spatial functions are much much higher than the costs of ordinary functions in PostgreSQL. Even though all PostGIS functions are written in C, they still have to perform vastly more calculations to return a result than most standard PostgreSQL functions: computational geometry is complicated!

Prior to parallelism, the declared COST of a function would rarely effect the query plan generated by PostgreSQL – no matter what plan was chosen, the function result had to be calculated.

With parallelism though, the decision about whether or not to set up a parallel plan is a function of number of rows to be processed times function cost. A higher function cost can flip a plan over from single-worker to parallel.

PostGIS has not globally applied costs to functions in the past, because the planner had no use for it, and it’s a lot of work – there’s hundreds of functions in PostGIS. Why spend all that effort to add costs that would never actually affect a plan?

However, with Amit’s patch we had a use for costs, so we added explicit costs to a number of high-cost spatial functions.

CREATE OR REPLACE FUNCTION ST_Centroid(geography, use_spheroid boolean DEFAULT true) RETURNS geography AS 'MODULE_PATHNAME','geography_centroid' LANGUAGE 'c' IMMUTABLE STRICT _PARALLEL COST 100; What, Still Broken?

At this point, we had:

  • added a PostgreSQL planner patch to honor function costs more effectively, and
  • adjusted PostGIS function costs appropriately to capture the high cost of spatial functions.

So, we should be done! But we weren’t.

A lot of very heavily used PostGIS functions are actually SQL wrappers that cover up more complex combinations of other functions. For example:

CREATE OR REPLACE FUNCTION ST_Intersects(geom1 geometry, geom2 geometry) RETURNS boolean AS 'SELECT $1 && $2 AND _ST_Intersects($1,$2)' LANGUAGE 'sql' PARALLEL SAFE;

PostGIS expects that functions of this sort will be “inlined”. That PostgreSQL will, when finding one of these functions, replace the function with contents of the function definition. So:

SELECT * FROM a, B WHERE ST_Intersects(a.geom, b.geom)

Would be silently inlined as:

SELECT * FROM a, B WHERE a.geom && b.geom AND _ST_Intersects(a.geom, b.geom)

The trouble is that deep in the PostgreSQL code base is logic that determines if a given function can be inlined, and one of the things that determines whether inlining is allowed is if the functions being inlined are not too costly. And we just increased the costs of many of our functions.

The PostgreSQL inlining behaviour seems to be justified for users who use SQL wrapper functions as a way to force the caching of expensive calculations underneath the wrapper. That is never our use case at CARTO, so we don’t mind losing that behaviour in order to get back “sensible” inlining with our properly costed functions.

Again we applied a very small patch to our PostgreSQL 10 stable branch.

The problem of losing inlining behaviour was discussed on the pgsql-hackers list in November 2017, but no patch was offered, and our patch is not suitable for general application since it changes behaviours that some users might want to retain.

I Want That

The simplest way to ape the CARTO installation is to just use our patched PostgreSQL and PostGIS forks:

If you want to roll your own, you can:

From GIS to Remote Sensing: Major Update: Semi-Automatic Classification Plugin v. 6.1.0

Planet OSGeo feeds - Wed, 03/07/2018 - 10:00
I have updated the Semi-Automatic Classification Plugin to v. 6.1.0.
This new version includes several bug fixing and a new button in the tab Download products that allows for the display of OpenStreetMap tiles (© OpenStreetMap contributors) in the QGIS map as described in https://wiki.openstreetmap.org/wiki/QGIS . The cartography is licensed as CC BY-SA (Tile Usage Policy).


gvSIG Team: Free registration for the 3rd gvSIG festival is now open

Planet OSGeo feeds - Tue, 03/06/2018 - 17:23

Free registration period for the 3rd gvSIG Festival is now open. The gvSIG Festival is a virtual conference about gvSIG that will be held in March 21st and 22nd.

During the Festival there will be several presentations in English and Spanish, including a presentation about how to use gvSIG Mobile, the GIS application for mobile devices for field data gathering, or how to apply gvSIG in the field of archaeology or mining. You can check the full program of the gvSIG Festival on the event website.

The webinar platform allows to connect to the webinars from any operating system, and in case you can’t see some of the webinars, you will be able to watch them at the gvSIG Youtube channel later.

Registration for each webinar can be done from the program page of the gvSIG Festival website.

See you at the gvSIG Festival!

gvSIG Team: Abiertas las inscripciones gratuitas para el 3er gvSIG Festival

Planet OSGeo feeds - Tue, 03/06/2018 - 17:14

Ya están abiertas las inscripciones gratuitas para el 3er gvSIG Festival, las jornadas virtuales de gvSIG que se celebrarán los días 21 y 22 de marzo.

En estas jornadas se mostrará, entre otras cosas, cómo utilizar gvSIG Mobile, la aplicación SIG para dispositivos móviles para la toma de datos en campo, o cómo aplicar gvSIG en el campo del medio ambiente. Aparte, habrá varias ponencias en inglés, como una de gvSIG aplicado a criminología, o de geoestadística con gvSIG entre otras. Podéis consultar el programa completo del gvSIG Festival en la página web del evento.

La plataforma de webinar permite conectarse desde cualquier sistema operativo, y en caso de no poder seguirlos en directo podréis verlos a posteriori, ya que se publicarán en el canal de Youtube del proyecto.

La inscripción a cada uno de los webinars puede realizarse desde el propio programa en la web del evento.

¡Os esperamos!

GeoSolutions: GeoNode Summit 2018

Planet OSGeo feeds - Tue, 03/06/2018 - 13:46

Dear Reader,

GeoSolutions will sponsor and participate to the GeoNode Summit 2018 which will take place in Turin, Italy from 26th to 28th of March 2018. It will bring together developers and users of GeoNode for an intense 3 days marathon that will cover users and developers workshops, thematic presentation on how organizations are using GeoNode and, last but not least, a roadmapping session to talk about the future of GeoNode itself. The programme is available here (mind you, this is still changing to accomodate new content).

Alessio Fabiani, our GeoNode Technical Lead will provide the user workshop on the afternoon of the 26th, moreover we will provide two presentations on the 27th:

  • Challenge Fund Data Exploration, with Giovanni Allegri at 3 pm
  • One GeoNode, Many GeoNode, with Alessio Fabiani at 3:15 pm

We will also attend the roadmapping meeting on the 28th to discuss about the future of GeoNode and our plans for a more robust integration with GeoServer, as well as our plans for using MapStore as the mapping front-end.

If you want to learn more about GeoNode's functionalities or leverage on the experience of other organisations using it you should attend. We also encourage newcomers to attend and learn from real-world experience as well as from the developers what GeoNode can do for them; the event will give attendees a unique opportunity to discuss with the developers as well as with other users and avoid pitfalls and commons mistakes while making your way into the GeoNode world!

We would like to thank ITHACA for hosting the event. You can find more information about logistics here. So see you in Turin!

Since you have read so far, if you are interested in learning about how we can help you achieving your goals with open source products like GeoServerMapStoreGeoNode and GeoNetwork through our Enterprise Support Services and GeoServer Deployment Warranty offerings, feel free to contact us!

The GeoSolutions team,

gvSIG Team: Nueva plataforma gvSIG Training y curso gratuito

Planet OSGeo feeds - Tue, 03/06/2018 - 12:51

La Asociación gvSIG y GeoAlternativa, colaboradora oficial, dan un paso más en el esfuerzo conjunto por difundir el uso de la Geomática Libre.

GeoAlternativa, además de ser especialistas en Geomática Libre, tiene un fuerte componente ambiental y de Educación cooperativa, estando todo el equipo capacitado en facilitación de procesos de aprendizaje.


Por eso, nuestra nueva plataforma educativa, gvSIG Training, está desarrollada por el equipo de GeoAlternativa y será gestionada en colaboración con la propia Asociación gvSIG. Esperamos que os guste y estamos abiertos a sugerencias para que sea la plataforma educativa de todos y todas.

¡Y qué mejor manera de estrenar una plataforma educativa y la reciente versión 2.4 de gvSIG que con un curso gratuito! GeoAlternativa, para celebrar esta colaboración, libera parte de su curso de gvSIG aplicado a Medio Ambiente.

A través de este curso podréis aprender a manejar gvSIG desde cero, realizando ejercicios prácticos aplicados al trabajo medioambiental y adquiriendo más destreza y conocimientos semana tras semana.

Es un curso de matrícula abierta, así que podréis realizarlo a vuestro ritmo. Ya tenéis disponible el primer tema para que comencéis.

Para conocer la nueva plataforma y matricularos en el curso es necesario acceder a www.geoalternativa.com/gvsig-training y elegir el curso de gvSIG aplicado a Medio Ambiente. Después debéis elegir la opción “Registrarse como usuario” y, por último, matricularos en él.

¡Nos vemos en gvSIG Training!

gvSIG Team: GIS applied to Municipality Management: Module 16.2 ‘gvSIG Online (Basic editing, hyperlink…)’

Planet OSGeo feeds - Mon, 03/05/2018 - 12:07

The second video of the sixteenth module is now available, where we will continue showing how to work with gvSIG Online.

As we talked about in the previous video, gvSIG Online is an integral solution on free software for the spatial information management of an organization following the Spatial Data Infrastructures (SDI) model.

In the first video of this module we watched how to connect with gvSIG Desktop, being able to do an advanced editing directly in the desktop application and publishing that information in gvSIG Online.

In this second video we will see the editing tools that are available in gvSIG Online, a more basic editing for field work, with our mobile device, since we can edit directly on the web.

We will also see how to create hyperlinks in gvSIG Online, a very useful feature that will allow us to link the documents related to the town planning regulations of a municipality among other documents. It will allow the citizen to get that information without having to go to the city hall. The citizen would look for his parcel on the gvSIG Online project, and using the information tool he/she would get the PDF file with all the information.

Like the previous module, you can’t perform this exercise directly, since it is necessary to implement the platform, but you can see everything that can be done with gvSIG Online.

If you are interested in implementing gvSIG Online in your city council, or in any other organization, you can contact us, writing to this mail address: info@gvsig.com, where we will inform you about it.

Here you have the second videotutorial of this module:

Related posts:

GRASS GIS: GRASS GIS 7.0.6 LTS released

Planet OSGeo feeds - Fri, 03/02/2018 - 10:05
We are pleased to announce the new LTS release of GRASS GIS 7.0

Pages

Subscribe to soilinformationstandards.org aggregator