CLMS QC Tool Release 1.4.3

Release Notes

The open-source (OSS) Copernicus Quality Assurance (QA) tool is a web-based application for performing automatic checks on Copernicus vector and raster products and submitting checked products to EEA. The version 1.4.3 has following new features:

• Updated definitions of HRL 2018 products
• User interface changes (new logos, documentation links)
• QC tool version number is included in PDF reports
• Admin user can QC and delete other user's deliveries

System requirements:

• For a user: a web browser with Internet or Intranet connection.
• For a EEA service provider: a computer (or virtual machine) accepting outside network connections with docker software and at least 10 GB storage for uploaded files.
  ** The runtime environment is organized into two separate services (Frontend and Worker) running as docker containers.
  ** The worker containers can be distributed across multiple hosts.
  ** In case of distributing the services across multiple hosts, a shared network drive (such as NFS) must be available on all participating host nodes.

Quick installation (requires docker software):

(1) Download this release zip file: https://github.com/eea/copernicus_quality_tools/archive/1.4.3.zip
(2) Unzip the zip file.
(3) Navigate to the docker subfolder.
(4) Inside the the docker subfolder, run the following commands:

docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app pull
docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app up --scale worker=4

User and technical documentation:

https://github.com/eea/copernicus_quality_tools/wiki

Docker container installation images:

https://hub.docker.com/r/eeacms/copernicus-qctool-frontend
https://hub.docker.com/r/eeacms/copernicus-qctool-worker

Supported product definitions:

• General vector product
• General raster product
• Corine Land Cover (2012, 2018)
• Urban Atlas 2012 (Geodatabase and Shapefile versions)
• Riparian Zones
• Natura 2000
• High Resolution Layers:
  ** Small Woody Features, combined vector and 5 m raster product
  ** Small Woody Features, 100m raster product
  ** Imperviousness Density, 7 products (10 m, 20 m and 100 m rasters)
  ** Tree Cover / forest, 14 products (10m, 20m and 100m rasters)
  ** Grassland, 5 products (10m, 20m and 100m rasters)
  ** Water and Wetness, 3 products (10m and 100m rasters)

Copernicus QC Tool Release 1.3.4

Release Notes

The open-source (OSS) Copernicus Quality Assurance (QA) tool is a web-based application for performing automatic checks on Copernicus vector and raster products and submitting checked products to EEA. The version 1.3.4 has following new features:

• Introduced new vector.area check. Every area column in all product definitions have got its own area check.
• ua_2012_shp product definition have got geometry check which was missing.
• vector.attribute check has "ignored" parameter. The columns shape_length and shape_area are ignored when checking attributes of Small Woody Features product.

System requirements:

• For a user: a web browser with Internet or Intranet connection.
• For a EEA service provider: a computer (or virtual machine) accepting outside network connections with docker software and at least 10 GB storage for uploaded files.
  ** The runtime environment is organized into two separate services (Frontend and Worker) running as docker containers.
  ** The worker containers can be distributed across multiple hosts.
  ** In case of distributing the services across multiple hosts, a shared network drive (such as NFS) must be available on all participating host nodes.

Quick installation (requires docker software):

(1) Download this release zip file: https://github.com/eea/copernicus_quality_tools/archive/1.3.2.zip
(2) Unzip the zip file.
(3) Navigate to the docker subfolder.
(4) Inside the the docker subfolder, run the following commands:

docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app pull
docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app up --scale worker=4

User and technical documentation:

https://github.com/eea/copernicus_quality_tools/wiki

Docker container installation images:

https://hub.docker.com/r/eeacms/copernicus-qctool-frontend
https://hub.docker.com/r/eeacms/copernicus-qctool-worker

Supported product definitions:

• General vector product
• General raster product
• Corine Land Cover (2012, 2018)
• Urban Atlas 2012 (Geodatabase and Shapefile versions)
• Riparian Zones
• Natura 2000
• High Resolution Layers:
  ** Small Woody Features, combined vector and 5 m raster product
  ** Small Woody Features, 100m raster product
  ** Imperviousness Density, 7 products (10 m, 20 m and 100 m rasters)
  ** Tree Cover / forest, 13 products (10m, 20m and 100m rasters)
  ** Grassland, 6 products (10m, 20m and 100m rasters)
  ** Water and Wetness (10m and 100m rasters)

Copernicus QC Tool release 1.3.3

Release Notes

The open-source (OSS) Copernicus Quality Assurance (QA) tool is a web-based application for performing automatic checks on Copernicus vector and raster products and submitting checked products to EEA. The version 1.3.3 has following new features:

• Optimized speed and fixed out-of-memory issue in Small Woody Features (SWF) vector minimum mapping length check (taskman issue #105058).
• Adjusted error threshold in raster / vector area comparison check (taskman issue #105057).

System requirements:

• For a user: a web browser with Internet or Intranet connection.
• For a EEA service provider: a computer (or virtual machine) accepting outside network connections with docker software and at least 10 GB storage for uploaded files.
  ** The runtime environment is organized into two separate services (Frontend and Worker) running as docker containers.
  ** The worker containers can be distributed across multiple hosts.
  ** In case of distributing the services across multiple hosts, a shared network drive (such as NFS) must be available on all participating host nodes.

Quick installation (requires docker software):

(1) Download this release zip file: https://github.com/eea/copernicus_quality_tools/archive/1.3.2.zip
(2) Unzip the zip file.
(3) Navigate to the docker subfolder.
(4) Inside the the docker subfolder, run the following commands:

docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app pull
docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app up --scale worker=4

User and technical documentation:

https://github.com/eea/copernicus_quality_tools/wiki

Docker container installation images:

https://hub.docker.com/r/eeacms/copernicus-qctool-frontend
https://hub.docker.com/r/eeacms/copernicus-qctool-worker

Supported product definitions:

• General vector product
• General raster product
• Corine Land Cover (2012, 2018)
• Urban Atlas 2012 (Geodatabase and Shapefile versions)
• Riparian Zones
• Natura 2000
• High Resolution Layers:
  ** Small Woody Features, combined vector and 5 m raster product
  ** Small Woody Features, 100m raster product
  ** Imperviousness Density, 7 products (10 m, 20 m and 100 m rasters)
  ** Tree Cover / forest, 13 products (10m, 20m and 100m rasters)
  ** Grassland, 6 products (10m, 20m and 100m rasters)
  ** Water and Wetness (10m and 100m rasters)

Copernicus QC Tool release 1.3.2

Release Notes

The open-source (OSS) Copernicus Quality Assurance (QA) tool is a web-based application for performing automatic checks on Copernicus vector and raster products and submitting checked products to EEA. The version 1.3.2 has following new features:

• Fixed issue in Small Woody Features (SWF) vector layer naming (taskman issue #106565).
• Fixed bug in minimum mapping width where features with width up to MMW * 2 were reported as warnings (taskman issue #106370).
• Changed visibility of deleted files in admin accounts (taskman issue #106579)
• Introduced new check: minimum mapping length (#105058)
• Introduced new check: maximum mapping width (#105062)
• Introduced new check: compactness (#105063)
• Minimum mapping width check is only applied for patchy SWF (#105819)

System requirements:

• For a user: a web browser with Internet or Intranet connection.
• For a EEA service provider: a computer (or virtual machine) accepting outside network connections with docker software and at least 10 GB storage for uploaded files.
  ** The runtime environment is organized into two separate services (Frontend and Worker) running as docker containers.
  ** The worker containers can be distributed across multiple hosts.
  ** In case of distributing the services across multiple hosts, a shared network drive (such as NFS) must be available on all participating host nodes.

Quick installation (requires docker software):

(1) Download this release zip file: https://github.com/eea/copernicus_quality_tools/archive/1.3.2.zip
(2) Unzip the zip file.
(3) Navigate to the docker subfolder.
(4) Inside the the docker subfolder, run the following commands:

docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app pull
docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app up --scale worker=4

User and technical documentation:

https://github.com/eea/copernicus_quality_tools/wiki

Docker container installation images:

https://hub.docker.com/r/eeacms/copernicus-qctool-frontend
https://hub.docker.com/r/eeacms/copernicus-qctool-worker

Supported product definitions:

• General vector product
• General raster product
• Corine Land Cover (2012, 2018)
• Urban Atlas 2012 (Geodatabase and Shapefile versions)
• Riparian Zones
• Natura 2000
• High Resolution Layers:
  ** Small Woody Features, combined vector and 5 m raster product
  ** Small Woody Features, 100m raster product
  ** Imperviousness Density, 7 products (10 m, 20 m and 100 m rasters)
  ** Tree Cover / forest, 13 products (10m, 20m and 100m rasters)
  ** Grassland, 6 products (10m, 20m and 100m rasters)
  ** Water and Wetness (10m and 100m rasters)

Copernicus QC Tool release 1.3.0

Release Notes

The open-source (OSS) Copernicus Quality Assurance (QA) tool is a web-based application for performing automatic checks on Copernicus vector and raster products and submitting checked products to EEA. The version 1.3.0 has following new features:

• Postgis and worker run in the same container. This allows simplified horizontal scaling with multiple Postgis
• Error file attachements have been changed from shapefile to GeoPackage format. This allows having attachments larger than 2.0 GB shapefile limitation.
• Introduced new check vector.max_area for checking maximum mapping unit in small woody features.
• Introduced new check vector.layer_area for checking if area sum of vector layer matches area sum of raster .layer.
• Introduced new check vector.change for checking if initial year and reference year have distinct class codes.
• Administration interface changes - administrator user has access to deliveries, job history and uploaded files of all other users.

System requirements:

• For a user: a web browser with Internet or Intranet connection.
• For a EEA service provider: a computer (or virtual machine) accepting outside network connections with docker software and at least 10 GB storage for uploaded files.
  ** The runtime environment is organized into two separate services (Frontend and Worker) running as docker containers.
  ** The worker containers can be distributed across multiple hosts.
  ** In case of distributing the services across multiple hosts, a shared network drive (such as NFS) must be available on all participating host nodes.

Quick installation (requires docker software):

(1) Download this release zip file: https://github.com/eea/copernicus_quality_tools/archive/1.3.0.zip
(2) Unzip the zip file.
(3) Navigate to the docker subfolder.
(4) Inside the the docker subfolder, run the following commands:

docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app pull
docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app up --scale worker=4

User and technical documentation:

https://github.com/eea/copernicus_quality_tools/wiki

Docker container installation images:

https://hub.docker.com/r/eeacms/copernicus-qctool-frontend
https://hub.docker.com/r/eeacms/copernicus-qctool-worker

Supported product definitions:

• General vector product
• General raster product
• Corine Land Cover (2012, 2018)
• Urban Atlas 2012 (Geodatabase and Shapefile versions)
• Riparian Zones
• Natura 2000
• High Resolution Layers:
  ** Small Woody Features, combined vector and 5 m raster product
  ** Imperviousness Density, 7 products (10 m, 20 m and 100 m rasters)
  ** Tree Cover / forest, 13 products (10m, 20m and 100m rasters)
  ** Grassland, 6 products (10m, 20m and 100m rasters)
  ** Water and Wetness (10m and 100m rasters)

Copernicus QC Tool release 1.2

Release Notes

The open-source (OSS) Copernicus Quality Assurance (QA) tool is a web-based application for performing automatic checks on Copernicus vector and raster products and submitting checked products to EEA. The version 1.2 has following new features:

• Multiple quality controls (QC jobs) can be launched from the home page in batch.
• The QC jobs are added to a queue
• Multiple worker containers pull QC jobs from the queue.
• The architecture is horizontally scalable.
• QC result page includes PDF report and shapefile attachments of error, exception and warning features.
• Job log history is accessible for all QC jobs run by a user on a delivery with the same file name.
• AOI boundary management
• Introduced new check modules and improved performance of long-running checks

System requirements:

• For a user: a web browser with Internet or Intranet connection.
• For a EEA service provider: a computer (or virtual machine) accepting outside network connections with docker software and at least 10 GB storage for uploaded files.
  ** The runtime environment is organized into three separate services (Frontend, Worker and PostGIS) running as docker containers.
  ** The worker containers can be distributed across multiple hosts.
  ** In case of distributing the services across multiple hosts, a shared network drive (such as NFS) must be available on all participating host nodes.

Quick installation (requires docker software):

(1) Download this release zip file: https://github.com/eea/copernicus_quality_tools/archive/v1.2.2.zip
(2) Unzip the zip file.
(3) Navigate to the docker subfolder.
(4) Inside the the docker subfolder, run the following commands:

docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app pull
docker-compose -f ./docker-compose.service_provider.yml -p qc_tool_app up --scale worker=4

User and technical documentation:

https://github.com/eea/copernicus_quality_tools/wiki

Docker container installation images:

https://hub.docker.com/u/qctool

Supported product definitions:

• General vector product
• General raster product
• Corine Land Cover (2012, 2018)
• Urban Atlas 2012 (Geodatabase and Shapefile versions)
• Riparian Zones
• Natura 2000
• High Resolution Layers:
  ** Small Woody Features, combined vector and 5 m raster product
  ** Imperviousness Density, 7 products (10 m, 20 m and 100 m rasters)
  ** Tree Cover / forest, 13 products (10m, 20m and 100m rasters)
  ** Grassland, 6 products (10m, 20m and 100m rasters)
  ** Water and Wetness (10m and 100m rasters)