talk · Tuesday 22 September · 11:48–⁠12:02 · ODIN

The Swedish experience on verification and how to improve quality on observations

Mora Aronsson · Data Quality: From Standard to Practice

Recording time 3:16:26–3:31:08Open on Vimeo ↗

Summaries and key moments are machine-produced. Check the recording for the speaker’s exact words.

The short versionHuman verification remains essential, and the community needs a standard to exchange verification status between systems.

Overview

What this was about

Mora Aronsson describes human verification of species observations in Sweden's Artportalen, as distinct from automated validation. Quality now covers not only identity but accurate positions, especially for red-listed, sensitive and EU-regulated invasive species. About 480-500 contracted, trained verifiers handle roughly 20,000 observations a day (about 7.5 million a year in Artportalen alone), aiming to verify around 10%, with focus on rare, threatened and invasive species. The main open problem is communicating verification status between databases and back to primary repositories, for which a standard is needed.

Why it matters. Without a way to share verification results, corrected or doubtful records keep circulating uncorrected through aggregators.

Key ideas

In the room

  • Position accuracy has become as important as identification, driven by protected and invasive species legislation.
  • Verification focuses on rare birds, species new to the country, outliers, threatened and invasive species.
  • Verification classes range from expert-determined samples to trusted reporters; "not approved" is used sparingly after dialogue with reporters.
  • Verifiers receive education and sign contracts covering confidentiality of sensitive data and courteous behaviour.
  • Artportalen has had verification for about 25 years (initially birds).
  • Coverage is biased: birds and vascular plants have higher verification rates.
  • Verification results need to flow between databases and back to primary repositories.
Jump in

Notable moments

In their words

Transcript

Automatically generated captions can contain mistakes, especially in names and technical terms. Times are relative to the room recording.

Read the transcript ↓
Loading transcript…
Programme abstract

The Swedish experience on verification and how to improve quality on observations

Mora Aronsson

Quality on observations is always a challenge as we often know was needed but human and/or economic resources are lacking. Today technical validation is well implemented in most observations system (date is existing and relevant, coordinates is in a relevant area and more). AI has the last years been of great help to find anomalies in the reported observations, but it still a need for a human eye and brain to perform the last step. To get the final approved och not approved. For some observations (e.g. red listed species under debate by forestry or species under legal act as species listed in European regulation on invasive species) the verification by human is needed for companies and agencies to guarantee that the observation is correctly identified and reported from right place. Since more than 2000 years Sweden has been evolving a quality assessment of observations, both by technical validation and human verification to reach as good quality as possible. The last five years have the verification system been improved to meet new legal requirements with more strict rules and, new tools and improved education of both the users and the persons doing verification. The Swedish system will can also be used as test for the BDQ-Standard. The presentation will cover the system with verification system, categories,contract and education of people doing the verification and contract. It will also cover the results from the work with the “new” verification system in Sweden.

Submitted to the conference programme before the talk, so the talk itself may differ.