talk · Tuesday 22 September · 14:00–⁠14:15 · ODIN

AURORA - A Shiny app designed to create Darwin Core Archives from messy biodiversity datasets

Sara Araújo · Semantic Interoperability and Standards Infrastructure

Recording time 5:30:42–5:41:53Open on Vimeo ↗

Summaries and key moments are machine-produced. Check the recording for the speaker’s exact words.

The short versionAURORA lowers the barrier to Darwin Core publication by guiding researchers step by step from messy tables to standard-compliant tables and metadata.

Overview

What this was about

Sara Araújo presents the AURORA Shiny app, a browser-based R Shiny workflow of eight steps that turns non-standard occurrence tables into Darwin Core tables ready for publication. It supports tidying, header-to-term mapping with suggestions, creating ID and dependent fields, repository-specific required-term validation (OBIS, GBIF, EMODnet Biology), date and coordinate conversion, taxonomic cleaning and matching against WoRMS or the GBIF backbone, event/occurrence restructuring, eMoF creation, quality control and IPT-style metadata. It does not build the archive itself (the IPT does) and currently supports only a limited set of cores and extensions.

Why it matters. Standardization is a main barrier to data publication; a free, guided tool can bring more datasets into GBIF, OBIS and EMODnet.

Key ideas

In the room

  • Eight-step workflow: upload/tidy, map headers to Darwin Core terms, create key fields, validate required terms, transform dates and coordinates, clean and match taxonomy, structure event core/occurrence/eMoF, quality control and metadata export.
  • Required terms adapt to the target repository (OBIS, GBIF, EMODnet Biology).
  • Taxonomic validation via WoRMS (marine) or GBIF backbone (terrestrial) retrieves scientificNameID and taxonRank.
  • eMoF measurements are assigned to events (e.g. temperature) or occurrences (e.g. life stage) and can use controlled vocabularies.
  • Quality control produces logs, summaries and issue flags.
  • Limitations: does not create the DwC-A (use the GBIF IPT); only event core + occurrence + eMoF or occurrence core + eMoF; users must know their data and basic Darwin Core.
  • Funded by the EU via the DTO-BioFlow project; user manual, video tutorial and source code on GitHub.
Jump in

Notable moments

In their words

Transcript

Automatically generated captions can contain mistakes, especially in names and technical terms. Times are relative to the room recording.

Read the transcript ↓
Loading transcript…
Programme abstract

AURORA - A Shiny app designed to create Darwin Core Archives from messy biodiversity datasets

Sara Araújo

Biodiversity monitoring data are commonly stored in heterogeneous tabular formats, hindering standardisation, validation, and publication through public repositories. Researchers often face technical challenges, such as taxonomic variations and multiple date and geospatial format inconsistencies, that must be addressed before datasets can be submitted to global repositories like GBIF. To address these challenges, we developed the AURORA Shiny application that provides an intuitive, end-to-end workflow for transforming raw datasets into publication-ready Darwin Core tables. The application supports data ingestion from diverse tabular formats, enabling users to convert raw datasets into tidy data format. An interactive mapping interface allows users to align user-specific fields with Darwin Core terms by combining manual selection with automated suggestions and mandatory-field validation. The tool automates essential data-cleaning tasks for taxonomic integrity by integrating API calls to the WoRMS and GBIF Backbone Taxonomies and facilitates the use of controlled vocabulary in the Extended Measurement or Fact table. Finally, a quality control module offers diagnostics on data completeness and identifies missing key fields, providing detailed information about issues and errors for tracing and resolution. Currently, the Occurrence, Event, and extended Measurement or Fact extension DwC tables are available for export. A metadata form that follows the GBIF IPT format is provided to allow prefilling and downloading, facilitating metadata review among dataset authors. The output comprises standards-compliant DwC tables ready for publication. By streamlining these time-consuming processes into a user-friendly interface, this application reduces the technical barriers to biodiversity data mobilization and global sharing. The application is accessible to the public via a web browser by accessing https://bio-shiny.ua.pt/aurora/

Submitted to the conference programme before the talk, so the talk itself may differ.