talk · Thursday 24 September · 11:20–⁠11:35 · SAL C

Phenobase: a harmonized, AI-ready knowledge base of global plant phenology

Robert Guralnick · From Mobilizing Data to AI-Ready Knowledge: Infrastructure for Multimodal Biodiversity Data

Recording time 3:39:26–3:55:27Open on Vimeo ↗

Summaries and key moments are machine-produced. Check the recording for the speaker’s exact words.

The short versionCombining ontologies with machine learning lets Phenobase close global phenology data gaps, but making the result AI-ready requires per-record model provenance, quality and citation.

Overview

What this was about

Robert Guralnick presented Phenobase, an open, integrated database of global in situ plant phenology. It rests on the Plant Phenology Ontology, which harmonises monitoring-programme terms and supports inference, with extensions for observations of only part of a plant. To fill large geographic and taxonomic gaps, the team trained models on 1.5–2 million iNaturalist phenology annotations (masked-autoencoder pre-training) and a separate ensemble for herbarium sheets. They reached about 98% accuracy for flowers and 95% for fruits, and machine-labelled records now make up about 97% of records and fill many empty grid cells. He said making Phenobase AI-ready was the hard part: per-record model URIs and quality scores, provenance links back to sources, data dictionaries, update strategies and citation policies.

Why it matters. Phenology is a key climate-change indicator. Phenobase shows a working pattern for turning images from citizen science and herbaria into trustworthy, reusable trait data with provenance attached to each record.

Key ideas

In the room

  • Phenology monitoring programmes use incompatible, bespoke terminology; the Plant Phenology Ontology provides URIs and logical axioms for integration and inference (e.g. count of leaf buds implies presence).
  • Images show only part of a plant, so absence inferences differ from whole-plant monitoring; the ontology was adapted accordingly.
  • Integrated sources include USA-NPN, herbarium specimens, NEON and the Pan-European Phenology dataset.
  • iNaturalist has about 110 million angiosperm observations (150,000 in one recent weekend) and 1.5–2 million human phenology annotations.
  • Model uses masked autoencoder pre-training with threshold tuning and humans in the loop: about 98% for flowers and 95% for fruits (present), close to human performance; a separate ensemble model scores GBIF-imaged herbarium sheets.
  • About 97% of Phenobase records are machine-annotated; new data fill many previously empty grid cells.
  • AI-readiness requires per-record model URI (Hugging Face), per-record quality scores from family-level accuracy, traceable links to source records, data dictionaries, a portal plus Zenodo deposit, and clear data use and citation policies.
Jump in

Notable moments

In their words

Transcript

Automatically generated captions can contain mistakes, especially in names and technical terms. Times are relative to the room recording.

Read the transcript ↓
Loading transcript…
Programme abstract

Phenobase: a harmonized, AI-ready knowledge base of global plant phenology

Robert Guralnick

Plant phenology shapes ecosystem dynamics, species interactions and serves as a sensitive indicator of environmental change. Sources of global phenology data have exponentially increased but remain siloed and fragmented. In situ monitoring networks produce rigorous repeated observations, but are typically regional and disconnected. Digitized herbarium specimens and community-science platforms such as iNaturalist offer vast spatial, temporal, and taxonomic breadth but phenology information is latent in images and unstructured metadata. Phenobase addresses these gaps by assembling these sources into a harmonized knowledge base. We first applied computer-vision models (PhenoVision and PhenoVision-Leaf) to score presence of open flowers, fruits, breaking leaf buds, green leaves, and colored leaves across tens of millions of iNaturalist records. We used an different, ensemble-based ML model approach trained via expert annotations for labeled flowers on herbarium sheets to score millions of available imaged herbarium sheets. Finally, we assembled in-situ monitopring data from USA-NPN, NEON, PhenObs, Budburst, and SeasonWatch. Phenobase harmonizes these sources using the Plant Phenology Ontology which maps source-specific phenophase terms to shared trait concepts while preserving contextual metadata. Model certainty thresholds, validation accuracies, ML model version, and family-level performance metrics travel with each record, so downstream users can filter on quality. Phenobase data are openly available and show how machine-learning extraction, ontology-based integration, and standardized provenance metadata turn heterogeneous biodiversity collections into AI-ready data products. We close by discussing next-step challenges with maintaining and growing such resources.

Submitted to the conference programme before the talk, so the talk itself may differ.