Seminar: Ladislav Hodac
Institutsseminar
- Datum: 30.11.2023
- Uhrzeit: 14:30
- Vortragende(r): Ladislav Hodac
- (Reichstein department) ONLINE ONLY
Capture of plant phenotypes in situ with computer vision versus biological shape analysis: conflict or covariation?
Plant leaves vary not only between species, but also within populations of the same species. A persistent challenge in botany is to accurately document this variation directly in a plant's natural environment. In this study, we investigate the phenotypic variation of buttercup leaves in natural plant populations using an easy-to-use smartphone app called Flora Capture, designed for citizen scientists. We exploit the strengths of machine learning and geometric morphometrics to address three key questions: (1) Can smartphone images effectively capture leaf variation comparable to traditional herbarium methods? (2) Do image differences detected by computer vision correspond to actual variation in leaf shape? (3) Can smartphone images of leaves achieve detailed resolution for identifying plants at high taxonomic levels? Our approach incorporates several deep learning techniques, including Grad-CAM for interpretable AI and EfficientNet for feature extraction from images. We analyze the same leaves using computer vision and quantitative morphology - by extracting their shapes using landmark geometric morphometrics. Through dimension reduction and covariation analysis, we discover common patterns in both the image features and the corresponding biological shapes. Using machine learning algorithms such as Random Forest and Support Vector Machine, we evaluate the suitability of leaf images for classifying plant populations at high taxonomic levels. The goal is to understand the decision-making processes of computer vision in biological shape classification. This work represents a step towards reliable and reproducible phenotyping of plants in their natural habitats.