Loading Events

« All Events

  • This event has passed.

SWC Research @Semantics 2024

September 18 @ 1:00 pm - 1:30 pm

Investigate the Impact of Contextual Information on LLMs for Taxonomy Expansion

This paper presents an exploratory study that investigates the use of various Large Language Models (LLMs) for the task of taxonomy expansion.

Our objective is to enhance the taxonomical structure by querying LLMs for (1) child taxons and (2) alternative labels of existing taxons. Beginning with an incomplete taxonomy, we explore the most effective ways to prompt LLMs exploiting explicit and shared knowledge captured in manually curated taxonomies to provide context for the task at hand. We experiment with different prompting templates, well-recognized taxonomies (EuroVoc, STW, UNESCO), and popular language models (Claude, Claude3, Llama2).

Our results suggest feasibility of solving of the proposed task with the modern LLMs and human oversight. Moreover, we observe certain patterns and trends in the performance of the models, noting that it was not possible to identify a single best configuration that would fit all models.

 

Details

Date:
September 18
Time:
1:00 pm - 1:30 pm
Website:
https://2024-eu.semantics.cc/

Venue

Semantics 2024
Meer en Vaart 300
Amsterdam, 1068 LE Netherlands