AKBC 2027 Shared Task

AKBC 2027 will include a shared task on using large language models (LLMs) for knowledge base (KB) construction. Further task details, rules, and participation instructions will be announced soon.

Different from previous years, the task will not be about slot filling, but about open-ended elicitation, based on the BeQu benchmark introduced in “Beyond Questions: Evaluating the Stated Knowledge of LLMs” (Arxiv 2026) by Giordano and Razniewski.

Tentative Timeline

The following dates are tentative and may be adjusted as ACL 2027 workshop logistics are finalized.

ActivityTentative date
Dataset (train and development) releaseMonday, February 8, 2027
Dataset (test) releaseMonday, May 31, 2027
Submission of test output, code, and system papersWednesday, June 2, 2027
Acceptance and winner announcementFriday, June 18, 2027
Camera-ready system papersFriday, July 2, 2027
Shared-task presentations at AKBC / ACL 2027August 18 or 19, 2027

AKBC is co-located with ACL 2027 in Kyoto, Japan. The exact workshop day is still to be confirmed.