Tell me the truth. Validating the semantic alignment between the annotation user interface and the knowledge base

The study drafts a methodology to assess user interface (UI’s) semantic transparency in annotation applications. When proposing new semantic relationships through an interface, users expect that the annotation will extend the knowledge bases (KB) as well as that the annotation semantics will comply with the conceptual model of the KB. The verbalization of the semantics of the resulting graph aims to foster user awareness of the output of their interaction, filling the gap between formalized knowledge and corresponding natural language assertions. Leveraging two use cases from archival and textual scholarship and a test case from performing arts documentation, we outline a methodology for assessing the semantic neutrality of UIs in annotation applications.