Are Large Language Models Reliable Argument Quality Annotators?

This repository contains the code for the paper "Are Large Language Models Reliable Argument Quality Annotators?".

The dataset used in the paper is available at Zenodo.

Please use the following citation:

@InProceedings{mirzakhmedova:2024b,
  author =                   {Nailia Mirzakhmedova and Marcel Gohsen and Chia Hao Chang and Benno Stein},
  booktitle =                {1st International Conference on Recent Advances in Robust Argumentation Machines {(RATIO-24)}},
  doi =                      {10.1007/978-3-031-63536-6_8},
  editor =                   {Philipp Cimiano and Anette Frank and Michael Kohlhase and Benno Stein},
  month =                    jun,
  pages =                    {129--146},
  publisher =                {Springer},
  site =                     {Bielefeld, Germany},
  title =                    {{Are Large Language Models Reliable Argument Quality Annotators?}},
  volume =                   14638,
  year =                     2024
}