Comparative Statistical Analysis of Word Frequencies in Human-Written and AI-Generated Texts Full article
| Journal |
Glottometrics
ISSN: 1617-8351 , E-ISSN: 2625-8226 |
||||||
|---|---|---|---|---|---|---|---|
| Output data | Year: 2025, Volume: 58, Pages: 19-34 Pages count : 16 DOI: 10.53482/2025_58_423 | ||||||
| Tags | Large Language Model, Zipf’s Law, rare words. | ||||||
| Authors |
|
||||||
| Affiliations |
|
Funding (1)
| 1 | Sobolev Institute of Mathematics | FWNF-2022-0010 |
Abstract:
We classify texts using relative word frequencies. The task is to distinguish human-written texts from those generated by a computer using modern algorithms. We study two essay datasets, each containing an equal number of human-written and computer-generated essays. Studying Zipf diagrams shows that the generated texts have a significantly smaller vocabulary compared to human ones. However, the relative frequency of rare words (not included in the 1000 most common) does not allow us to confidently classify the texts. As additional features, we used the relative frequencies of the four most frequent words, as well as the ratio of the number of hapax legomena to the total number of different words. This feature allows to significantly improve the classification. Using these six features allows us to fairly confidently determine whether the text is computer-generated.
Cite:
Kudryavtseva A.
, Kovalevskii A.
Comparative Statistical Analysis of Word Frequencies in Human-Written and AI-Generated Texts
Glottometrics. 2025. V.58. P.19-34. DOI: 10.53482/2025_58_423 OpenAlex
Comparative Statistical Analysis of Word Frequencies in Human-Written and AI-Generated Texts
Glottometrics. 2025. V.58. P.19-34. DOI: 10.53482/2025_58_423 OpenAlex
Dates:
| Published print: | Aug 6, 2025 |
| Published online: | Aug 6, 2025 |
Identifiers:
| OpenAlex: | W4413000682 |
Citing:
Пока нет цитирований