From 3eb5247826a3d1fd395e4c59b1987787b2b0a549 Mon Sep 17 00:00:00 2001 From: Thomas Proisl Date: Fri, 22 Dec 2023 13:03:22 +0100 Subject: [PATCH] Update README to include new option `--character-offsets` --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index d495f15..661496a 100644 --- a/README.md +++ b/README.md @@ -179,6 +179,7 @@ options: SpaceAfter=No if the token was not followed by a space and OriginalSpelling="…" if the token contained whitespace. + --character-offsets Output character offsets in the input for each token. --parallel N Run N worker processes (up to the number of CPUs) to speed up tokenization. -v, --version Output version information and exit.