If I would start out to compare performance of solutions like:

  • Microsoft word
  • LibreOffice
  • Grammarly

Where do I start beyond thinking up own test texts?

To start with, I have found for example this one where authors claim that Microsoft Word hasn't seen any of 19 errors, but the text is really quite small.

Maybe you know about something more elaborated I can't find.

  • Probably linguistics.stackexchange.com is the better palce to ask – Alexey R. Oct 12 '18 at 10:46
  • In general you need to start by defining a clear set of test objectives. The text required for performance testing with be different from that need for stress testing, which would be different from grammar or spell checking. – Martin Spamer Oct 16 '18 at 20:02

You need to find a way to present the same bit of text to each of the engines , trigger the analysis and then extract the result of the analysis.

This is probably just going to be the textual output unless you want to get really involved in scripting to get some stats from the engines themselves.

You could then use this to compare lots of different bits of text that might be known to cause specific issues.

Depending on how many text samples you want to test and how often you want to test it you might want this automated or if this is one off it might not be worth the effort.

A simple workflow could be to use the clipboard , you could probably do more with powershell scripting or the scripting languages built into word and libreoffice.

  • your answer focuses very much on the workflow; thanks, this is useful information! though, I look for: "beyond thinking up own test texts" i.e. is there a standard proofreading test to use as benchmark? – J. Doe Oct 15 '18 at 14:26
  • i'm not aware of one (not my area though) but you would really need to ask a linguist for that as you would be looking for text that is tricky to parse. – Amias Oct 15 '18 at 16:41

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.