Skip to content
English
Go to veremark.com
  • There are no suggestions because the search field is empty.

How does Veremark score sentiment on reference checks?

How the automated sentiment scoring on reference checks works, and how to use it.

How does the sentiment scoring on reference checks work?

reference-sentiment-1-how-scoring-works

Referee responses are analysed automatically using AWS natural language processing (NLP). The system looks at the wording and context of each response and classifies the sentiment as positive, neutral, negative, or mixed. The pie charts and scores you see in the report come from that automated analysis.

What do the sentiment categories mean?

reference-sentiment-3-four-categories

Each free-text response is sorted into one of four categories.

  • Positive means the wording is favourable overall.

  • Neutral means it reads as balanced or factual, without a clear lean either way.

  • Negative means the wording is unfavourable overall.

  • Mixed means the response contains both favourable and unfavourable elements.

How are rating questions scored?

reference-sentiment-2-rating-scale

Where a referee gives a numerical rating, the score is grouped on this scale:

  • 8 to 10 — Positive
  • 4 to 7 — Neutral
  • 1 to 3 — Negative

Where do the pie charts and scores in the report come from?

They are generated directly from the automated analysis described above. Nothing in the sentiment section is entered or adjusted manually.

Can you tell me which words triggered a particular sentiment result?

No. The analysis runs through AWS, so we can’t see which exact words or phrases led to a specific classification. If a result looks surprising, read the referee’s full response alongside it. The wording itself is the best guide.

What should I do if a score doesn’t seem to match the response?

Read the referee’s full response and go by your own judgement. The score is a quick guide, and where your reading of the response differs from it, your reading takes precedence.

Should I rely on the sentiment score to make my decision?

No. The reference chart is an added tool to help you review referee responses more easily and speed up your read. The final adjudication and assessment still rests with you.