LV2 Moderation

Once the Moderation stage opens, all submitted reviews become public.

Catalyst flags

The Catalyst Team runs scripts to flag submitted reviews that are copy (or very similar) of other reviews, contain abusive language and are written using AI.

Flagged reviews will be highlighted by having the checkbox Flagged? ticked

Flag types:

  • Similarity - review identical or almost identical to previously submitted review. Once the review is flagged as similar to another one, then the similar proposal will appear. Moderators may choose to Expand and compare reviews that seem very similar and then decide whether to accept the review or not

  • Profanity - review that contain profanity or abusive content or language

  • Use of AI - review that does not reflect the Community Reviewer opinion, is provided by others and/or an AI agent acting on their behalf (written by AI)

Reviews without flag

LV2 Community Review will have assigned a small percentage of not-flagged reviews. It is a spot check where the Moderator decides whether or not the review should be included

LV2 Moderation

  1. As an LV2 Reviewer (Moderator), you will see the “Allocated reviews” tab, which contains a list of reviews assigned to you for moderation with a checkbox below containing information if a certain review was already moderated.

  2. Once opened, there will be a visible proposal title, link to the proposal page, Reviewer anonymized ID, and a score for each criteria - impact, feasibility, and value for money. If a review is flagged by the scripts, the flag will be visible in the upper right corner along with the type. The LV2 Reviewer has to answer whether the flagged review should be included or not

Depends on the decision, Moderators will have to choose the rationale out of the following options:

  • Yes

  1. There is no evident issue with the review

  2. Person’s own opinion

  3. There isn't any profanity

  4. It’s unique and not too similar to another review

  5. It's similar to another review for a valid reason

  6. Other - further written explanation needed

  • No

  1. I believe this is not person’s own opinion

  2. There is profanity

  3. There is too much similarity with another review

  4. Rationale doesn't correspond with the score given

  5. Rationale contains a false statement

  6. Other - further written explanation needed

Once the decision is made and rationale is chosen, the Moderator can submit own work by clicking the “Submit” button. If work was submitted by mistake, it can be removed by clicking the “Delete” button and resubmitting

  1. In the “Moderated Reviews” tab, LV2 Reviewer will see a list of its own moderated review

Last updated