Community Review Process

This page provides information regarding Community Reviewer process and information on how to find allocations in the Community Review module

New Community Reviewers (LV0)

• Community reviewers must register, complete a required identity verification process and carry out reviews using the Community Review module.

• Community reviewers must read through the guidance documentation provided.

• Community Reviewers will log into the Community Review module and carry out their reviews, providing scores and reasons for giving those scores using the scoring rubric supplied.

• LV0 and LV1 Reviewers can review proposals from any Fund categories; however, Catalyst suggests that opinions are most valuable when reviewing proposals from areas and subject matter that the Community Reviewer is familiar with.

• LV0 and LV1 Reviewers will be provided an allocation of proposals to review which will be visible in the tab “Allocated proposals”. Reviewers can choose to review outside of the allocation (by reviewing proposals in the “Proposals” tab), however, to minimize risks of gaming, non-allocated proposal reviews will have a lower weighted score compared to allocated reviews. (More details in the Score Weight section).

• Once a review is submitted, it will pass through Catalyst scripts which analyze the review for: ‘length,’ ‘similarity,’ ‘profanity,’ and ‘use of AI’ (details can be found in the Catalyst flags section).

• All flagged reviews will be randomly allocated to at least 2 LV2 Community Moderators for analysis. Community Moderators will determine whether a flagged review will be published or discarded.

• Once voting has concluded, the reward calculations for all reviewers (LV0-LV2) are prepared.

• Community Reviewer rewards will be distributed as soon as possible.

Experienced Community Reviewers (LV1)

Experienced Community Reviewers must follow the same guidance and steps as LV0 Community Reviewers, noting that after Step 3 above, LV1 community reviewers will have the following additional steps.

• Catalyst will generate a random allocation of proposals to be reviewed for eligible LV1 and LV0 reviewers in the Community Review module visible in the “Allocated proposals” tab.. Reviews of allocated proposals will be rewarded at a fixed rate per review for LV1 and at a variable rate per review for LV0, determined by the number of reviewers participating and the total reviews published.

• LV1 Community reviewer allocations are based on the category preferences selected during registration. While LV1s can review any proposal, the higher rewards will be paid for reviewing proposals identified in the allocation.

• When an LV1 reviewer chooses to review proposals outside of the prescribed allocation (visible in “Allocated proposals” tab), the review will still be counted (subject to passing the flagging and LV2 stage), and rewards for these additional reviewers will be counted as part of the LV0 pot of rewards.

An LV1 reviewer may perform more than the allocation of 60 reviews. To do so, you may review proposals visible in the “Proposals” tab. The rewards for each review above and beyond the allocation will be paid as part of the LV0 pool of reviews. Those excess reviews will also carry a lower weight in the score as outlined in the score weight formula section.

Where can I find my allocations?

Once proposals review will be open, LV0 and LV1 will see the “Allocated proposals” tab with allocated proposals in the Community Review module.