LogoLogo
projectcatalyst.io
  • 🚀WELCOME TO PROJECT CATALYST
    • What is Project Catalyst
    • Getting started
    • Catalyst Team Deliverables
      • Show & Tell Demos
  • 📖CURRENT FUND
    • Fund basics
      • Fund timeline
      • Fund parameters
      • Fund Rules
      • Project Catalyst Terms and Conditions
        • Legal & Treasury Details
        • Catalyst FC Privacy Policy
        • Catalyst FC Personal Data Consent
        • DMCA FAQ Catalyst
    • Proposal submission
      • Scoring guidance for the Proposer
      • Proposal submission Guide
      • Additional Guidance
      • Cardano Partners
        • Cardano Partners shortlist
    • Community Review
      • How to become a Community Reviewer?
      • Community Reviewer Levels
      • Community Review - Submission process (LV0 and LV1)
      • Community Review Process
      • Scoring rubric and guiding questions
      • Community Moderation Process
      • Conflict of Interest
      • Reviewer Rewards
      • Score Weight
      • FAQ
    • Voter registration
      • Supported wallets
      • Registration Guide - In your wallet
    • Voting
      • Wallet Connection - In the Catalyst Voting App
      • How to vote?
      • How to audit the vote?
        • Audit the Snapshot
          • Required Tools
          • Reproducing the Snapshot
        • Voting Ledger Snapshots
        • Audit The Tally
      • Voting FAQ
    • Project onboarding
      • Glossary of Terms
      • Milestone-based proposals
      • Funded Proposers guides
        • Key dates
        • Onboarding Sessions - Presentation & Recordings
          • Onboarding session A
          • Onboarding session B
        • What do you need to do next?
        • How to create a Statement of Milestones - guide for Funded Proposers
        • Statement of Milestones submission
        • How Milestone payments work
        • Creating your milestones - need to know
        • How to use the Milestone module as a Funded Proposer?
        • Formal Due Diligence Process
        • Test Transaction (Tx)
        • What else further down the line?
        • Funded Project Checklist
        • Requesting a change to funded project
      • Milestone Reviewers guides
        • Milestone Reviewer - Terms & Conditions
        • Milestone Reviewer Process Examples
          • Milestone Reviewer - Interview 1
          • Milestone Reviewer - Interview 2
          • Milestone Reviewer - Interview 3
          • Milestone Reviewer - Interview 4
          • Milestone Reviewer - Interview 5
        • Key dates
        • Milestone Reviewers onboarding meetings
          • Onboarding session A
          • Onboarding session B
        • A Milestone Reviewer’s role
        • What is the Statement of Milestones (SoM)?
        • How to use the Milestone module as a Milestone Reviewer?
        • How to review SoM as a Milestone Reviewer?
        • What is Proof of Achievement (PoA)
        • What is good evidence?
        • What is not good evidence?
        • Milestone Reviewer rewards
        • FAQ
    • General information
      • Catalyst Network
      • How to create a Statement of Milestones - guide for Funded Proposers
      • Project Close-out Report and Project Close-out Video (PCR and PCV)
      • Requesting a change to funded project on Milestone Module
      • Policy on Suspension and Termination of Catalyst Grants
        • Suspension and Termination policy memo
        • Suspension or termination at the request of a Grantee
        • Suspension by the Fund Operator
        • Termination by the Fund Operator
      • Catalyst Ecosystem Rewards
    • External documentation
  • ⚙️CATALYST TOOLS
    • Moderation Module
      • How to set up an account
      • Moderation module sections
      • How to moderate the review
      • Catalyst flags
      • Reviews without flag
    • Milestone Module
      • Latest changes in the Milestone Module
      • How to use the Milestone module - recording
      • Glossary of terms
      • Statement of Milestones (SoM)
      • Proof of Achievement (PoA)
      • What is the Milestone Module for?
      • Setting up a Project Catalyst Milestone account
      • Dashboard, Project Dashboard, and Notification sections
      • Milestone Module chat
      • Milestone Module - roles and responsibilities
        • Funded Proposer using the Milestone module
        • Milestone Reviewer using the Milestone module
        • Catalyst Team Reviewer using the Milestone module
        • Catalyst Team sign-off user using the Milestone module
      • Milestone Module - FAQ
    • Voting App
      • F13 Voting App changes
      • F12 Voting App changes
      • Dry run
      • Known Issues
      • Privacy Policy
    • Catalyst App
      • App Timeline
      • Getting Started
      • Restore Keychain
      • My Account
      • Catalyst Spaces
      • Browse Proposals in Discovery Space
      • Create & Submit Proposals in Workspace
        • Using images
      • Stay Involved
      • Mobile Experience
      • FAQ
  • 📂PREVIOUS FUNDS
    • Fund13 Docs
      • Fund timeline
      • Fund parameters
      • Fund Rules
      • Project Catalyst Terms and Conditions
        • Catalyst FC Privacy Policy
        • Catalyst FC Personal Data Consent
        • DMCA FAQ Catalyst
      • Proposal submission
        • Scoring guidance for the Proposer
        • Proposal submission Guide
        • Additional Guidance
        • Cardano Partners
          • Cardano Partners short list
      • Community Review
        • How to become a Community Reviewer?
        • Community Reviewer Levels
        • Community Review - Submission process (LV0 and LV1)
        • Community Review Process
        • Scoring rubric and guiding questions
        • Community Moderation Process
        • Conflict of Interest
        • Reviewer Rewards
        • Score Weight
        • FAQ
      • Voter registration
        • Supported wallets
        • Registration Guide - In your wallet
      • Voting
        • Wallet Connection - In the Catalyst Voting App
        • How to vote?
        • How to audit the vote?
          • Audit the Snapshot
            • Required Tools
            • Reproducing the Snapshot
          • Voting Ledger Snapshots
          • Audit The Tally
        • Voting FAQ
      • Project onboarding
        • Glossary of Terms
        • Milestone-based proposals
        • Funded Proposers guides
          • Key dates
          • Onboarding Sessions - Presentation & Recordings
            • Onboarding session A
            • Onboarding session B
          • What do you need to do next?
          • How to create a Statement of Milestones - guide for Funded Proposers
          • Statement of Milestones submission
          • How Milestone payments work
          • Creating your milestones - need to know
          • How to use the Milestone module as a Funded Proposer?
          • Formal Due Diligence Process
          • Test Transaction (Tx)
          • What else further down the line?
          • Funded Project Checklist
          • Requesting a change to funded project
        • Milestone Reviewers guides
          • Milestone Reviewer - Terms & Conditions
          • Milestone Reviewer Process Examples
            • Milestone Reviewer - Interview 1
            • Milestone Reviewer - Interview 2
            • Milestone Reviewer - Interview 3
            • Milestone Reviewer - Interview 4
            • Milestone Reviewer - Interview 5
          • Key dates
          • Milestone Reviewers onboarding meetings
            • Onboarding session A
            • Onboarding session B
          • A Milestone Reviewer’s role
          • What is the Statement of Milestones (SoM)?
          • How to use the Milestone module as a Milestone Reviewer?
          • How to review SoM as a Milestone Reviewer?
          • What is Proof of Achievement (PoA)
          • What is good evidence?
          • What is not good evidence?
          • Milestone Reviewer rewards
          • FAQ
      • General information
        • Catalyst Network
        • How to create a Statement of Milestones - guide for Funded Proposers
        • Project Close-out Report and Project Close-out Video (PCR and PCV)
        • Requesting a change to funded project on Milestone Module
        • Policy on Suspension and Termination of Catalyst Grants
          • Suspension and Termination policy memo
          • Suspension or termination at the request of a Grantee
          • Suspension by the Fund Operator
          • Termination by the Fund Operator
        • Catalyst Ecosystem Rewards
      • External documentation
    • Fund12 Docs
      • Fund timeline
      • Fund parameters
      • Fund Rules
      • Proposal submission
        • Scoring guidance for the Proposer
        • Proposal submission Guide
        • Additional Guidance
        • Cardano Partners and Real World Integrations category
          • Cardano Partners short list
      • Community Review
        • How to become a Community Reviewer?
        • Community Reviewer Levels
        • Community Review - Submission process (LV0 and LV1)
        • Community Review Process
        • Scoring rubric and guiding questions
        • Community Moderation Process
        • Conflict of Interest
        • Reviewer Rewards
        • Score Weight
        • FAQ
      • Voter registration
        • Supported wallets
        • Registration Guide - In your wallet
      • Voting
        • Wallet Connection - In the Catalyst Voting App
        • How to vote?
        • How to audit the vote?
          • Audit the Snapshot
            • Required Tools
            • Reproducing the Snapshot
          • Voting Ledger Snapshots
          • Audit The Tally
        • Voting FAQ
      • Project onboarding
        • Glossary of Terms
        • Milestone-based proposals
        • Funded Proposers guides
          • Key dates
          • Onboarding Sessions - Presentation & Recordings
            • Onboarding session A
            • Onboarding session B
          • What do you need to do next?
          • How to create a Statement of Milestones - guide for Funded Proposers
          • Statement of Milestones submission
          • How Milestone payments work
          • Creating your milestones - need to know
          • How to use the Milestone module as a Funded Proposer?
          • Formal Due Diligence Process
          • Test Transaction (Tx)
          • What else further down the line?
          • Funded Project Checklist
          • Requesting a change to funded project
        • Milestone Reviewers guides
          • Milestone Reviewer - Terms & Conditions
          • Milestone Reviewer Process Examples
            • Milestone Reviewer - Interview 1
            • Milestone Reviewer - Interview 2
            • Milestone Reviewer - Interview 3
            • Milestone Reviewer - Interview 4
            • Milestone Reviewer - Interview 5
          • Key dates
          • Milestone Reviewers onboarding meetings
            • Onboarding session A
            • Onboarding session B
          • A Milestone Reviewer’s role
          • What is the Statement of Milestones (SoM)?
          • How to use the Milestone module as a Milestone Reviewer?
          • How to review SoM as a Milestone Reviewer?
          • What is Proof of Achievement (PoA)
          • What is good evidence?
          • What is not good evidence?
      • General information
        • Catalyst Network
        • How to create a Statement of Milestones - guide for Funded Proposers
        • Project Close-out Report and Project Close-out Video (PCR and PCV)
        • Requesting a change to funded project from F10 onwards
        • Suspension and Termination of Catalyst Grants
          • Suspension and Termination policy memo
          • Suspension or termination at the request of a Grantee
          • Suspension by the Fund Operator
          • Termination by the Fund Operator
        • Catalyst Ecosystem Rewards
      • External documentation
    • Fund11 Docs
      • Fund11 timeline
      • Fund11 parameters
      • Fund Rules
      • How to submit a proposal?
        • Scoring guidance for the Proposer
        • Proposal submission Guide
        • Additional Guidance
          • Open Source Guidance
          • Submitting Milestones for your F11 proposal
      • Community Review Guidelines Fund 11
        • Community Reviewer Levels
        • Community Review - Submission process (LV0 and LV1)
        • Community Review Process
          • How to find allocations in the Ideascale?
        • Scoring rubric and guiding questions
        • Community Moderation Process
        • Rules to be followed by Community Moderators (LV2)
        • Conflict of Interest
        • How do I progress through the Community Reviewer levels?
        • Reviewer Rewards
        • Score Weight
      • Moderation Module Guide
        • How to set up an account
        • Moderation module sections
          • Home
          • Proposals
          • Community Reviews section
          • Allocated Reviews section
          • Moderated Reviews
        • How to moderate the review
        • Catalyst flags
        • Reviews without flag
      • How to register as a voter?
        • Voting registration minimal requirements
        • Wallet Registration Guide
          • Supported wallets
          • Registration Guide - In your wallet
          • Wallet Connection - In the Catalyst Voting App
      • Voting
        • How to vote?
        • How to audit the vote?
          • Audit the Snapshot
            • Required Tools
            • Reproducing the Snapshot
          • Voting Ledger Snapshots
          • Audit The Tally
        • Voting FAQ
        • Voting App
          • Known Issues
      • Catalyst Network
      • Project Onboarding
        • Funding Glossary of Terms
        • How to submit Project milestones
          • What should be included in the Statement of Milestones?
          • Approval of the Statement of Milestones
          • Approval and payment of Milestones
        • Funded Proposers (FP)
          • Key dates
          • F11 Onboarding Sessions - Presentation & Recordings
            • F11 Onboarding Session A
            • F11 Onboarding Session B
          • What do you need to do next?
          • Statement of Milestones
            • Submitting your Statement of Milestones
            • How Milestone payments work
            • Creating your milestones - need to know
          • How Proof of Life is confirmed
          • Test Transaction (Tx)
          • What else further down the line?
          • Funded Project Checklist
          • Requesting a change to funded project
        • F11 Milestone Reviewers Guide
          • Milestone Reviewer Process Examples
            • Milestone Reviewer - Interview 1
            • Milestone Reviewer - Interview 2
            • Milestone Reviewer - Interview 3
            • Milestone Reviewer - Interview 4
            • Milestone Reviewer - Interview 5
          • Key dates during the onboarding stage
          • Milestone Reviewers onboarding meetings
          • A Milestone Reviewer’s role
            • Milestone Reviewer expectations
          • What is the Statement of Milestones (SoM)?
          • How to use the Milestone module as a Milestone Reviewer?
          • How to review SoM as a Milestone Reviewer?
          • A good example of SoM formulation from F9 pilot project
          • What is Proof of Achievement (PoA)
          • Good example of PoA completion from F9 pilot project
          • What is good evidence?
          • What is not good evidence?
          • Rewards for SoM and PoA review
        • Proof of Life (PoL) Verifiers
          • Key Dates
          • What do you need to do?
          • Confirming Proof of Life
          • PoL Verifiers Checklist
        • Community roles rewards
      • Suspension and Termination of Catalyst Grants
        • Suspension and Termination policy memo
        • Suspension or termination at the request of a Grantee
        • Suspension by the Fund Operator
        • Termination by the Fund Operator
    • Fund10 Docs
      • Fund10 timeline
      • Fund10 parameters
      • How to submit a proposal?
        • Scoring guidance for the Proposer
        • Proposal submission Guide
      • How to participate in community reviews?
        • How to become a Community Reviewer?
          • Community Reviewers Levels
            • How do I progress through the Community Reviewer levels?
        • Community Review - Submission process (LV0 and LV1)
          • Community Review - Scoring Rubric and Guiding Questions
        • Community Review - Moderation Process (LV2)
          • Rules for Community Moderators (LV2)
          • Moderation module guide
            • How to set up an account
            • Moderation module sections
            • How to moderate the review
              • Catalyst flags
              • Reviews without flag
        • Conflict of Interest in Community Review
        • Community Review Rewards
        • Community Review - Score weight
      • Voting
        • How to vote?
        • How to audit the vote?
          • Audit the Snapshot
            • Required Tools
            • Reproducing the Snapshot
          • Voting Ledger Snapshots
          • Audit The Tally
        • Voting FAQ
        • Voting App
          • Known Issues
          • Privacy Policy
        • How to register as a voter?
          • Voting registration minimal requirements
          • Wallet Registration Guide
            • Supported wallets
            • Registration Guide - In your wallet
            • Wallet Connection - In the Catalyst Voting App
            • Check Voting Power & Rewards Eligibility
      • Project Onboarding
        • Challenge Teams (CT)
          • Key Dates
          • What do you need to do?
          • Confirming Proof of Life
          • CT Checklist
        • Funded Proposers (FP)
          • Key dates
          • F10 Onboarding Sessions - Presentation & Recordings
            • F10 Onboarding Session A
            • F10 Onboarding Session B
          • What do you need to do next?
          • Statement of Milestones
            • Submitting your Statement of Milestones
            • How Milestone payments work
            • Creating your milestones - need to know
            • How to use the Milestone module in F10
              • Glossary of terms
              • What is the Statement of Milestones?
              • When to submit a Statement of Milestones
              • Approval of milestones in the Statement of Milestones
                • Process of checking milestones
              • Amendments to the milestones
              • Funding Rules
              • What is Proof of Achievement (PoA)?
              • Why Statements of Milestones and Proof of Achievement?
              • How to submit PoA
              • Where to find each project’s SoMs and PoAs
              • Approval of the Proof of Achievement
                • Process of checking PoA
                • Using the Milestone Module
                  • What is the Milestone Module for?
                  • Setting up a Project Catalyst Milestone account
                  • Dashboard, Project Dashboard, and Notification sections
                  • Roles and responsibilities
                    • Funded Project (FP) using the Milestone module
                      • Actions that FP can carry out in the Milestone module
                        • Submit new milestone
                        • Review Milestone Reviewers feedback
                        • Resubmit milestones
                        • Submit Proof of Achievement
                        • Resubmit PoA to supersede existing PoA
                    • Milestone Reviewer using the Milestone module
                      • SoM process
                      • PoA process
                      • Actions that Milestone Reviewers can carry out in the module
                        • Milestone Reviewer can review milestones
                        • Milestone Reviewer can review a PoA
                        • Milestone Reviewer can resubmit review for milestones
                        • Milestone Reviewer can resubmit review for PoA
                    • Catalyst Team Reviewer
                      • Actions that a Catalyst Team Reviewer can carry out in the module
                        • Catalyst Team Reviewer can assign reviewer
                        • Catalyst Team Reviewer can review milestones and PoA
                    • Catalyst Team sign-off user
              • Appendix
          • How Proof of Life is confirmed
          • Test Transaction (Tx)
          • What else further down the line?
          • Funded Project Checklist
        • F10 Milestone Reviewers Guide
          • Milestone Reviewer Process Examples
            • Milestone Reviewer - Interview 1
            • Milestone Reviewer - Interview 2
            • Milestone Reviewer - Interview 3
            • Milestone Reviewer - Interview 4
            • Milestone Reviewer - Interview 5
          • Key dates during the onboarding stage
          • A Milestone Reviewer’s role
          • What is the Statement of Milestones (SoM)?
          • How to use the Milestone module as a Milestone Reviewer?
          • How to review SoM as a Milestone Reviewer?
          • A good example of SoM formulation from F9 pilot project
          • What is Proof of Achievement (PoA)
          • Good example of PoA completion from F9 pilot project
          • What is good evidence?
          • What is not good evidence?
          • Rewards for SoM and PoA review
        • Community roles rewards
      • Catalyst Network
      • How to submit Project milestones
        • What Milestones should be included in the Statement of Milestones?
        • Approval of the Statement of Milestones
        • Approval and payment of Milestones
      • Funded Project Reporting Guideline
        • Submitting Monthly Reports
        • Monthly Reporting status changes
        • Catalyst Team Monthly Reports approval process
        • What is good evidence?
        • What is not good evidence?
        • Requesting a change to funded project from F10 onwards
        • Project Closeout Report and Project Closeout Video (PCR and PCV)
          • Catalyst - Project Closeout Process for projects up to Fund9
        • Funded Projects accountability overview
      • Funding Glossary of Terms
    • Fund9 Docs
      • The Statement of Milestones Module - (Fund9 Only)
        • Glossary of terms
        • Statement of Milestone Process
          • Basic Funding Rules
        • Submitting Proof of Achievement (PoA)
          • Process of checking PoA
        • What is Good Evidence
        • What is not good evidence?
        • Using the Milestone Module
          • What is the Milestone Module for?
          • Setting up an Project Catalyst Milestone account
          • Dashboard, Project Dashboard, and Notification sections
          • Roles and Responsibilities
            • Funded Project (FP) using the Milestone module
              • Actions that FP can carry out in the Milestone module
                • Submit a new SoM
                • Review Catalyst Team Reviewer/Milestone Reviewers feedback
                • Resubmit milestones
                • Submit Proof of Achievement
                • Resubmit PoA to supersede existing PoA
            • Milestone Reviewers using the Milestone module
              • SoM process
              • PoA process
            • Actions that a Milestone Reviewers can carry out in the module
              • Milestone Reviewers can review SoM
              • Milestone Reviewers can review a PoA
              • Milestone Reviewers can resubmit review for SoM
              • Milestone Reviewers can resubmit review for PoA
            • Catalyst Team Reviewer
              • Actions that a Catalyst Team Reviewer can carry out in the module
                • Catalyst Team Reviewer can assign reviewer
                • Catalyst Team Reviewer can review SoM/PoA
            • Catalyst Team sign off user
            • Catalyst Team system admin
        • Appendix
        • Note on Confidentiality
Powered by GitBook
On this page
  • Community Moderation Process
  • Rules to be followed by Community Moderators (LV2)
Export as PDF
  1. PREVIOUS FUNDS
  2. Fund12 Docs
  3. Community Review

Community Moderation Process

Community Moderation Process

All reviews the Community Reviewers provide will be subject to an automated review process using Catalyst Flags. Catalyst Flags* are pieces of code known as scripts that are run to analyze all reviews by the Community Reviewers. Catalyst scripts will raise flags in case of;

  • Similarity ~ reviews which are identical or almost identical to a previously submitted review

  • Profanity ~ reviews that contain profanities or abusive content or language

  • Use of AI ~ reviews that do not reflect the opinion of the Community Reviewer or which are provided by others or an AI-agent acting on their behalf.

* Length requirements have already been applied for automatically (reviews containing less than 150 characters in impact, feasibility, and value for money criteria)

All reviews that have been flagged will go through a moderation process involving Community Moderators (LV2).

  • Community Moderators will be randomly allocated flagged reviews for further assessment. In addition, between 1-5% percent of reviews not flagged by scripts will be allocated to LV2 Community Reviewers for a spot check (depending on the total reviews received).

  • Community Moderators will be provided a secure login for their moderation function in the Moderation Module.

  • Community Moderators can see which flags have been raised by the scripts about the review/reviewer.

  • After reading the review and flags, Community Moderators will submit their moderations, marking reviews they believe were legitimately flagged and providing a reason for removing the review. Eg. Where the flag is raised because of potential ChatGPT AI involvement or plagiarism, the Moderator must judge whether they believe the review is not a reviewer's opinion. If the Moderator agrees with the flag, they mark it as REMOVE and give a rationale.

  • The rationale should be a short written statement; a selection must be made from a menu of reasons. For example, the moderator would select from options such as:

    1. There is no evident issue with review

    2. I believe this is not the person’s own opinion

    3. There is profanity

    4. There is too much similarity with another review

    5. Rationale doesn’t correspond with the score given

    6. Rationale contains a false statement

  • If Moderators disagree with the flag and believe the review should be included for voters to consider, they mark it as VALID and give a rationale.

  • Moderators should only discard reviews if there is a valid reason why voters shouldn’t see that review. Unless the review has an apparent reason, such as the flags below or another cause (spamming, for instance), the review should be included.

Rules to be followed by Community Moderators (LV2)

  • All reviews should be provided to voters if a Community Moderator has good reason not to include it.

  • Community Moderators are anticipated to approve many flagged reviews and will be retained for voters to consider.

  • Moderators are there to provide a sanity check to verify if the flag(s) have raised a valid concern.

  • Moderators should use their best judgment and give a reason if they agree the flag is valid, meaning the review should not be included.

  • Most reviews will be displayed in the voting application, meaning only those legitimately flagged and tagged by LV2 Moderators will not be included.

  • A simple majority forms a consensus about including the review or not. In a scenario whereby 2 moderators (or an equal number of moderators on each side of the decision) do not form a consensus about including the review, then the benefit of the doubt will be given and the review included.

    • In a scenario where only 1 moderator checks a review, the Catalyst will fulfill the second necessary moderation

    • In a scenario where flagged or spot-checked reviews go without moderation by either LV2 moderators allocated to check, the Catalyst team will fulfill the moderation duty.

PreviousScoring rubric and guiding questionsNextConflict of Interest

Last updated 11 months ago

📂