Following a period of consultation and internal review, the Community Team has undertaken a comprehensive rewrite of the FAQ document for new evaluators. This foundational resource, which serves as the primary onboarding guide for all members participating in our review queues, had become fragmented and incrementally updated over several platform iterations, leading to some inconsistencies and gaps in guidance.
The new version has been restructured from the ground up with clarity and logical flow as its primary objectives. We have eliminated redundant sections, consolidated related topics, and ensured the language is precise and unambiguous. Key areas of focus in the rewrite include a more detailed explanation of the "Skip" function and its appropriate use cases, a clarified hierarchy of our core evaluation principles, and expanded examples to illustrate common points of confusion, particularly around the boundaries of acceptable and unacceptable feedback.
This revision is not merely cosmetic; it represents a codification of the community standards we have collectively developed through discussion and precedent. We encourage all evaluators, both new and experienced, to set aside some time to review the updated FAQ. Familiarity with this document is crucial for maintaining consistency and fairness in our collective review work. As always, we welcome constructive feedback on the revised FAQ in this thread, with the understanding that its core tenets are now firmly established.
— EthanP
Let's keep it constructive