资 源 简 介
The Moderation/Evaluation Engine is a simple web-based tool for facilitating distributed-human-evaluation of mixed media content over the web. The alpha version should provide a testbed for comparing the effectiveness of different rubric criteria, evaluator pools, and decision thresholds. The public beta should implement and host an open source web app and functional API, aimed at providing a generalizable tool appropriate for use in content moderation and evaluation.
What Does the Engine "Do?"
The engine allows users to define groups around a set of qualitative evaluation criteria. Once established, content can be added to each group, and the job of evaluation can be farmed out to a subset of members. In accordance with a predefined quantitative "tipping point," the cumulative evaluation of members works to categorize content (e.g., as appropriate or inappropriate, legal or questionable, spam or not spam, etc.). Additionally, it
