资 源 简 介
Publications
Quoc Viet Hung Nguyen, Thanh Tam Nguyen, Ngoc Tran Lam and Karl Aberer. An Evaluation of Aggregation Techniques in Crowdsourcing. In: WISE. 2013.
Quoc Viet Hung Nguyen, Thanh Tam Nguyen, Ngoc Tran Lam, and Karl Aberer. BATC: a benchmark for aggregation techniques in crowdsourcing. In: SIGIR. 2013, pp. 1079-1080.
Description
As the volumes of AI problems involving human knowledge are likely to soar, crowdsourcing has become essential in a wide range of world-wide-web applications. One of the biggest challenges of crowdsourcing is aggregating the answers collected from crowd workers; and thus, many aggregate techniques have been proposed. However, for a particular application, it is difficult for users to choose the best-suited technique as well as appropriate values of parameter configuration since each of these techniques has distinct performance characteristics depending on various factors (e.g. work