Uncertainty in Crowd Data Sourcing under Structural Constraints

Abstract :

Applications extracting data from crowdsourcing platforms must deal with the uncertainty of crowd answers in two different ways: first, by deriving estimates of the correct value from the answers; second, by choosing crowd questions whose answers are expected to minimize this uncertainty relative to the overall data collection goal. Such problems are already challenging when we assume that questions are unrelated and answers are independent, but they are even more complicated when we assume that the unknown values follow hard structural constraints (such as monotonicity).

In this vision paper, we examine how to formally address this issue with an approach inspired by [2]. We describe a generalized setting where we model constraints as linear inequalities, and use them to guide the choice of crowd questions and the processing of answers. We present the main challenges arising in this setting, and propose directions to solve them.

Document type :
Conference papers
Complete list of metadatas

https://hal-imt.archives-ouvertes.fr/hal-01190716
Contributor : Admin Télécom Paristech <>
Submitted on : Tuesday, September 1, 2015 - 2:36:19 PM
Last modification on : Thursday, October 17, 2019 - 12:36:59 PM

Identifiers

  • HAL Id : hal-01190716, version 1

Collections

Citation

Antoine Amarilli, Yael Amsterdamer, Tova Milo. Uncertainty in Crowd Data Sourcing under Structural Constraints. UnCrowd, Apr 2014, Bali, Indonesia. pp.351-359. ⟨hal-01190716⟩

Share

Metrics

Record views

100