Publication
On using crowdsourcing and active learning to improve classification performance
| dc.contributor.author | Costa, Joana | |
| dc.contributor.author | Silva, Catarina | |
| dc.contributor.author | Antunes, Mário | |
| dc.contributor.author | Ribeiro, Bernardete | |
| dc.date.accessioned | 2025-11-04T12:43:54Z | |
| dc.date.available | 2025-11-04T12:43:54Z | |
| dc.date.issued | 2011-11 | |
| dc.description.abstract | Crowdsourcing is an emergent trend for general-purpose classification problem solving. Over the past decade, this notion has been embodied by enlisting a crowd of humans to help solve problems. There are a growing number of real-world problems that take advantage of this technique, such as Wikipedia, Linux or Amazon Mechanical Turk. In this paper, we evaluate its suitability for classification, namely if it can outperform state-of-the-art models by combining it with active learning techniques. We propose two approaches based on crowdsourcing and active learning and empirically evaluate the performance of a baseline Support Vector Machine when active learning examples are chosen and made available for classification to a crowd in a web-based scenario. The proposed crowdsourcing active learning approach was tested with Jester data set, a text humour classification benchmark, resulting in promising improvements over baseline results. | eng |
| dc.identifier.citation | J. Costa, C. Silva, M. Antunes and B. Ribeiro, "On using crowdsourcing and active learning to improve classification performance," 2011 11th International Conference on Intelligent Systems Design and Applications, Cordoba, Spain, 2011, pp. 469-474, doi: 10.1109/ISDA.2011.6121700. | |
| dc.identifier.doi | 10.1109/isda.2011.6121700 | |
| dc.identifier.isbn | 978-1-4577-1676-8 | |
| dc.identifier.issn | 2164-7143 | |
| dc.identifier.uri | http://hdl.handle.net/10400.8/14488 | |
| dc.language.iso | eng | |
| dc.peerreviewed | yes | |
| dc.publisher | IEEE | |
| dc.relation.hasversion | https://ieeexplore.ieee.org/document/6121700/ | |
| dc.relation.ispartof | 2011 11th International Conference on Intelligent Systems Design and Applications | |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | |
| dc.subject | Crowdsourcing | |
| dc.subject | Active Learning | |
| dc.subject | Support Vector Machines | |
| dc.subject | Text Classification | |
| dc.title | On using crowdsourcing and active learning to improve classification performance | eng |
| dc.type | conference paper | |
| dspace.entity.type | Publication | |
| oaire.citation.conferenceDate | 2011 | |
| oaire.citation.conferencePlace | Cordoba, Spain | |
| oaire.citation.endPage | 474 | |
| oaire.citation.startPage | 469 | |
| oaire.citation.title | 2011 11th International Conference on Intelligent Systems Design and Applications | |
| oaire.version | http://purl.org/coar/version/c_970fb48d4fbd8a85 | |
| person.familyName | Costa | |
| person.familyName | Silva | |
| person.familyName | Antunes | |
| person.givenName | Joana | |
| person.givenName | Catarina | |
| person.givenName | Mário | |
| person.identifier | R-000-NX4 | |
| person.identifier.ciencia-id | 1B19-3DDC-BE75 | |
| person.identifier.ciencia-id | AF10-7EDD-5153 | |
| person.identifier.orcid | 0000-0002-4053-5718 | |
| person.identifier.orcid | 0000-0002-5656-0061 | |
| person.identifier.orcid | 0000-0003-3448-6726 | |
| person.identifier.scopus-author-id | 25930820200 | |
| relation.isAuthorOfPublication | 23d200dc-1a81-4bd9-9a4a-0efc28af6ce4 | |
| relation.isAuthorOfPublication | ee28e079-5ca7-4842-9094-372c40f75c38 | |
| relation.isAuthorOfPublication | e3e87fb0-d1d6-44c3-985d-920a5560f8c1 | |
| relation.isAuthorOfPublication.latestForDiscovery | e3e87fb0-d1d6-44c3-985d-920a5560f8c1 |