Publication
Quadcriteria Optimization of Binary Classifiers: Error Rates, Coverage, and Complexity
| dc.contributor.author | Basto-Fernandes, Vitor | |
| dc.contributor.author | Yevseyeva, Iryna | |
| dc.contributor.author | Ruano-Ordás, David | |
| dc.contributor.author | Zhao, Jiaqi | |
| dc.contributor.author | Fdez-Riverola, Florentino | |
| dc.contributor.author | Ramón Méndez, José | |
| dc.contributor.author | Emmerich, Michael T. M. | |
| dc.date.accessioned | 2025-10-22T11:54:58Z | |
| dc.date.available | 2025-10-22T11:54:58Z | |
| dc.date.issued | 2017-11-11 | |
| dc.description.abstract | This paper presents a 4-objective evolutionary multiobjective optimization study for optimizing the error rates (false positives, false negatives), reliability, and complexity of binary classifiers. The example taken is the email anti-spam filtering problem. The two major goals of the optimization is to minimize the error rates that is the false negative rate and the false positive rate. Our approach discusses three-way classification, that is the binary classifier can also not classify an instance in cases where there is not enough evidence to assign the instance to one of the two classes. In this case the instance is marked as suspicious but still presented to the user. The number of unclassified (suspicious) instances should be minimized, as long as this does not lead to errors. This will be termed the coverage objective. The set (ensemble) of rules needed for the anti-spam filter to operate in optimal conditions is addressed as a fourth objective. All objectives stated above are in general conflicting with each other and that is why we address the problem as a 4-objective (quadcriteria) optimization problem. We assess the performance of a set of state-of-the-art evolutionary multiobjective optimization algorithms. These are NSGA-II, SPEA2, and the hypervolume indicator-based SMS-EMOA. Focusing on the anti-spam filter optimization, statistical comparisons on algorithm performance are provided on several benchmarks and a range of performance indicators. Moreover, the resulting 4-D Pareto hyper-surface is discussed in the context of binary classifier optimization. | eng |
| dc.description.sponsorship | This work was partially funded by the [14VI05] Contract Programme from the University of Vigo. Iryna Yevseyeva acknowledges Engineering and Physical Sciences Research Council (EPSRC), UK, and Government Communications Headquarters (GCHQ), UK, for funding Choice Architecture for Information Security (ChAISe) project EP/K006568/1 as a part of Cyber Research Institute. | |
| dc.identifier.citation | Basto-Fernandes, V. et al. (2018). Quadcriteria Optimization of Binary Classifiers: Error Rates, Coverage, and Complexity. In: Tantar, AA., Tantar, E., Emmerich, M., Legrand, P., Alboaie, L., Luchian, H. (eds) EVOLVE - A Bridge between Probability, Set Oriented Numerics, and Evolutionary Computation VI. Advances in Intelligent Systems and Computing, vol 674. Springer, Cham. https://doi.org/10.1007/978-3-319-69710-9_3 | |
| dc.identifier.doi | 10.1007/978-3-319-69710-9_3 | |
| dc.identifier.isbn | 9783319697086 | |
| dc.identifier.isbn | 9783319697109 | |
| dc.identifier.issn | 2194-5357 | |
| dc.identifier.issn | 2194-5365 | |
| dc.identifier.uri | http://hdl.handle.net/10400.8/14354 | |
| dc.language.iso | eng | |
| dc.peerreviewed | yes | |
| dc.publisher | Springer International Publishing | |
| dc.relation.hasversion | https://link.springer.com/chapter/10.1007/978-3-319-69710-9_3 | |
| dc.relation.ispartof | Advances in Intelligent Systems and Computing | |
| dc.relation.ispartof | EVOLVE - A Bridge between Probability, Set Oriented Numerics, and Evolutionary Computation VI | |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | |
| dc.subject | Evo | |
| dc.subject | Parsimony | |
| dc.subject | Three-way classification | |
| dc.subject | Binary classification | |
| dc.subject | Evolutionary multi-objective optimization | |
| dc.subject | Parallel coordinates | |
| dc.title | Quadcriteria Optimization of Binary Classifiers: Error Rates, Coverage, and Complexity | eng |
| dc.type | book part | |
| dspace.entity.type | Publication | |
| oaire.citation.endPage | 49 | |
| oaire.citation.startPage | 37 | |
| oaire.citation.title | EVOLVE - A Bridge between Probability, Set Oriented Numerics, and Evolutionary Computation VI | |
| oaire.version | http://purl.org/coar/version/c_970fb48d4fbd8a85 | |
| person.familyName | Basto-Fernandes | |
| person.givenName | Vitor | |
| person.identifier.ciencia-id | 581C-52BB-AC4E | |
| person.identifier.orcid | 0000-0003-4269-5114 | |
| person.identifier.rid | N-1891-2016 | |
| person.identifier.scopus-author-id | 53363129900 | |
| relation.isAuthorOfPublication | fb2d3703-9d6a-4c22-bbc4-9ff14c162feb | |
| relation.isAuthorOfPublication.latestForDiscovery | fb2d3703-9d6a-4c22-bbc4-9ff14c162feb |