Active Manifold Learning with Twitter Big Data

Silva, Catarina; Antunes, Mário; Costa, Joana; Ribeiro, Bernardete

http://hdl.handle.net/10400.8/15105

Use this identifier to reference this record.

Name:	Description:	Size:	Format:
Active Manifold Learning with Twitter Big Data.pdf	Part of special issue INNS Conference on Big Data 2015 Program San Francisco, CA, USA 8-10 August 2015	297.65 KB	Adobe PDF	Download

Send Feedback

Authors

Abstract(s)

The data produced by Internet applications have increased substantially. Big data is a flaring field that deals with this deluge of data by using storage techniques, dedicated infrastructures and development frameworks for the parallelization of defined tasks and its consequent reduction. These solutions however fall short in online and highly data demanding scenarios, since users expect swift feedback. Reduction techniques are efficiently used in big data online applications to improve classification problems. Reduction in big data usually falls in one of two main methods: (i) reduce the dimensionality by pruning or reformulating the feature set; (ii) reduce the sample size by choosing the most relevant examples. Both approaches have benefits, not only of time consumed to build a model, but eventually also performance-wise, usually by reducing overfitting and improving generalization capabilities. In this paper we investigate reduction techniques that tackle both dimensionality and size of big data. We propose a framework that combines a manifold learning approach to reduce dimensionality and an active learning SVM-based strategy to reduce the size of labeled sample. Results on Twitter data show the potential of the proposed active manifold learning approach.

Description

Conference name INNS Conference on Big Data 2015, San Francisco
Conference date 8 August 2015 - 10 August 2015

Keywords

Big data Support Vector Machine Manifold Twitter

URI

http://hdl.handle.net/10400.8/15105

Citation

Silva, Catarina & Antunes, Mario & Costa, Joana & Ribeiro, Bernardete. (2015). Active Manifold Learning with Twitter Big Data. Procedia Computer Science. 53. 208-215. 10.1016/j.procs.2015.07.296.