Short Text Classification Using An Enhanced Term Weighting Scheme And Filter-Wrapper Feature Selection

Alsmadi, Issa Mohammad Ibrahim (2018) Short Text Classification Using An Enhanced Term Weighting Scheme And Filter-Wrapper Feature Selection. PhD thesis, Universiti Sains Malaysia.

[img]
Preview
PDF
Download (892kB) | Preview

Abstract

Social networks and their usage in everyday life have caused an explosion in the amount of short electronic documents. Social networks, such as Twitter, are common mechanisms through which people can share information. The utilization of data that are available through social media for many applications is gradually increasing. Redundancy and noise in short texts are common problems in social media and in different applications that use short text. However, the shortness and high sparsity of short text lead to poor classification performance. Employing a powerful short-text classification method significantly affects many applications in terms of efficiency enhancement. This research aims to investigate and develop solutions for feature discrimination and selection in short texts classification. For feature discrimination, we introduce a term weighting approach namely, simple supervised weight (SW), which considers the special nature of short text in terms of term strength and distribution. To address the drawbacks of using existing feature selection with short text, this thesis proposes a filter-wrapper feature selection approach. In the first stage, we propose an adaptive filter-based feature selection method that is derived from the odd ratio method, used in reducing the dimensionality of feature space. In the second stage, grey wolf optimization (GWO) algorithm, a new heuristic search algorithm, uses the SVM accuracy as a fitness function to find the optimal subset feature.

Item Type: Thesis (PhD)
Additional Information: Access full text: Off Campus Log In Via OpenAthens
Subjects: Q Science > QA Mathematics > QA75.5-76.95 Electronic computers. Computer science
Divisions: Pusat Pengajian Sains Komputer (School of Computer Sciences) > Thesis
Depositing User: Mr Mohammad Harish Sabri
Date Deposited: 03 Jul 2020 07:41
Last Modified: 03 Jul 2020 07:41
URI: http://eprints.usm.my/id/eprint/46679

Actions (login required)

View Item View Item
Share