Skip header navigation

Conference Proceeding

Data Analytics in Text Messages: A Mobile Network Operator Case Study

Babaee M & Sarabadani H (2019) Data Analytics in Text Messages: A Mobile Network Operator Case Study. In: 9th International Symposium on Telecommunication, IST 2018. 2018 9th International Symposium on Telecommunications (IST), Tehran, Iran, 17.12.2018-19.12.2018. Piscataway, NJ: Institute of Electrical and Electronics Engineers Inc. pp. 330-336.

This paper explores the application of different data mining and machine learning algorithms to propose an effective technique to filter out spam SMSs. Due to high competitive nature of MNO business; filtering spam SMSs will have a great impact on the protection of business and profit making. This is mostly because subscribers refuse to use the services of MNOs that are not vigilant about spam SMSs. Based on the CRISP-DM method which is an open standard process model for data analytics projects, machine learning algorithms and data preparation methods have been conducted on a MNO unstructured dataset to transform characters, delete stop words, extract word stems, roots, N-Grams, and classification. Next, numerical Vector Space Models were created utilizing all four types of word vector creation methods. After producing test and train models with machine learning algorithms; accuracy and error rate, recall, precision and the area under curve for each classification algorithm has been measured. Finally, the Bagging algorithm by implementing Binary Term Occurrence vector space creation method showed the highest efficiency rate which can have the highest application in the big data ecosystem of the industry for spam filtering.

Machine learning algorithms; Big Data; Data models; Text mining; Numerical models; Business

Author(s)Babaee, Mohammadreza; Sarabadani, Hamidreza
Publication date31/12/2019
Publication date online07/03/2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Place of publicationPiscataway, NJ
Conference2018 9th International Symposium on Telecommunications (IST)
Conference locationTehran, Iran
Scroll back to the top