Enhanced Late-Straggler Algorithm With On-Demand Etl For Big Data Retrieval

Zakaria Katrawi, Anwar Hussein (2022) Enhanced Late-Straggler Algorithm With On-Demand Etl For Big Data Retrieval. PhD thesis, Perpustakaan Hamzah Sendut.

[img]
Preview
PDF
Download (822kB) | Preview

Abstract

The growth of digital information is phenomenal. Digital documents dominate nearly every aspect of doing business to the point that it is hard to imagine doing without them. With an unprecedented potential lurking in its depths, the ongoing digital information revolution also presents risks and challenges, mainly when dealing with the extraction and analysis of digital data. The conventional method ETL of Big Data processing consists of Extraction, Transformation, and Loading integrated into a warehouse. Using this method without any optimization often leads to a delay in data retrieval, known as the straggler problem, which is a situation that arises when tasks are delayed due to low processing on some nodes. The straggler problem is considered by many as a major problem, especially when the data resources are important and if these resources are inefficiently used. Hence, detecting and, therefore, eliminating the straggler problem early is crucial to enhancing the ETL performance.

Item Type: Thesis (PhD)
Subjects: T Technology > T Technology (General) > T1-995 Technology(General)
Divisions: Pusat IPv6 Termaju Negara (National Advanced IPv6 Centre of Excellence NAv6) > Thesis
Depositing User: Mr Hasmizar Mansor
Date Deposited: 28 Feb 2024 06:49
Last Modified: 28 Feb 2024 06:49
URI: http://eprints.usm.my/id/eprint/60026

Actions (login required)

View Item View Item
Share