International Journal of Science, Engineering and TechnologyAuthors: Shreya Banerjee
Abstract: Linux-based ETL workflows are critical for enterprise data integration, analytics, and operational decision-making. This review explores ETL strategies on Red Hat Enterprise Linux and CentOS, covering extraction, transformation, and loading processes, tools, scripting techniques, and automation approaches. It examines open-source platforms, database-native methods, and workflow orchestration for scalable and maintainable pipelines. Performance optimization, logging, monitoring, and security considerations are discussed, along with practical applications in finance, healthcare, and retail. Emerging trends including cloud integration, AI-enhanced ETL, real-time processing, and containerization are highlighted to provide insights into future-ready Linux ETL pipelines. The review provides guidance for building reliable, efficient, and automated data workflows in enterprise environments.
DOI: http://doi.org/10.5281/zenodo.17278576
