• Design and implement scalable big data architectures to handle large volumes of data.

• Develop and optimize data processing pipelines using technologies such as Hadoop, Spark, and Kafka.

• Collaborate with data scientists and analysts to provide data insights and support advanced analytics.

• Manage and maintain big data platforms, ensuring high availability and performance.

• Perform data extraction, transformation, and loading (ETL) tasks from various data sources.

• Implement data security measures to protect sensitive information.

• Monitor and troubleshoot data processing systems to ensure reliability and efficiency.

• Evaluate and integrate new big data technologies to enhance data processing capabilities.

• Provide technical leadership and guidance to the data engineering team.

• Stay abreast of industry trends and advancements in big data technologies to drive innovation.