Spain Job Openings
EPAM Systems
Lead Data Software Engineer (Spark/Scala/Databricks)
Madrid
November 26, 2024
As part of this project, our Data teams are working on migrating Data Products pipelines from Oracle workloads to Databricks. At EPAM, you will enter a dynamic, agile work environment, serving Fortune 1000 clients while adhering to best engineering practices. If you're a forward-thinking Scala expert with a passion for transforming data solutions, join us in Madrid, Málaga, or remotely across Spain to be at the forefront of innovation with EPAM!
RESPONSIBILITIES
- Develop, monitor, and operate the most used and most critical curated data pipeline at client’s - Sales Order Data (incl. post-order information, e.g. shipment, return, payment)
- Consulting with analysts, data scientists, and product managers to build and continuously improve "Single Source of Truth" KPI for business steering such as the central Profit Contribution measurement (PC II)
- Redevelop old legacy pipelines to new, advanced, and standard versions that are easy to maintain and scalable for future demands
- Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
REQUIREMENTS
- Expertise in Apache Spark along with Spark streaming
- Good hands-on experience with Databricks and delta-lake
- Fluency in Scala programming language
- Expertise in SQL
- Good understanding & hands-on experience with CI/CD
- Rich working experience with Git Hub
- Fluency working with AWS landscape
- Ability to build Apache Airflow pipelines
NICE TO HAVE
- Presto
- Superset
- Starburst
- Oracle & Exasol
WE OFFER
- Private health insurance
- EPAM Employees Stock Purchase Plan
- 100% paid sick leave
- Referral Program
- Professional certification
- Language courses
New Job Alerts
leadtech
Frontend Developer (SEO) (Full Remote within Spain)
FULL TIME
November 26, 2024
View Job Description
leadtech
Social Ads Specialist (Full remote within Spain)
FULL TIME
November 26, 2024
View Job Description
Santander
SBGM Operations Senior Analyst
Boadilla del Monte
FULL TIME
November 26, 2024
View Job Description
Inetum Spain
Técnico Middleware - especialista implantación clarive
Madrid
FULL TIME
November 26, 2024
View Job Description
Looking for similar job?
Anteriad
Italiano | Italian - Pre-Sales Lead Generation B2B
Las Rozas de Madrid
FULL TIME
September 23, 2024
View Job Description
Worldwide Recruitment Energy
Senior Project Lead Developer - EV Chargers H/F
Madrid
FULL TIME
October 8, 2024
View Job Description
Aliaxis Iberia SAU (Spain)
Continous Improvement Plant Leader
FULL TIME
October 8, 2024
View Job DescriptionArtelier
Lead Project Manager and Designer
FULL TIME & PART TIME
September 23, 2024
View Job DescriptionSee What’s New: EPAM Systems Job Opportunities
EPAM Systems
Lead Data Software Engineer (Spark/Scala/Databricks)
Madrid
November 26, 2024
View Job Description
New Job Alerts
leadtech
Frontend Developer (SEO) (Full Remote within Spain)
FULL TIME
November 26, 2024
View Job Description
leadtech
Social Ads Specialist (Full remote within Spain)
FULL TIME
November 26, 2024
View Job Description
Santander
SBGM Operations Senior Analyst
Boadilla del Monte
FULL TIME
November 26, 2024
View Job Description
Inetum Spain
Técnico Middleware - especialista implantación clarive
Madrid
FULL TIME
November 26, 2024
View Job Description