Arrixa AB

Databricks Data Engineer

Stockholm

FULL TIME

October 11, 2024

Job Description: -
We are seeking an experienced "Senior Data Engineer" with a deep understanding of data engineering, cloud data platforms, and the Databricks ecosystem. The ideal candidate will have over 6 years of hands-on experience designing and implementing data solutions on Databricks, along with strong expertise in data modeling, ETL processes, and cloud data architectures. You will be responsible for building, optimizing, and maintaining robust data pipelines while ensuring data quality and scalability.

Key Responsibilities:
⦁ Design and implement scalable data pipelines on Databricks and Apache Spark.
⦁ Develop, test, and maintain ETL solutions using Py Spark and SQL.
⦁ Build data models and optimize performance for efficient data processing and analytics.
⦁ Collaborate with data scientists, analysts, and other stakeholders to understand requirements and deliver data solutions.
⦁ Implement best practices for data governance, data security, and data quality management.
⦁ Monitor and troubleshoot performance bottlenecks in data pipelines and optimize them for efficiency.
⦁ Lead efforts in the migration of data solutions to Databricks from legacy systems.
⦁ Work closely with cloud architects to ensure seamless integration with cloud data platforms (e.g., Azure, AWS, GCP).
⦁ Participate in code reviews and provide mentorship to junior engineers.

Required Skills & Qualifications:
⦁ 6+ years of experience in data engineering, with at least 3+ years of hands-on experience on Databricks.
⦁ Expertise in Apache Spark and Py Spark.
⦁ Strong knowledge of SQL and relational databases.
⦁ Experience with cloud data platforms like Azure Data Lake, AWS S3, or GCP Big Query.
⦁ Proficiency with ETL tools and processes.
⦁ Understanding of data modeling, schema design, and optimization techniques.
⦁ Familiarity with CI/CD pipelines and version control (Git).
⦁ Knowledge of Delta Lake, Parquet, and other big data file formats.
⦁ Experience with Airflow, Databricks workflows, or other orchestration tools.
⦁ Solid understanding of data security and governance in cloud environments.

Nice-to-Have Skills:
⦁ Familiarity with Power BI, Tableau, or other data visualization tools.
⦁ Knowledge of Kafka, Event Hubs, or other real-time data streaming technologies.
⦁ Experience with Scala in a Spark environment.

No Visa Sponsorship, apply only if physically available in Sweden and have valid work authorisation.

Öppen för alla
Vi fokuserar på din kompetens, inte dina övriga förutsättningar. Vi är öppna för att anpassa rollen eller arbetsplatsen efter dina behov.
New Job Alerts
AFRY

Fredrik söker en Senior Projektledare inom produktutveckling och produktion i Mälardalen

Stockholm

November 20, 2024

View Job Description
Sway Sourcing Sweden AB

Scrum Master & Business Analyst - Malmö

Malmö

FULL TIME

November 20, 2024

View Job Description
Job Solution Sweden Consulting AB

CAM-beredare med erfarenhet av kompositmaterial

Linköping

FULL TIME

November 20, 2024

View Job Description
Business Sweden

Senior Advisor, Strategic Partnerships to GTI, Washington D.C.

Stockholm

November 20, 2024

View Job Description
H2GS AB

Talent Acquisition Manager - Boden

Boden

FULL TIME

November 20, 2024

View Job Description
Co-Worker Consulting Partner Sweden AB

Expert on Baseband Layer 2 Architecture

FULL TIME

November 20, 2024

View Job Description
Business Sweden

Head of Accounting, Stockholm

Stockholm

November 20, 2024

View Job Description
BRUKS SIWERTELL GROUP

Group CIO

Bjuv

FULL TIME

November 20, 2024

View Job Description
ARKET

Sales Advisor 8-12H

Malmö

PART TIME

November 20, 2024

View Job Description
Karolinska Institutet, doctoral positions

Doktorandplats inom klinisk epidemiologi med fokus på vaccination under graviditet

Solna

FULL TIME

November 20, 2024

View Job Description
Looking for similar job?
IKEA

Architecture Leader | Data & Information Architect | ROSS

Malmö

FULL TIME

October 8, 2024

View Job Description
Boston Consulting Group

Data Scientist, Sweden - BCG X

Stockholm

FULL TIME

October 7, 2024

View Job Description
Boston Consulting Group

Data Scientist, Internship, Sweden - BCG X

Stockholm

FULL TIME

October 7, 2024

View Job Description
HITACHI ENERGY SWEDEN AB

Sustainability data specialist/controller

Västerås

FULL TIME

October 7, 2024

View Job Description
& Other Stories

Data Strategist & Web Analyst

Stockholm

FULL TIME

October 7, 2024

View Job Description
NXT Interim Malmö AB

Data Scientist/Analyst

Malmö

FULL TIME

October 7, 2024

View Job Description
New Job Alerts
AFRY

Fredrik söker en Senior Projektledare inom produktutveckling och produktion i Mälardalen

Stockholm

November 20, 2024

View Job Description
Sway Sourcing Sweden AB

Scrum Master & Business Analyst - Malmö

Malmö

FULL TIME

November 20, 2024

View Job Description
Job Solution Sweden Consulting AB

CAM-beredare med erfarenhet av kompositmaterial

Linköping

FULL TIME

November 20, 2024

View Job Description
Business Sweden

Senior Advisor, Strategic Partnerships to GTI, Washington D.C.

Stockholm

November 20, 2024

View Job Description
H2GS AB

Talent Acquisition Manager - Boden

Boden

FULL TIME

November 20, 2024

View Job Description
Co-Worker Consulting Partner Sweden AB

Expert on Baseband Layer 2 Architecture

FULL TIME

November 20, 2024

View Job Description
Business Sweden

Head of Accounting, Stockholm

Stockholm

November 20, 2024

View Job Description
BRUKS SIWERTELL GROUP

Group CIO

Bjuv

FULL TIME

November 20, 2024

View Job Description
ARKET

Sales Advisor 8-12H

Malmö

PART TIME

November 20, 2024

View Job Description
Karolinska Institutet, doctoral positions

Doktorandplats inom klinisk epidemiologi med fokus på vaccination under graviditet

Solna

FULL TIME

November 20, 2024

View Job Description