Tech Lead (2 year fixed term)

The role

APRA is seeking to modernise its data platform and data governance architecture. The Tech Lead will play a key part in orchestrating the decommissioning of a complex on premise data architecture and transitioning to a modern data architecture leveraging Data Bricks on Azure.

Alongside other key program stakeholders (Solution Architects and Business Analysts) the Tech Lead will help define, estimate and lead transition workstreams that moves APRA architecture to the desired target state architecture. In addition, this role will work closely with other workstreams including Workstream 1 (Establishment of the Databricks platform) and Workstream 3 (Extending of the Data Governance capabilities within APRA).

This is a 2-year fixed term opportunity.

The team

This role resides within the Chief Data Office and works closely with other senior technical specialists. This role will report to the Senior Data Stream Lead and works exclusively within Program GUIDE.

Key responsibilities

Architecture Design & Strategy

• Using the established design and architecture of Databricks on Azure, work with appropriate stakeholders on extending the design to facilitate future use cases of the data platform
• Collaborate with senior management and stakeholders to align the data architecture with the organization's strategic goals, including the decommission of D2A (APRA's current collection portal)
• Define and document the technical architecture, including data pipelines, data storage, ETL processes, and governance frameworks.
• Assist in maturing the ETL framework where required

Technical Leadership

• Provide hands-on technical leadership and mentorship to a team of data engineers, and developers.
• Drive best practices in data engineering, including coding standards, testing, automation, and continuous integration/deployment (CI/CD).
• Ensure leading practices are implemented from a secure development and operations perspective
• Ensure that production releases to the Azure databricks environment are managed with appropriate oversight
• Understanding and knowledge of Unity Catalogue and its effective implementation
• Understanding and knowledge of legacy data warehouse environments including proficiency in SQL and PL/SQL

Project Management

• Contribute to the end-to-end project lifecycle, from initial requirements gathering through to deployment and ongoing maintenance.
• Collaborate with Project Managers to manage timelines, deliverables, and resources ensuring projects are completed on time and within budget.

Innovation & Optimization

• Stay abreast of the latest developments in cloud technologies, big data, and analytics, incorporating new tools and techniques to improve the architecture.
• Continuously evaluate and optimize the architecture for performance, cost-efficiency, and future scalability.

Stakeholder Engagement

• Work closely with business and technical stakeholders to understand their data needs and translate these into technical solutions.
• Provide regular updates and technical insights to senior leadership, highlighting progress, risks, and opportunities.
• Facilitate workshops and technical discussions to promote knowledge sharing and alignment across teams.

Governance & Compliance

• Implement robust data governance practices, ensuring compliance with industry standards and regulatory requirements.
• Define and enforce data quality standards, security protocols, and access controls across the data platform.
• Ensure proper documentation of all architectural decisions, designs, and processes.

About you

• Bachelor's degree in Computer Science, Information Systems, Business Administration, or a related field.
• Experience and exposure to agile delivery methodologies.
• Extensive experience as a Tech Lead, or in a related role with a strong focus on modern data architectures.
• Proven experience of large scale complex data migration projects from on premise to cloud platforms.
• Hands-on experience with Databricks, Azure Data Services, and related technologies. Azure Databricks certifications are essential.
• Strong understanding of data architecture principles, including data modelling, ETL processes, data governance, data quality, privacy and security controls.
• Proficiency in SQL, data analysis tools, and familiarity with programming languages such as Python.
• Excellent analytical and problem-solving skills, with the ability to assess complex systems and propose actionable solutions.
• Knowledge of the Medallion Architecture or similar data frameworks is highly desirable.
• Knowledge of regulatory reporting standards is advantageous.

To work with us, you need to be an Australian citizen with eligibility to gain a Baseline Security clearance.

About APRA

The Australian Prudential Regulation Authority (APRA) places you at the heart of Australia's financial services industry. APRA serves the Australian community by helping ensure financial institutions deliver on the financial commitments they make, within a stable, efficient and competitive financial system.

At APRA we're committed to providing an inclusive workplace where everyone belongs, feels valued and respected. We aspire to attract and foster diversity of background, thought, and experience, recognising that a broad range of perspectives, approaches and ideas makes us stronger, and better enables us to meet our obligation to protect the financial wellbeing of the Australian community. When applying, please inform us of any adjustments you may need during the interview process.

Job ID APR1522