Senior Data Engineer

This role is responsible for designing, building and maintaining data pipelines and curated datasets within the Agency’s analytics platform, enabling high-quality analytics and data-driven decision-making. You will be required to undertake work that is complex and sensitive while operating under broad direction, applying sound decision-making and judgement to produce high quality outcomes. Specifically, you will be responsible for building and documenting ETL pipelines and data lineage to ingest data into our analytics platform, including cleansing, aggregating, and modelling data to inform digital health business through deep dive analytics. This includes identifying opportunities to improve data capture, linkage, transformation, and flow. You can demonstrate strong data engineering technical skills with the ability to communicate findings using plain language. Key duties and responsibilities Data Engineering & Platform Development Design, build and maintain scalable data pipelines to ingest, transform and publish data into the Agency analytics platforms. Develop and optimise data models and curated datasets to support reporting, analytics and data science use cases. Identify and implement improvements to data ingestion, transformation, and data flow processes. Experience with Azure Data Factory, Databricks, Python (PySpark), SQL and Power BI environments Data Quality & Integrity Establish and maintain strong data quality practices, including monitoring, validation, and issue resolution. Perform root cause analysis of data issues and implement sustainable fixes to improve reliability and trust in data assets. Analysis & Problem Solving Analyse complex data problems, identify underlying causes, and deliver practical, fit-for-purpose solutions. Support analytical use cases through preparation and curation of high-quality datasets to support insights. Leadership & Delivery Take ownership of deliverables, managing competing priorities to achieve high-quality outcomes. Provide expert advice on complex data engineering issues and contribute to strategic direction within the team. Promote adoption of best practices, standards, and continuous improvement in data engineering. Collaboration & Stakeholder Engagement Work closely with data analysts, data scientists, and business stakeholders to deliver trusted, well-understood datasets aligned to business needs. Communicate complex technical concepts in clear, plain language to non-technical audiences. Build and maintain effective working relationships across internal and external stakeholders. Platform & Technical Capability Contribute to the design, development, testing, deployment, and ongoing support of the analytics platform and associated tooling. Apply modern data engineering practices, including testing, automation, and performance optimisation across data pipelines. Essential requirements Ability to obtain and maintain a Neg Vet 1 (NV1) security clearance Ability to obtain and maintain national police check. Australian Citizenship is a condition of eligibility. Qualifications Tertiary qualification in Computer Science, Engineering, or related field (desirable) Equivalent experience will be considered   Criteria The buyer has specified that each candidate must provide a one page pitch to address all criteria specified. This is equal to 5000 characters. Essential criteria 1. Demonstrated compliance/alignment with the Statement of Requirement 2. Relevant experience of the candidate 3. Relevant skills, knowledge and education/qualifications Opportunity summary Sellers can submit Up to 5 candidates Number of sellers invited Between 5 and 10 Number of candidates submitted Fewer than 10 Send us feedback About Accessibility Privacy Terms of use Disclaimer and copyright An initiative of the Digital Transformation Agency The Australian Government acknowledges the Traditional Owners of Country throughout Australia and acknowledges their continuing connection to land, waters and community. We pay our respects to the people, the cultures and the Elders past and present. © Commonwealth of Australia