Lead Data Engineer

Data Engineers prepare raw data for analytical or operational uses. They make data accessible so that it can be used for optimisation, delivery of services and enhanced analytics solutions. The Data Engineer operates under limited direction to support and maintain enterprise data assets across environments. The position will work closely with business and technical teams to deliver continuous improvement of data pipelines and processes. Key duties and responsibilities Develop, maintain and optimise enterprise data pipelines, Extract, Transform and Load (ETL) processes and analytical code. Define and maintain data modelling, peer review, development and release standards. Lead technical implementation activities from requirements analysis through to deployment and warranty support. Develop and maintain Structured Query Language (SQL) analytical and ETL code supporting enterprise reporting and analytics. Optimise and tune SQL code to improve performance and efficiency. Produce and maintain technical documentation, data dictionaries and implementation artefacts. Conduct peer reviews of code, data models, and technical designs. Analyse and translate business requirements into technical solutions and data assets. Collaborate with business stakeholders, developers, testers and support teams to deliver solutions. Facilitate knowledge transfer and contribute to team capability uplift Support backlog prioritisation, work queue and management, and delivery planning activities. Knowledge/Qualifications Cyber security knowledge and experience Protective Security Policy Framework (PSPF) Information Security Manual (ISM) Essential 8 Strategies National Institute of Standards and Technology (NIST) Business intelligence BINT - Level 4 Data engineering DENG - Level 6 Data management DATM - Level 6 Data modelling and design DTAN - Level 5 Data visualisation VISL - Level 5 Database design DBDS - Level 5 Information management IRMG - Level 6 Measurement MEAS - Level 5 Quality assurance QUAS - Level 5 Storage management STMG - Level 5 Criteria The buyer has specified that each candidate must provide a one page pitch to address all criteria specified. This is equal to 5000 characters. Essential criteria 1. Demonstrated experience in cyber resilience, security remediation or compliance initiatives within large and complex ICT environments, preferably within Australian Government or other regulated environments. 2. Demonstrated and proven experience performing the duties and responsibilities relevant to the role being applied for, including the required technical skills, technologies, frameworks and methodologies identified in the RFQ 3. Demonstrated experience applying cyber security frameworks, policies and standards, including the Protective Security Policy Framework (PSPF), Information Security Manual (ISM), Essential Eight and other relevant security and risk management frameworks. 4. Demonstrated ability to engage, influence and collaborate with a broad range of stakeholders, including senior executives, technical specialists, business representatives and external providers. Desirable criteria 1. Demonstrated experience delivering cyber security, infrastructure, ICT transformation or uplift activities within government agencies or complex ICT environments. 2. Experience working within large-scale enterprise environments involving cloud platforms, identity and access management, security operations, infrastructure, applications and data services. 3. Demonstrated ability to deliver outcomes within tight timeframes while managing competing priorities, dependencies and stakeholder expectations. 4. Demonstrated ability to communicate complex technical and cyber security concepts to both technical and non-technical audiences and contribute to capability uplift through mentoring, collaboration and knowledge transfer activities. Opportunity summary Sellers can submit Up to 2 candidates Number of sellers invited More than 10 Number of candidates submitted Fewer than 10 RFQ closing time 02 Weeks 01 Days 06 Hours Send us feedback About Accessibility Privacy Terms of use Disclaimer and copyright An initiative of the Digital Transformation Agency The Australian Government acknowledges the Traditional Owners of Country throughout Australia and acknowledges their continuing connection to land, waters and community. We pay our respects to the people, the cultures and the Elders past and present. © Commonwealth of Australia