Lead Data Engineer

The Data engineer will work as part of the Data Operations team within Data and Systems (DaS) section, supporting the maintenance and delivery of Geoscience Australia’s Earth Analysis scientific products and infrastructure capability. The candidate will work closely with DaS teams with a specific focus on data management, IT system support and Earth observation product support. It will consider cybersecurity implications in the planning, delivery and monitoring of any solutions and align with branch governance frameworks. Expertise in data engineering orchestration, containerisation, and coding in Python is essential. Key duties and responsibilities Design, coding, training, validation, maintenance, optimisation through orchestration testing and documentation of machine learning workflows Support data source, ingest, and transformation pipeline development and maintenance Open Data Cube code base development, testing and maintenance Knowledge transfer and upskilling of Earth Observation Scientists Guidance on existing algorithm improvements Implement, maintain and improve automated testing and deployment pipelines on AWS for various platforms. Contribute and drive a strong culture with a focus on collaboration Ensure that services and components are available and high performing Embed security tools and practices into systems and CI/CD pipelines. Support data operations as directed by DaS leadership. Other required admin tasks as appropriate and required by the Buyer. Criteria The buyer has specified that each candidate must provide a one page pitch to address all criteria specified. This is equal to 5000 characters. Essential criteria 1. • Demonstrated experience working with large, geospatial datasets within a cloud environment. 2. • Comprehensive knowledge of protocols associated with data access and editing. 3. • Demonstrated experience providing strategic advice and guidance on the use and reuse of data processes, systems and tools. 4. • Provide technical leadership across software development, driving the adoption of development practices, tools and standards to deliver secure, high-quality solutions. 5. • The ability to work effectively with technical and non-technical stakeholders, and communicate complex concepts across a range of audiences. Desirable criteria 1. • Build and sustain strong relationships and collaboration while fostering an inclusive, high-performing team environment. Opportunity summary Sellers can submit Up to 2 candidates Number of sellers invited Between 5 and 10 Number of candidates submitted Fewer than 10 RFQ closing time 02 Weeks 05 Days 06 Hours Send us feedback About Accessibility Privacy Terms of use Disclaimer and copyright An initiative of the Digital Transformation Agency The Australian Government acknowledges the Traditional Owners of Country throughout Australia and acknowledges their continuing connection to land, waters and community. We pay our respects to the people, the cultures and the Elders past and present. © Commonwealth of Australia