Lead Senior Data Engineer

Data Engineers prepare raw data for analytical or operational uses. They make data accessible so that it can be used for optimisation, delivery of services and enhanced analytics solutions. Key duties and responsibilities The Senior Analytics Engineer will be responsible for:   • Writing robust, performant, production quality code and tests   • Identifying and applying appropriate design patterns and practices    • Providing a leading contribution to the design and code review processes   • Assisting delivery leadership with work planning and estimations   • Productionising and optimising non-trivial distributed algorithms   • Working with vendors, engineers, data scientists and UX designers to integrate algorithm    implementations with data pipelines and production systems • Developing improvements to entity resolution and network analytics solutions • Working on Spark platforms to deploy parallelisable distributed data pipelines    • Working with architecture and engineering teams to build robust, sustainable and adaptable analytics platforms and tools to support agency initiatives   • Working with governance to ensure successful delivery of team initiatives  • Fostering a positive, respectful, and delivery focused culture for the team. Skills, Qualifications & Experience: •  Undergraduate degree in Computer Science or a related field, or equivalent work experience.  •  Excellent software engineering skills, including 5+ years’ experience delivering production-grade software in mainstream general-purpose languages. We currently use Scala, Python, SQL, and Java, but also encourage applications by people with experience in different main-stream programming languages and frameworks.  • Knowledge of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.  • Experience in wrangling complex datasets (SQL, Apache Spark) and implementing complex, data science based algorithms.  • Exposure to full stack software development, and experience in data platform engineering and administration. DevOps experience is desirable Criteria The buyer has specified that each candidate must provide a response to each criterion. Each response is limited to 3000 characters. Essential criteria Weighting 1. Extent to which the response meets AUSTRAC’s requirement set out in the RFQ Weighting: 60% 2. The Supplier’s demonstrated capability and capacity to provide the requirement Weighting: 20% 3. Whole of life costs incurred by AUSTRAC. Considerations will include both the quoted price and any costs AUSTRAC will incur as a result of accepting the Supplier’s response Weighting: 20% Opportunity summary Sellers can submit Up to 2 candidates Number of sellers invited Between 5 and 10 Number of candidates submitted Fewer than 10 RFQ closing time 02 Weeks 03 Days 06 Hours Send us feedback About Accessibility Privacy Terms of use Disclaimer and copyright An initiative of the Digital Transformation Agency The Australian Government acknowledges the Traditional Owners of Country throughout Australia and acknowledges their continuing connection to land, waters and community. We pay our respects to the people, the cultures and the Elders past and present. © Commonwealth of Australia