Data Factory Engineers

The Australia Electoral Commission (AEC) is seeking to engage a suitably qualified and experienced Data Factory Engineers to deliver and support a range of ICT projects/programs. Data Factory Engineers are responsible for designing, developing, and maintaining data integration solutions that connect the AEC’s on-premises and cloud-based enterprise applications, leveraging Microsoft Azure tools and technologies. This role involves creating efficient data pipelines, ensuring data quality, optimising performance, and adhering to security and compliance standards. The role involves collaborating with cross-functional teams to support AEC’ systems through testing and quality assurance, monitoring, troubleshooting and issue resolution. Please note that this is an APS 6 equivalent role. As BuyICT experience level does not provide an APS 6 classification option, EL1 was selected as the closest available equivalent. Key duties and responsibilities The role will be responsible for, but not limited to: • Collaborating with team members and stakeholders to design data integration solutions that meet business requirements, utilising Microsoft Azure tools such as Azure Data Factory and SQL. • Developing, implementing, and maintaining ETL pipelines to ensure efficient and secure data transfer between various systems, adhering to best practices for data processing and transformation. • Designing and maintaining data models, ensuring data accuracy, consistency, and availability while considering scalability and performance optimisations. • Implementing data validation and quality checks to identify and rectify data anomalies, errors, and inconsistencies within integrated systems. • Continuously monitoring and optimising data integration processes to enhance performance, reduce latency, and minimise resource consumption. • Creating and maintaining comprehensive documentation for data integration solutions, including technical specifications, data flow diagrams, and operational procedures. • Working closely with cross-functional teams, including developers, and system analysts, to understand data requirements and ensure integrations align with business objectives. • Troubleshooting and resolving data integration issues, working collaboratively with the team to implement effective solutions and prevent recurrence. • Staying updated on emerging technologies and industry trends related to data engineering and integration, applying this knowledge to improve integration processes and tools. • Managing assigned work items as per established Ways of Working, and producing and maintaining appropriate documentation as required. • Performing additional duties or assuming responsibility for functions as directed by the Program Management team. Criteria The buyer has specified that each candidate must provide a one page pitch to address all criteria specified. This is equal to 5000 characters. Essential criteria 1. • Strong Microsoft Azure Data Factory skills and experience • Proven experience in data engineering, including data integration, ETL processes, and data modelling. • Strong SQL skills and experience with data warehousing concepts. • Knowledge of data governance, security, and compliance best practices. • Excellent problem-solving skills and the ability to work effectively in a collaborative team environment. • Effective communication skills for collaborating with technical and non-technical stakeholders. • Demonstrated ability to build and maintain effective working relationships. • Ability to work independently and be a self-motivated individual. 2. To be considered compliant, submissions need to be provided in 1 PDF Document including: Page 1 - a completed copy of the AEC Candidate Submission Guide (will be emailed to the listed BuyICT contact address upon RFQ publication): • Provide information for the following items: Candidate Name, Position Title, Opportunity ID, Candidate Availability, Location, Citizenship Status, Security Clearance Level, Planned Leave (exceeding 1 week), Additional Engagements, Submitting Consultant. • Choose an item or check the box that applies to the following options: Previous AEC Employee or Contractor, Current AEC Contractor, Code of Conduct, Submission History, Authority to Represent, Submission Compliancy • Consultant comments may be added (must be limited to the space provided). Page 2 - A one-page pitch addressing the selection criteria. This should not exceed one page. Pages 3 - 5 - A resume of no more than three pages We will strictly adhere to the above requirements. Submissions will be deemed non-compliant if they do not meet the listed criteria, if they exceed the 5-page limit or if the rates of submitted candidates are included in the PDF. Desirable criteria 1. • Microsoft Azure tools and services, Azure SQL Database. • Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience). • Relevant certifications (e.g., Microsoft Azure Data Engineer, AWS Certified Data Analytics) are advantageous. Opportunity summary Sellers can submit Up to 1 candidate Number of sellers invited Fewer than 5 Number of candidates submitted Fewer than 10 RFQ closing time 00 Weeks 03 Days 12 Hours Send us feedback About Accessibility Privacy Terms of use Disclaimer and copyright An initiative of the Digital Transformation Agency The Australian Government acknowledges the Traditional Owners of Country throughout Australia and acknowledges their continuing connection to land, waters and community. We pay our respects to the people, the cultures and the Elders past and present. © Commonwealth of Australia