Find your next job in New Zealand
Browse by

Python Data Engineer
Exponential Trading
10 Aug 2025Sydney, New South Wales, 2000Full TimeIT
Role OverviewWe are seeking a Python Data Engineer to design, build, and optimise robust data pipelines while maintaining the highest standards of code quality and engineering best practices. You will work closely with our trading and research teams to deliver clean, maintainable, and scalable solutions that drive our analytics and operational workflows. ResponsibilitiesDesign and implement modular, reusable, and maintainable Python code for data ingestion, transformation, and analysis pipelinesDevelop and maintain unit and integration tests to ensure reliability and correctness of data pipelinesOptimise data processing workflows for performance and scalability using pandas and numpyDesign and implement efficient ETL processes, ensuring memory and compute efficiency, and integrating with databases or distributed storage as requiredImplement CI/CD pipelines to automate testing, deployment, and validation of data engineering workflowsCollaborate with team members via code reviews and design discussions, driving clean architecture and maintainability across the codebaseContribute to documentation of data models, pipeline designs, and operational processes to ensure knowledge sharing and reproducibilityEstablish and enforce coding standards, including typing, docstrings, and version control workflows RequirementsStrong proficiency in Python, with a focus on clean code, modular design, and software engineering best practicesDemonstrated experience with pandas and numpy for data processing, with an understanding of performance optimisation and memory managementExperience designing scalable data pipelines, using tools such as Dask or Spark when neededSolid understanding of ETL design patterns, batching, parallel processing, and streaming conceptsProficiency with unit testing frameworks (pytest or unittest) and integration testing strategiesExperience integrating with CI/CD pipelines for automated testing and deploymentFamiliarity with database query optimisation and data storage design is a plusExcellent communication skills and a collaborative mindset for working with cross-functional teams What We OfferOwnership of data pipeline design and architecture, with autonomy to implement best practicesExposure to large-scale data processing challenges in a collaborative engineering environmentCompetitive compensation commensurate with experienceSupportive team culture focused on engineering excellence and continuous learning
Date10 Aug 2025
Location Sydney, New South Wales, 2000
type Full Time
Salary -
IT