Graduate Data Engineer
About Our Client Work in a true tech start-up environment with a business that has thrived since it's inception in under 5 years. Wear t-shirts and sneakers to work, and escape the rigidity of the corporate world. They have offices in Sydney, Melbourne, Brisbane, Perth, and Singapore and have grown to over 300 people in just five years.
Job Description As they are ramping up for the current project, we need someone who can hit the ground the running. Support and maintain existing ETL processes that ingest data from various sources (such as relational databases, APIs, SFTP sites, etc.), transform it and load it into S3 or Redshift.
Work closely with internal teams to capture and analyze data and process requirements and implement those as required. Engage with 3rd party vendors in order to implement and integrate new solutions. Design and implement a uniform and consistent ETL framework and migrate existing ETL processes into this platform.
Build data models, such as a single customer view, to facilitate descriptive and predictive analytics. Design and develop a centralized monitoring tool for infrastructure performance and processes, capable of raising alarms and notifications and executing automated actions. Support AWS infrastructure and continuously work towards improving its reliability and availability whilst optimizing cost and performance.
Assess and implement new technologies and processes. The Successful Applicant Ability to design and develop ETL workflows. Experience in programming in Python.
Writing and tuning complex SQL queries. Experienced in working with relational databases (such as Oracle, MS SQL, MySQL). Ability to design and develop ETL workflows.
Knowledge of complexities and challenges of implementing ETL and data flow processes for Big Data. Excellent understanding and extensive experience in AWS services (such as S3, EC2, CloudWatch, Kinesis, Redshift, Athena â€¦) Experience in Linux operating system and Linux shell scripting. What's on Offer Weekly internal tech meetups with food and drinks, host game nights, organize Hackathons, pay for AWS training and certifications.
Social events, often supporting charity initiatives. Paid parental leave program. Flexible working hours and a culture based on respect, trust, and collaboration.
Full-working rights are a must.