Lead Data Engineer

Location

Description

About Our Client Join a successful new player in the Digital/Cloud Transformation game. This organization has successfully been through the initial high-risk startup phase and has consolidated its spot in the market as a key player in this competitive space. Modern offices and flexible work options are consistent with Melbourne's fast-growing start-up culture.

Work with industry-leading execs that can offer career growth and up-skilling opportunities. Job Description Design and implement optimal data pipeline architectures Assemble large, complex data sets that meet business requirements Identify, design, and implement internal process improvements: including process automation, optimizing data delivery, etc. Design optimal ETL infrastructures from a variety of data sources Incorporate governance processes and tools into the data landscape Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.

Work with executive, LOB, design and IT stakeholders on data-related technical issues and infrastructure needs Keep data separated and secure across national boundaries through replication and failover techniques Guide and mentor clients to become self-sufficient practitioners The Successful Applicant From a development or operations background (or an existing DataOps Team) Understanding what getting something done looks like (documentation, testing, operational requirements, continuous improvement of the process) Have experience with the AWS ecosystem (EC2, EBS, S3, ASG's, ALB/ELB's, VPC's, etc… Experience with big data tools: Hadoop, Spark, Kafka, Kinesis, etc. Experience working with the following Toolsets will be strongly considered: Talend on AWS, Snowflake SaaS and resulting DevOps, configuration activities. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.

Experience with data pipeline and workflow management tools: Azkaban, Luigi, Nifi, Airflow, etc. Experience with AWS cloud data services: EMR, RDS, Redshift, Kinesis, Glue Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: SQL, Python, PySpark, SCALA, etc What's on Offer Work for a successful start-up Lucrative package Centrally located Lots of opportunities to upskill, certify, and grow.

.

Company
JOB8
Share Now

Posted

18 Oct 2019

CONTACT US

We're not around right now. But you can send us an email and we'll get back to you, asap.

Sending
Copyright © NZRelo™ 2019. All Rights Reserved.
Loading

To save this website, tap the button and select Add To Home Screen.

× Tap this message to dismiss.

Forgot your details?