Want to be notified the moment a job has been posted? Setup Job Alerts
Manager Custom IngestionCustomer Strategy & Technology
Are you an effective communicator and collaborator? Interested in leading a team of Full Stack and ELT developers? About us At Transport, we’re passionate about making NSW a better place to live, work and visit. Our vision is to give everyone the freedom to choose how and when they get around, no matter where they live. Right now, we’re delivering a $57.
5bn program – the largest Australia has ever seen – to keep people and goods moving, connect communities and shape the future of our cities, centres and regions. Advanced Analytics and Insights We are a trusted partner to our clients, within Customer Strategy and Technology, developing and delivering smart, integrated and sustainable data and analytics solutions which enable evidence-driven decisions to benefit our customers and communities. The opportunity The primary purpose of the role is to lead a discreet team of Full Stack and ELT developers responsible for the obtaining and importing of data for immediate use or storage in proprietary, cluster databases.
To view the role description, please click here You will Coach and mentor a discreet team of Full Stack and ELT developers by helping to guide their work program, contributing to their professional development and supporting them to achieve performance outcomes in line with the team’s strategic priorities Work in collaboration with Division and Group IT teams to determine the optimal and most effective way to approach to the ingesting of data Provide specialist advice for projects involving numerous data sources that exist in diverse formats Help divisions optimise their data by first co-reviewing their data source type, data transport protocols and updating the semantics of incoming data ingestion techniques For special data projects where the preference for spoke teams is to ingest batch data, support stakeholders to progressively work through key issues concerning incoming data semantics, data acquisition, behavior and error conditions data denormalization and transformation For special data projects where the preference for spoke teams is to ingest streaming data, support stakeholders to progressively work through key issues concerning systems capacity and reliability, data context and volume with the intent then of exploring how new frameworks such as Apache Strom, Apache Flume and Apache Kaftka can be used Perform research to identify and recommend best practice frameworks, systems, software and tools that enable the ingestion process to be automated About You You’re a collaborative and talented leader of people with a strong background in data ingestion, batching and streaming. You demonstrate stakeholder engagement expertise, decisiveness, and the drive to get things done. Engaging and energetic, you excel in communication and presentation and have proven experience in a complex customer-centric environment.
Essential requirements Experience using data ingestion frameworks, systems, software and tools in large scale, com....