Lead Data Engineer - Sydney Australia

Company: Confidential
Your Application: You have not applied yet
Location: Sydney Australia, Australia
JOB DESCRIPTION

Lead Data Engineer
Accenture Australia
Do you have your head in the Cloud-
Combine the best of your ingenuity oud technologies to build a better world ad clients towards changebr>Join us extraordinary thingsr>

About you:

As a Lead Data Engineer, you will design intain data analytic road maps ta structures that support business chnology objectivesaturally inquisitive en to exploration of underlying data, finding valuable insights rk with functional areas to drive identified actions, you enjoy working both autonomously part of a team ve the confidence to influence mmunicate with stakeholders at all levels mfortable working with ambiguity in complex environmentsp>

About the role:
You will become an integral part of our Cloud First & Applied Intelligence team with the credibility, expertise sight clients depend on working alongside our industry, functional chnology SMEs with famous brnd household names to tackle some of the most challenging problems in industry e communityn our team you will:

Work as a hn, authentic mmitted Data Engineer to support clients across a range of industriesr>Take responsibility for all aspects of data engineering from delivery planning, estimating alysis, through to data architecture peline design, delivery, oduction implementation
Design plement complex data solutions ranging from batch to streaming ent-driven architectures, across cloud, on-premises brid client technology lpes
Delivering a number of analytical use cases for the Confidential businessbr>Develop liver complex data transforms derste need for de-normalised gregated data for BI solutionsbr>Carry out root cause analysis of the problem opose solutionsr>Attend SCRUM ceremonies to report on progress mmunicate with the teamr>Providing ongoing support intenance of the Dashboards ta in the data lake platformr>Fix bugs velop minor enhancementsbr>Liaise with the business on application maintenance activities e ticket updates, system status, upcoming maintenance/ downtimer>Ensure technical expectations of deliverables are met
Drive thought-leadership on engineering chitectural practices s
Working closely with the Scrum Master oduct Owner to develop end to end analytical solutions which will require transformation of complex data sets from multiple source systems, fix bugs, develop enhancements, address queries quests from business sist in data tegration testsbr>

We are looking for experience in the following:

Using tools chniques such as Data Lake, SQL, Python/Pysparkor other programming languages with the capability to learn Python, Git, AWS, ADO DevOpsr>Strong hn experience in building data engineering pipelinesr>Worked on delivering Data & Analytics solution on cloud platform, preferably AWS
Used cloud data services, such as S3, RedShift, Glue, Step Functions, Lambda

Desirable

Previous experience with high-scale or distributed RDBMS Teradata, Netezza, Greenplum, Aster Data, Vertica, including metadata Confidential, SQLrformance tuning within these database environmentsr>Experience in addressing plementing data quality solutions, data reconciliation framework rong underst perience in building data lineage documentation, ta Cataloguesbr>Experience with related/complementary open source software platforms nguages e Java, Linux, Apache, Perl/PHP, Chef

Qualifications

Bachelor?s degree, Computer Science, Software Engineering, or a related experience
Accenture Australia
Do you have your head in the Cloud-
Combine the best of your ingenuity oud technologies to build a better world ad clients towards changebr>Join us extraordinary thingsr>

About you:

As a Lead Data Engineer, you will design intain data analytic road maps ta structures that support business chnology objectivesaturally inquisitive en to exploration of underlying data, finding

valuable insights rk with functional areas to drive identified actions, you enjoy working both autonomously part of a team ve the confidence to influence mmunicate with stakeholders at all levels mfortable working with ambiguity in complex environmentsp>

About the role:
You will become an integral part of our Cloud First & Applied Intelligence team with the credibility, expertise sight clients depend on working alongside our industry, functional chnology SMEs with famous brnd household names to tackle some of the most challenging problems in industry e communityn our team you will:

Work as a hn, authentic mmitted Data Engineer to support clients across a range of industriesr>Take responsibility for all aspects of data engineering from delivery planning, estimating alysis, through to data architecture peline design, delivery, oduction implementation
Design plement complex data solutions ranging from batch to streaming ent-driven architectures, across cloud, on-premises brid client technology lpes
Delivering a number of analytical use cases for the Confidential businessbr>Develop liver complex data transforms derste need for de-normalised gregated data for BI solutionsbr>Carry out root cause analysis of the problem opose solutionsr>Attend SCRUM ceremonies to report on progress mmunicate with the teamr>Providing ongoing support intenance of the Dashboards ta in the data lake platformr>Fix bugs velop minor enhancementsbr>Liaise with the business on application maintenance activities e ticket updates, system status, upcoming maintenance/ downtimer>Ensure technical expectations of deliverables are met
Drive thought-leadership on engineering chitectural practices s
Working closely with the Scrum Master oduct Owner to develop end to end analytical solutions which will require transformation of complex data sets from multiple source systems, fix bugs, develop enhancements, address queries quests from business sist in data tegration testsbr>

We are looking for experience in the following:

Using tools chniques such as Data Lake, SQL, Python/Pysparkor other programming languages with the capability to learn Python, Git, AWS, ADO DevOpsr>Strong hn experience in building data engineering pipelinesr>Worked on delivering Data & Analytics solution on cloud platform, preferably AWS
Used cloud data services, such as S3, RedShift, Glue, Step Functions, Lambda

Desirable

Previous experience with high-scale or distributed RDBMS Teradata, Netezza, Greenplum, Aster Data, Vertica, including metadata Confidential, SQLrformance tuning within these database environmentsr>Experience in addressing plementing data quality solutions, data reconciliation framework rong underst perience in building data lineage documentation, ta Cataloguesbr>Experience with related/complementary open source software platforms nguages e Java, Linux, Apache, Perl/PHP, Chef

Qualifications

Bachelor?s degree, Computer Science, Software Engineering, or a related experience
-
Click
Apply Now
$'ternal_job_apply_now_button''click', {
;
;
};



Apply Now
$'ternal_job_apply_now_button''click', {
;
;
};
 

 
 

$'''click', {
;
$'#myModal392464'', 'open';
}
$document"click", "", {
;
;
}
$'#''click', {
;
;
};
Confidential

:

Location

Confidential, Australia

Arrangements



Industries

IT & Telecomms






JOB TYPE
Work Day: Full Time
Employment type: Permanent Job
Salary: Negotiable


JOB REQUIREMENTS
Minimal experience: No experience



Jobs you may be interested in






    Tips You May Be Interested In