Cloud Data Engineers (AWS, Glue, PySpark)

As a Data Engineer for one of the top Australian banks, you will be involved in supporting the bank's initiative to modernize their data and analytics platform. Your primary responsibilities will include: - Designing, building, and delivering a new cloud data solution to transform international regulatory reporting requirements - Leading the design and delivery of cost-effective, scalable data solutions aligned with strategic goals - Driving solution architecture decisions in alignment with enterprise architecture principles and business priorities - Engineering robust data product assets and pipelines in AWS (S3, Glue, Iceberg, Kinesis, Airflow, Sagemaker, Redshift) - Providing technical data governance and risk management - Leading a team of data engineers, providing technical guidance, reviewing work, and mentoring team members - Defining and implementing engineering standards for data modelling, ingestion, transformation, and egression patterns - Collaborating across teams to ensure a secure, efficient, and well-documented solution - Contributing to continuous improvement initiatives within the team - Demonstrating strong experience in Data Engineering using Agile practices and DevSecOps - Designing, building, and delivering "greenfield" data solutions in AWS Cloud using cloud native technologies with a focus on data quality assurance and security controls - Mentoring and building a community of engaged and curious engineers - Exhibiting excellent verbal and written communication skills - Engaging and managing internal stakeholders and external suppliers - Having a problem-solving mindset with a focus on automation and continuous process improvement In addition to the above responsibilities, you are expected to have the following mandatory skills: - 4+ years of experience in designing, building, and delivering enterprise-wide data solutions - Extensive experience in data ingestion, integration, and pipeline solutions - Strong Data Architecture expertise with knowledge of data governance - Ability to drive platform efficiency through automation and AI capabilities - Proficiency in various tools and languages including Python, SQL, AWS Data Stack, Data Orchestration & Pipelines, Data Formats & Modelling, Programming & DevOps, ETL & Ingestion, Security and Observability, Testing & Automation, and familiarity with data warehousing and visualization tools - AWS Data Engineer Associate certification Nice-to-have skills include: - AWS Solution Architect certification - Containerization (Docker, Kubernetes) - Experience with data visualization tools and integration - Experience with Alation, Observability tools, Ab initio or DBT tooling, Parquet File Format, Iceberg tables, Glue Data Catalogue & AWS DataZone, and Markets domain knowledge This role requires proficiency in English. As a Data Engineer for one of the top Australian banks, you will be involved in supporting the bank's initiative to modernize their data and analytics platform. Your primary responsibilities will include: - Designing, building, and delivering a new cloud data solution to transform international regulatory reporting requirements - Leading the design and delivery of cost-effective, scalable data solutions aligned with strategic goals - Driving solution architecture decisions in alignment with enterprise architecture principles and business priorities - Engineering robust data product assets and pipelines in AWS (S3, Glue, Iceberg, Kinesis, Airflow, Sagemaker, Redshift) - Providing technical data governance and risk management - Leading a team of data engineers, providing technical guidance, reviewing work, and mentoring team members - Defining and implementing engineering standards for data modelling, ingestion, transformation, and egression patterns - Collaborating across teams to ensure a secure, efficient, and well-documented solution - Contributing to continuous improvement initiatives within the team - Demonstrating strong experience in Data Engineering using Agile practices and DevSecOps - Designing, building, and delivering "greenfield" data solutions in AWS Cloud using cloud native technologies with a focus on data quality assurance and security controls - Mentoring and building a community of engaged and curious engineers - Exhibiting excellent verbal and written communication skills - Engaging and managing internal stakeholders and external suppliers - Having a problem-solving mindset with a focus on automation and continuous process improvement In addition to the above responsibilities, you are expected to have the following mandatory skills: - 4+ years of experience in designing, building, and delivering enterprise-wide data solutions - Extensive experience in data ingestion, integration, and pipeline solutions - Strong Data Architecture expertise with knowledge of data governance - Ability to drive platform efficiency through automation and AI capabilities - Proficiency in various tools and languages including Pytho