Senior/Lead Data Engineer
CareerXperts Consulting
Job Description
As a skilled and experienced software development consultant specializing in Agile Delivery, you will be working alongside the client to enable them and add real value to their products. In this role, you will have the opportunity to work with a diverse team of like-minded individuals, continuously learning new technologies on the go and implementing best practices.
**Key Responsibilities:**
- Collaborate with the client and the team to identify data processing and access requirements and determine the best way to fulfill them.
- Develop and maintain highly available data pipelines and storage solutions, such as data warehouses.
- Utilize agile practices, including pair programming, TDD, CI/CD, to deliver software solutions efficiently.
- Automate data infrastructure and deployments to enhance efficiency.
- Advocate for agile practices within the client organization and mentor team members.
- Enhance the team and clients' data capabilities through continuous improvement.
**Qualifications Required:**
- Extensive experience in working on data pipelines, platforms, and projects.
- Proficiency in developing solutions on major Cloud providers like AWS, GCP, Azure.
- Strong programming skills in at least one language, with a preference for Python.
- Familiarity with various databases, data warehouses, and distributed file systems in production environments.
- Solid understanding of SQL, data modeling, and data processing at scale.
- Knowledge of GDPR and data security regulations.
- Experience with source control and infrastructure as code tools like Git/Github, Terraform, Ansible, and CI/CD practices.
- Ability to support data scientists or business intelligence teams in data preparation and mentoring.
- Excellent collaboration and communication skills to effectively work with globally distributed teams, including remote work environments.
For more details, please reach out to rajeshwari.vh@careerxperts.com. As a skilled and experienced software development consultant specializing in Agile Delivery, you will be working alongside the client to enable them and add real value to their products. In this role, you will have the opportunity to work with a diverse team of like-minded individuals, continuously learning new technologies on the go and implementing best practices.
**Key Responsibilities:**
- Collaborate with the client and the team to identify data processing and access requirements and determine the best way to fulfill them.
- Develop and maintain highly available data pipelines and storage solutions, such as data warehouses.
- Utilize agile practices, including pair programming, TDD, CI/CD, to deliver software solutions efficiently.
- Automate data infrastructure and deployments to enhance efficiency.
- Advocate for agile practices within the client organization and mentor team members.
- Enhance the team and clients' data capabilities through continuous improvement.
**Qualifications Required:**
- Extensive experience in working on data pipelines, platforms, and projects.
- Proficiency in developing solutions on major Cloud providers like AWS, GCP, Azure.
- Strong programming skills in at least one language, with a preference for Python.
- Familiarity with various databases, data warehouses, and distributed file systems in production environments.
- Solid understanding of SQL, data modeling, and data processing at scale.
- Knowledge of GDPR and data security regulations.
- Experience with source control and infrastructure as code tools like Git/Github, Terraform, Ansible, and CI/CD practices.
- Ability to support data scientists or business intelligence teams in data preparation and mentoring.
- Excellent collaboration and communication skills to effectively work with globally distributed teams, including remote work environments.
For more details, please reach out to rajeshwari.vh@careerxperts.com.
Skills Required
Posted on: March 19, 2026