Lead Data Engineer

Role Overview: As an Engineering Lead at Arcesium, you will be a crucial member of the Technology team, collaborating with Product Managers, Subject Matter Experts, Data Scientists, and Software Engineers to develop and optimize scalable data pipelines for the Data Platform. Your role involves architecting efficient data solutions, leading a team of technologists, and ensuring the smooth functioning of data workflows. Key Responsibilities: - Collaborate with various teams to understand business requirements and translate them into effective engineering solutions. - Design, build, and maintain data solutions and pipelines to align with business needs. - Lead and mentor a team of technologists, establishing engineering best practices. - Manage and resolve production defects and stability issues effectively. - Oversee end-to-end data workflows, from ingestion and transformation to storage in batch and streaming environments. - Enhance the performance, reliability, and scalability of data pipelines. Qualifications Required: - Bachelors degree in computer science, Math, or related technical fields with 6-8 years of experience; Fintech domain knowledge is advantageous. - Proven track record in delivering enterprise-grade software solutions. - Proficiency in Data Engineering, Data Lakes, Data Warehousing, and Data Analytics tools. - Hands-on experience with Big Data technologies like Spark, Hadoop, Elasticsearch, and Kafka. - Strong expertise in enterprise application development and working with SQL and NoSQL databases. - Familiarity with cloud technologies is a plus. - Advanced proficiency in Python for building scalable data pipelines and automating workflows. - Experience in building ETL/ELT data pipelines and data lakes/warehouses. - Knowledge of workflow orchestration tools such as Airflow, ADF, and Glue Workflow. - Understanding of CI/CD, version control, and DevOps practices. - Ability to work in agile, collaborative environments with attention to detail and quality. - Strong problem-solving, communication, and leadership skills. - Experience in leading highly skilled engineering teams and influencing stakeholders effectively. Additional Company Details: Arcesium and its affiliates are committed to diversity and do not discriminate based on race, color, religion, gender, age, disability, or any other protected category. These principles are integral to the corporate culture, fostering an inclusive environment that values input from all qualified individuals. Role Overview: As an Engineering Lead at Arcesium, you will be a crucial member of the Technology team, collaborating with Product Managers, Subject Matter Experts, Data Scientists, and Software Engineers to develop and optimize scalable data pipelines for the Data Platform. Your role involves architecting efficient data solutions, leading a team of technologists, and ensuring the smooth functioning of data workflows. Key Responsibilities: - Collaborate with various teams to understand business requirements and translate them into effective engineering solutions. - Design, build, and maintain data solutions and pipelines to align with business needs. - Lead and mentor a team of technologists, establishing engineering best practices. - Manage and resolve production defects and stability issues effectively. - Oversee end-to-end data workflows, from ingestion and transformation to storage in batch and streaming environments. - Enhance the performance, reliability, and scalability of data pipelines. Qualifications Required: - Bachelors degree in computer science, Math, or related technical fields with 6-8 years of experience; Fintech domain knowledge is advantageous. - Proven track record in delivering enterprise-grade software solutions. - Proficiency in Data Engineering, Data Lakes, Data Warehousing, and Data Analytics tools. - Hands-on experience with Big Data technologies like Spark, Hadoop, Elasticsearch, and Kafka. - Strong expertise in enterprise application development and working with SQL and NoSQL databases. - Familiarity with cloud technologies is a plus. - Advanced proficiency in Python for building scalable data pipelines and automating workflows. - Experience in building ETL/ELT data pipelines and data lakes/warehouses. - Knowledge of workflow orchestration tools such as Airflow, ADF, and Glue Workflow. - Understanding of CI/CD, version control, and DevOps practices. - Ability to work in agile, collaborative environments with attention to detail and quality. - Strong problem-solving, communication, and leadership skills. - Experience in leading highly skilled engineering teams and influencing stakeholders effectively. Additional Company Details: Arcesium and its affiliates are committed to diversity and do not discriminate based on race, color, religion, gender, age, disability, or any other protected category. These principles are integral to the corporate culture, fostering an inclusive environment that values input from all qualifi