Data Engineer - Python Programming

As a Data Engineer at our company, you will be responsible for designing and implementing data solutions using technologies like PySpark, Spark SQL, and Power BI. Your role will involve building scalable data pipelines, working with Azure Databricks, and ensuring data governance and security in cloud environments. **Key Responsibilities:** - Utilize PySpark for building and optimizing data pipelines - Work with Azure Databricks, including Delta tables and Python scripting - Model data for Data Warehousing and Visualization projects - Write complex SQL queries and build views involving multiple tables - Collaborate with cross-functional teams, participate in mobbing sessions, and coordinate effectively - Demonstrate strong problem-solving skills and code review expertise - Communicate effectively to understand business requirements and translate them into technical solutions - Stay proactive and responsive during business hours for ad-hoc calls or meetings **Qualifications Required:** - 7+ years of hands-on experience in software development, with a focus on Python programming - Deep expertise in PySpark, Spark SQL, and DataFrames - Solid experience with Azure Databricks, including Unity Catalog and Delta tables - Understanding of data governance, security, and compliance in cloud environments - Familiarity with Azure cloud services, Azure Data Lake, and Azure Data Factory - Proficiency in Power BI, DAX, and Power Query - Experience with DevOps tools, version control, and CI/CD pipelines The ideal candidate will also possess the following nice-to-have skills: - Experience with Azure AI, Copilot Studio, and Azure Fabric - Familiarity with Power Automate, EventHub, and Kafka - Proficiency in designing and implementing real-time data streaming solutions - Strong grasp of Agile Scrum methodologies and the Software Development Lifecycle (SDLC) At our company, we value your collaboration mindset, problem-solving abilities, and communication skills. We encourage proactive behavior, effective prioritization, and adaptability to new technologies and feedback. As a Data Engineer at our company, you will be responsible for designing and implementing data solutions using technologies like PySpark, Spark SQL, and Power BI. Your role will involve building scalable data pipelines, working with Azure Databricks, and ensuring data governance and security in cloud environments. **Key Responsibilities:** - Utilize PySpark for building and optimizing data pipelines - Work with Azure Databricks, including Delta tables and Python scripting - Model data for Data Warehousing and Visualization projects - Write complex SQL queries and build views involving multiple tables - Collaborate with cross-functional teams, participate in mobbing sessions, and coordinate effectively - Demonstrate strong problem-solving skills and code review expertise - Communicate effectively to understand business requirements and translate them into technical solutions - Stay proactive and responsive during business hours for ad-hoc calls or meetings **Qualifications Required:** - 7+ years of hands-on experience in software development, with a focus on Python programming - Deep expertise in PySpark, Spark SQL, and DataFrames - Solid experience with Azure Databricks, including Unity Catalog and Delta tables - Understanding of data governance, security, and compliance in cloud environments - Familiarity with Azure cloud services, Azure Data Lake, and Azure Data Factory - Proficiency in Power BI, DAX, and Power Query - Experience with DevOps tools, version control, and CI/CD pipelines The ideal candidate will also possess the following nice-to-have skills: - Experience with Azure AI, Copilot Studio, and Azure Fabric - Familiarity with Power Automate, EventHub, and Kafka - Proficiency in designing and implementing real-time data streaming solutions - Strong grasp of Agile Scrum methodologies and the Software Development Lifecycle (SDLC) At our company, we value your collaboration mindset, problem-solving abilities, and communication skills. We encourage proactive behavior, effective prioritization, and adaptability to new technologies and feedback.