SDE 2 (Data Platform)

Role Overview: At slice, as a software developer in the data platform team, you will play a pivotal role in building and scaling systems that powers data infrastructure, real-time streaming, ML enablement, and data accessibility across the company. You will be involved in Trino query governance and abuse prevention, AI-based anomaly detection using Apache Flink, designing and maintaining self-healing, SLA-driven pipelines, building an LLMOps platform using Ray and MLflow, creating zero-SQL tooling for pipeline automation, optimizing performance and cost across Spark jobs and EKS clusters, and building a central governance layer and organizational data maps. Key Responsibilities: - Trino query governance and abuse prevention - AI-based anomaly detection using Apache Flink - Designing and maintaining self-healing, SLA-driven pipelines - Building an LLMOps platform using Ray and MLflow - Creating zero-SQL tooling for pipeline automation - Optimizing performance and cost across Spark jobs and EKS clusters - Building a central governance layer and organizational data maps Qualifications Required: - Strong programming experience in Python (PySpark) and/or Golang - Hands-on experience with Kubernetes (EKS) and REST API development using Django or FastAPI - Proficiency in distributed systems and data processing frameworks like Spark and Flink - Experience with Trino, Redpanda, Ray, and MLflow - Working knowledge of Delta Lake on S3 and AWS big data services like EMR and Glue - Familiarity with Superset, Apache Ranger, and low-latency data stores - Strong problem-solving skills and a deep understanding of scalable cloud-native infrastructure Additional Company Details: slice offers a competitive salary, extensive medical insurance for employees and their dependants, flexible working hours, tailored vacation and leave policies, a reward system for hard work, learning and upskilling opportunities, good food, games, and a cool office environment that fosters a sense of camaraderie among colleagues. Role Overview: At slice, as a software developer in the data platform team, you will play a pivotal role in building and scaling systems that powers data infrastructure, real-time streaming, ML enablement, and data accessibility across the company. You will be involved in Trino query governance and abuse prevention, AI-based anomaly detection using Apache Flink, designing and maintaining self-healing, SLA-driven pipelines, building an LLMOps platform using Ray and MLflow, creating zero-SQL tooling for pipeline automation, optimizing performance and cost across Spark jobs and EKS clusters, and building a central governance layer and organizational data maps. Key Responsibilities: - Trino query governance and abuse prevention - AI-based anomaly detection using Apache Flink - Designing and maintaining self-healing, SLA-driven pipelines - Building an LLMOps platform using Ray and MLflow - Creating zero-SQL tooling for pipeline automation - Optimizing performance and cost across Spark jobs and EKS clusters - Building a central governance layer and organizational data maps Qualifications Required: - Strong programming experience in Python (PySpark) and/or Golang - Hands-on experience with Kubernetes (EKS) and REST API development using Django or FastAPI - Proficiency in distributed systems and data processing frameworks like Spark and Flink - Experience with Trino, Redpanda, Ray, and MLflow - Working knowledge of Delta Lake on S3 and AWS big data services like EMR and Glue - Familiarity with Superset, Apache Ranger, and low-latency data stores - Strong problem-solving skills and a deep understanding of scalable cloud-native infrastructure Additional Company Details: slice offers a competitive salary, extensive medical insurance for employees and their dependants, flexible working hours, tailored vacation and leave policies, a reward system for hard work, learning and upskilling opportunities, good food, games, and a cool office environment that fosters a sense of camaraderie among colleagues.