GCP Developer - Streaming & Data Analytics

As the Technical Lead for streaming and analytics use cases at our company, you will be responsible for the following key responsibilities: - **Technical Leadership & Architecture:** - Own end-to-end technical design for streaming and analytics use cases using Google Cloud Platform (GCP). - Define reference architectures for real-time data ingestion, processing, and analytics. - Lead design reviews, architecture governance, and technical decision-making with client stakeholders. - Ensure alignment with telecom enterprise standards, security, and compliance requirements. - **Streaming Data Engineering (Primary Focus):** - Design and lead implementation of real-time streaming pipelines using: - Pub/Sub for event ingestion - Dataflow (Apache Beam) for stream processing - BigQuery for near-real-time analytics - Handle high-volume, low-latency telecom data streams such as network events, usage/CDR-like data, customer interaction events, and operational telemetry. - Ensure exactly-once/at-least-once processing, fault tolerance, and replay mechanisms. - **BigQuery & Analytics Platform:** - Architect streaming-to-BigQuery patterns (microbatch/streaming inserts). - Design analytics-optimized data models for telecom KPIs and reporting. - Drive performance tuning and cost optimization through partitioning & clustering strategies, query optimization, slot usage, and cost governance. - Enable downstream consumption via BI and reporting platforms. - **Telecom Domain Enablement:** - Translate telecom business needs into streaming analytics use cases including customer behavior & experience analytics, network performance monitoring, revenue assurance & usage analytics, and near-real-time operational dashboards. - Work with client SMEs to ensure domain correctness and data interpretation. - **Delivery & Client Engagement:** - Act as a technical Single Point of Contact (SPOC) for the client under the Statement of Work (SoW). - Support scope definition, estimation, and solution sizing for streaming analytics workstreams. - Provide status updates, risk identification, and mitigation plans to client leadership. - Collaborate with program managers to ensure milestone-based delivery. - **Engineering Excellence & Governance:** - Establish coding standards, design patterns, and best practices. - Lead code reviews and mentor senior and junior engineers. - Implement CI/CD pipelines for streaming and analytics workloads. - Define monitoring, alerting, and operational runbooks. **Must-Have Technical Skills:** - **GCP & Streaming Stack:** - Google Cloud Platform (GCP) expert level - Pub/Sub, Dataflow (Apache Beam) strong hands-on leadership experience - BigQuery advanced SQL, performance tuning, and cost optimization - Cloud Storage, Cloud Functions / Cloud Run - **Programming & Frameworks:** - Python (preferred) or Java for streaming and pipeline development - Strong understanding of event-driven architectures - **Data Engineering:** - Streaming ETL/ELT design patterns - Schema evolution, late-arriving data, deduplication - Data quality, reconciliation, and observability - **DevOps & Security:** - CI/CD for data pipelines - IAM, service accounts, data access controls - Infrastructure-as-Code exposure (Terraform preferred) - **Telecom Domain Skills (Mandatory):** - Experience working with telecom data platforms - Understanding of high-volume event data, usage/transaction-based analytics, near-real-time operational metrics - Ability to converse confidently with telecom business and IT stakeholders **Good-to-Have Skills:** - Experience with Looker / Tableau / Power BI - Knowledge of Kafka (migration or coexistence scenarios) - GCP Professional certifications (Data Engineer / Architect) - Exposure to cloud cost management frameworks As the Technical Lead for streaming and analytics use cases at our company, you will be responsible for the following key responsibilities: - **Technical Leadership & Architecture:** - Own end-to-end technical design for streaming and analytics use cases using Google Cloud Platform (GCP). - Define reference architectures for real-time data ingestion, processing, and analytics. - Lead design reviews, architecture governance, and technical decision-making with client stakeholders. - Ensure alignment with telecom enterprise standards, security, and compliance requirements. - **Streaming Data Engineering (Primary Focus):** - Design and lead implementation of real-time streaming pipelines using: - Pub/Sub for event ingestion - Dataflow (Apache Beam) for stream processing - BigQuery for near-real-time analytics - Handle high-volume, low-latency telecom data streams such as network events, usage/CDR-like data, customer interaction events, and operational telemetry. - Ensure exactly-once/at-least-once processing, fault tolerance, and replay mechanisms. - **BigQuery & Analytics Platform:**