Lead Data Engineer – GCP
Experience: 10–15 Years
Job Summary
We are looking for a highly experienced Senior / Lead Data Engineer with deep expertise in Google Cloud Platform (GCP) to lead the design, development, and optimization of large-scale, cloud-native data platforms. The role requires strong hands-on capabilities along with technical leadership, architectural decision-making, and mentoring responsibilities.
Key Responsibilities
• Lead end-to-end design and implementation of scalable data architectures on GCP.
• Architect, develop, and optimize data pipelines using Dataflow, Dataproc, and BigQuery.
• Design and manage high-performance data storage solutions using Bigtable and Cloud Datastore.
• Own and optimize complex SQL queries and Python-based data processing frameworks.
• Establish best practices for data modeling, ETL/ELT frameworks, and pipeline orchestration.
• Drive DevOps and CI/CD strategies for data platforms using GCP-native tools.
• Ensure platform reliability, data quality, security, and cost optimization.
• Act as a technical advisor to stakeholders, translating business requirements into scalable data solutions.
• Mentor and guide junior and mid-level data engineers.
• Conduct design reviews, performance tuning, and production issue resolution.
Required Skills & Qualifications
• 10–15 years of overall experience in data engineering and analytics platforms.
• Strong hands-on expertise in SQL and Python.
• Extensive experience with Google Cloud Platform, including:
• BigQuery
• Bigtable
• Cloud Datastore
• Dataflow (Apache Beam)
• Dataproc (Spark/Hadoop)
• Proven experience in GCP DevOps, including CI/CD pipelines, monitoring, logging, and automation.
• Strong understanding of distributed systems, data warehousing, and large-scale data processing.
• Experience designing and operating high-volume, high-availability data platforms.
• Hands-on experience with version control systems (Git).
Good to Have
• Experience with real-time/streaming architectures.
• Exposure to GKE, Docker, and Kubernetes.
• Knowledge of data governance, metadata management, and security best practices.
• GCP certifications (Professional Data Engineer / Cloud Architect).
• Experience working in regulated or large enterprise environments (BFSI a plus).
What We Offer
• Opportunity to lead and shape enterprise-scale data platforms.
• High-impact role with architectural ownership.
• Competitive compensation and leadership growth opportunities.
• Work with cutting-edge GCP technologies at scale.
Apply Now
Apply Now