Senior Data Engineer
Job description
We are looking for a hands-on Data Engineer who can design, build, and maintain scalable data pipelines and data platforms end-to-end. The ideal candidate should be strong in SQL and Python, experienced with ETL/ELT processes, and comfortable working on any major cloud platform (AWS, Azure, GCP, or Snowflake). This role requires someone who can independently handle data ingestion, transformation, validation, and delivery across the full data lifecycle with minimal supervision.
Key responsibilities
Design, develop, and maintain robust and scalable data pipelines for batch and real-time processing. Build and optimize ETL/ELT workflows to ingest data from multiple structured and unstructured sources. Write efficient and complex SQL queries for data transformation, validation, and performance optimization. Develop reusable data processing components using Python and distributed processing frameworks (e.g., Databricks/Spark). Work with cloud data platforms such as AWS, Azure, GCP, or Snowflake for storage, compute, and orchestration. Ensure data quality, integrity, and reliability through validation, monitoring, and error handling. Design and implement data models to support analytics, reporting, and downstream applications. Collaborate with analysts, BI teams, and stakeholders to understand data requirements and deliver solutions. Troubleshoot data issues, optimize performance, and improve pipeline stability. Maintain documentation and follow best practices for version control, deployment, and monitoring.
Requirements
Strong hands-on expertise in SQL (joins, aggregations, window functions, optimization). Proficiency in Python for data processing and automation. Experience with Databricks / Apache Spark or distributed data processing frameworks. Solid understanding of ETL/ELT concepts, data pipelines, and data warehousing principles. Experience working on any cloud platform (AWS, Azure, GCP, or Snowflake). Knowledge of data ingestion patterns (batch, incremental, CDC, streaming). Experience with data validation, error handling, and monitoring.
Qualifications
Typically 3–10+ years of experience in Data Engineering or similar roles.
Job overview
Place of work
Number of positions
Salary range
Posted date
About Gr8Rank
Company size
Industry
Website
About
Gr8rank specializes in building intelligent, cloud-native data solutions that empower businesses to make faster, smarter decisions. With strong expertise in Google Cloud Platform (GCP), Data Engineering, and AI-driven analytics, we help organizations modernize their data infrastructure and unlock the full potential of their information. Our mission is to deliver simple, impactful, and scalable solutions aligned with client goals.
Skills
Primary skills
Secondary skills
Nice to have
Benefits
- PF
- Health Insurance
- Paid Leaves