Data Engineer
Job description
Results-driven Data Engineer with 4+ years of experience designing, developing, and optimizing ETL pipelines across on-premises and cloud environments. Strong expertise in the Microsoft Azure ecosystem, including Data Factory, Databricks, and Synapse Analytics, with advanced proficiency in SQL programming and data warehousing. Experienced in building scalable data solutions, implementing Delta Lake architectures, and performing performance tuning to enhance data processing efficiency.
Key responsibilities
Designed and developed end-to-end ADF pipelines for POS, CRM, and online order data ingestion. Built optimized Databricks PySpark workflows leveraging broadcast joins, caching, and partition pruning. Implemented Delta Lake Bronze → Silver → Gold architecture with MERGE logic for incremental loads. Developed Synapse fact and dimension models with partitioning and indexing for high-performance analytics. Automated monitoring, logging, and alerting using Azure Key Vault and Log Analytics. Ensured secure, reliable, and SLA-compliant production data workflows. Collaborated with business and reporting teams to deliver analytics-ready data solutions.
Requirements
4+ years in Information Technology with extensive experience using ETL tools like SSIS (SQL Server Integration Services). Proficient in SSMS and SQL commands, with experience writing complex SQL queries involving multiple tables using inner and outer joins. Strong SQL Programming skills, including query optimization and performance tuning. Experienced in creating SSIS packages for loading data from various sources like Flat files, Excel, and SQL server. Hands-on experience with SQL Server 2012/2014/2019 and a solid understanding of data warehousing concepts. Skilled in Microsoft Azure Data Factory, Azure Databricks, Data Lake, and Snowflake, having developed POCs to demonstrate efficient data solutions. Familiar with SDLC models like Waterfall, Agile Methodology, and Scrum approach. Proficient in Python, capable of developing and deploying automated solutions.
Qualifications
Bachelor of Technology (Information Technology) from GITAM University, Visakhapatnam.
Job overview
Number of positions
Salary range
Posted date