Data Engineer (Databricks, Pyspark, ETL)
Job description
We are seeking a highly experienced Senior Data Engineer to join our dynamic team. In this role, you will leverage your expertise in Databricks, Pyspark, and ETL processes to design and implement robust data pipelines that meet the needs of our stakeholders. You will play a critical role in leading projects, driving architectural decisions, and ensuring the delivery of high-quality data solutions that empower our analytics and data science teams. As a Senior Data Engineer, you will also mentor junior team members, conduct thorough code reviews, and communicate effectively with stakeholders to understand their data requirements. Your strategic thinking and leadership experience will be essential as you help shape the future of our data infrastructure and drive innovation within our organization.
Key responsibilities
Lead the design and implementation of data pipelines using Databricks and Pyspark. Mentor and guide junior engineers in best practices and technical skills. Make architectural decisions to enhance data processing frameworks. Conduct code reviews to ensure high-quality code and adherence to standards. Collaborate with stakeholders to gather data requirements and deliver insights. Optimize ETL processes for performance and scalability. Evaluate and integrate new data technologies as they emerge.
Requirements
5-8 years of experience in data engineering or related field. Deep expertise in Databricks and Pyspark for data processing. Proven experience in ETL design and implementation. Strong understanding of data warehousing concepts and methodologies. Experience leading projects and mentoring team members. Proficiency in SQL and data modeling techniques. Familiarity with cloud platforms such as AWS or Azure.
Qualifications
Expert-level skills in data engineering and data architecture. Proven leadership experience in technical teams. Strong strategic thinking and problem-solving abilities. Experience with big data technologies like Hadoop or Spark. Knowledge of data governance and compliance best practices. Experience in Agile methodologies and project management. Advanced degree in Computer Science, Engineering, or related field is a plus.
Job overview
Number of positions
Salary range
Posted date
About RSNG Info Solutions
Founded
Company size
Industry
Website
Contact information
About
At RSNGINFO, we prioritize customer needs and dedicate ourselves to quality creations that aim to meet every aspect of our client’s requirements. We collaborate and contribute our expertise to adapt the best ways to improve our product services that are accessible, light, and easy to implement.
Skills
Primary skills
Secondary skills
Nice to have
Benefits
- Competitive salary
- Health insurance
- Professional development opportunities