Senior Databricks
Job description
We are seeking a skilled Databricks Developer to design and build scalable data pipelines and analytics solutions on the cloud. The ideal candidate will have strong expertise in Apache Spark, Databricks, SQL, and Python, along with experience handling large-scale healthcare datasets. This role involves developing robust data processing frameworks and enabling data-driven insights for healthcare systems while ensuring data quality, security, and compliance.
Key responsibilities
Design, develop, and maintain data pipelines using Databricks and Apache Spark Build and optimize ETL/ELT processes for large-scale structured and unstructured data Work with Delta Lake for data storage, versioning, and optimization Write efficient code using PySpark, Spark SQL, and Python Collaborate with business analysts and stakeholders to understand data requirements Perform data cleansing, transformation, and validation Optimize performance of data pipelines and queries Integrate data from multiple sources such as APIs, databases, and healthcare systems Ensure compliance with healthcare data standards (HIPAA, PHI handling) Maintain documentation and support production deployments
Requirements
Strong hands-on experience with Databricks and Apache Spark Expertise in Python (PySpark) and SQL Experience with Delta Lake architecture Solid understanding of ETL/ELT processes and data engineering concepts Experience working with cloud platforms (AWS / Azure / GCP) Knowledge of data modeling and data warehousing concepts Familiarity with version control tools like Git Strong problem-solving and debugging skills
Qualifications
Experience in the Healthcare domain (claims, EHR/EMR, clinical data) Familiarity with HL7, FHIR standards Experience with orchestration tools like Airflow or Azure Data Factory Exposure to Snowflake or other modern data platforms Knowledge of streaming frameworks (Kafka, Spark Streaming)
Job overview
Number of positions
Salary range
Posted date
About Unifyx LLC
Company size
Website
Contact information
About
UnifyX is a technology solutions company specializing in AI, healthcare technology, CRM platforms, cloud services, and custom software development. We help organizations streamline operations, automate workflows, and accelerate digital transformation through innovative, scalable, and business-focused solutions.