DataBricks Data Engineering Leader

Job Summary:

Consultant Advisor, ERP Michael Cooper is recruiting this position.

email me linkedin

Databricks Data Engineering Lead

Location: Remote (EST preferred)

Start Date: ASAP

Engagement Length: 3–6 months, with possible extension

Role Overview

We're seeking a Senior-level Data Engineer to lead Databricks-based data engineering initiatives within a pharmaceutical environment. This role combines deep hands-on technical work with the potential to guide a small team of developers. Candidates must bring extensive Databricks and data warehouse experience, along with prior work in the pharmaceutical industry.

Required Experience

• Senior-level data engineering background, with the ability to lead a team of developers if needed
• Extensive hands-on experience with Databricks and enterprise data warehouse platforms
• Pharmaceutical industry experience (required)

 Required Skills

Databricks Data Engineering

• PySpark
• Delta Tables
• Declarative Pipelines
• Databricks Asset Bundles (DAB)
• Unity Catalog and permission management
• Cluster policies and governance

Programming & Software Engineering

• Strong Python development skills
• Object-Oriented Programming (OOP)
• Dependency Injection concepts
• Clean Code principles
• Agile development methodologies
• Experience building and maintaining shared/private Python packages
• Solid understanding of CI/CD principles and automated delivery pipelines
• Ability to follow established engineering standards and repository conventions

Git & GitHub

• Repository management fundamentals
• Pull Request workflows
• Branching and environment strategy
• Understanding of deployment processes and release workflows
• Strong collaboration skills through code review

Mindset & Ways of Working

• We're looking for engineers who:
• Build solutions that solve real problems and maximize business value
• Proactively communicate with peers and project leaders to understand priorities and context
• Favor iterative delivery over chasing a "perfect" first implementation
• Take ownership of quality, understanding that work isn't complete until it's tested and verified
• Can independently scope the validation a task requires, while knowing when to ask for clarification
• Give and receive technical feedback constructively, treating it as a growth opportunity
• Collaborate effectively through PR reviews and engineering discussions
• Balance business value delivery with long-term technical maintainability
• Learn autonomously from existing repositories, applying established coding standards and architectural patterns consistently across the platform

Nice to Have

• SQL (basic proficiency)
• Terraform (basic proficiency)
• Bash / command line (intermediate proficiency)

To learn more about this and other positions, contact Michael Cooper at or michael.cooper@healthcareitleaders.com. Healthcare IT Leaders is a national leader in IT workforce solutions, connecting healthcare provider, payer and life sciences organizations with experienced technology talent for consulting and full-time hiring. For more information, visit us on the web at www.healthcareitleaders.com.