Data Engineer – Databricks & Azure
Location: Remote (U.S.)
Employment Type: Contract or Contract-to-Hire
Company: Alpine Solutions Group – on behalf of a purpose-driven AI & Data Engineering organization
About the Opportunity
Alpine Solutions Group is partnered with a leading technology consultancy that designs and builds AI and data solutions for global impact — from advancing healthcare and infrastructure to promoting environmental sustainability and inclusive innovation.
We’re seeking a Data Engineer with hands-on experience in Databricks and Azure to help build the foundational data infrastructure for a large-scale enterprise data and AI strategy. You’ll design, develop, and maintain high-performance data pipelines and a robust lakehouse architecture that powers analytics, reporting, and AI-driven workflows — all while ensuring data security, integrity, and scalability.
Key Responsibilities
- Collaborate with product managers, designers, and client stakeholders to understand business requirements and translate them into effective Azure- and Databricks-based solutions.
- Design, build, and maintain scalable, reliable data pipelines using Databricks to ingest data from diverse sources (APIs, CRMs, databases, flat files, etc.).
- Implement and manage medallion architecture (Bronze, Silver, Gold layers) to transform raw data into curated, business-ready datasets.
- Develop Gold-layer tables and views optimized for analytics and visualization in Power BI and Tableau.
- Configure and optimize Databricks to integrate seamlessly with BI tools and enable self-service analytics.
- Ensure compliance with strict data security, privacy, and governance protocols, handling sensitive client data responsibly.
- Leverage and/or learn advanced Databricks features including MLflow, Delta Lake, and Unity Catalog.
- Apply DevOps best practices (CI/CD, automation, monitoring) to data pipeline development.
- Design and optimize scalable data models that align with business needs and performance goals.
- Implement automated testing and data validation processes to maintain accuracy and reliability.
- Create comprehensive documentation for data pipelines, models, and architectural decisions.
- Establish proactive monitoring and alerting systems to maintain data availability and pipeline reliability.
- Communicate technical concepts effectively to both technical and non-technical stakeholders.
- Collaborate within a large, cross-functional consulting team to deliver client-facing data solutions.
Qualifications
- Proven experience as a Data Engineer, with a focus on Databricks and Azure.
- Strong proficiency in Python, SQL, and data modeling.
- Demonstrated experience building and maintaining medallion architecture pipelines.
- Skilled in ingesting and transforming data from multiple source types (APIs, databases, flat files, streaming sources).
- Familiarity with Azure Data Lake Storage (ADLS Gen2), Azure Data Factory, and Azure Key Vault.
- Experience optimizing for BI tools such as Power BI and Tableau.
- Understanding of DevOps principles, including version control (Git) and CI/CD automation.
- Experience with MLflow or an eagerness to learn emerging Databricks capabilities.
- Strong understanding of data governance, security, and privacy-preserving techniques.
- Excellent analytical and problem-solving skills.
- Strong communication skills and experience in client-facing, collaborative environments.
- Bonus: Exposure to data science concepts or advanced DevOps practices.
Why Work With Alpine
Alpine Solutions Group partners with forward-thinking companies across the U.S., connecting elite data and software professionals to high-impact opportunities. Our approach is transparent, personalized, and focused on long-term success for both clients and candidates.
If you’re a Databricks + Azure Data Engineer looking to build scalable systems that power real-world AI solutions — we’d love to connect.