DataBricks Developer (Digital Engineering)

Company Background
Our client is a leading life insurance company and part of a global financial services group. Founded in 1896 and headquartered in North America, the company offers a wide range of products, including annuities and life insurance, through a nationwide network of agents.
Project Description
The project involves a production system for managing clients and the life insurance programs in which they are enrolled. The specialist will be responsible for supporting the existing system and developing new features.
Technologies

- Databricks, Unity Catalog, Delta Lake, Databricks Genie

- Advanced SQL

- Python

- Microsoft Azure
What You'll Do

- Collaborate with a team of three engineers to develop and support data solutions in Databricks;

- Develop and maintain data processing workflows using Databricks, SQL, Python, and Delta Lake;

- Work with Unity Catalog to manage data access permissions, data lineage, and governance;

- Support the existing production system and participate in the implementation of new features and enhancements;

- Investigate and troubleshoot issues in Databricks data workflows and production processes;

- Collaborate with team members and stakeholders to deliver reliable data engineering solutions;
Job Requirements

- 3+ years of professional experience in data engineering;

- Strong communication and collaboration skills, with the ability to work effectively with technical and non-technical stakeholders;

- Hands-on experience designing and developing data solutions in Databricks, including Databricks architecture, Unity Catalog, Delta tables, data lineage, access permissions, Databricks Genie, and notebooks;

- Advanced SQL skills, including writing complex queries and performing data transformations;

- Proficiency in Python for data processing, automation, and development of data engineering solutions;

- Professional experience working with Microsoft Azure cloud services and data platforms;
Nice To Have

- Experience using Databricks AI capabilities, including Agent Bricks, and implementing Generative AI and RAG solutions in Databricks;

- Experience working with Azure data services, including Azure Synapse, Synapse pipelines, Azure Data Factory, and Azure SQL pools;

- Experience setting up CI/CD processes for Databricks solutions using Azure DevOps, Databricks Asset Bundles, and Infrastructure as Code practices;

- Experience with performance tuning for Databricks workloads, SQL queries, and data processing pipelines;

- Databricks Certified Data Engineer Professional certification;

- Databricks Certified Generative AI Engineer Associate certification;
What Do We Offer
The global benefits package includes:

- Technical and non-technical training for professional and personal growth;

- Internal conferences and meetups to learn from industry experts;

- Support and mentorship from an experienced employee to help you professional grow and development;

- Health insurance;

- Sports activities to promote a healthy lifestyle;

- Flexible work options, including remote and hybrid opportunities;

- Referral program for bringing in new talent;

- Work anniversary program and additional vacation days.