Senior Cloud Engineer for Databricks Platform | Serbia

Role: For our client, a Swiss insurance company, we are searching for a highly skilled and motivated Senior Cloud Engineer for Databricks. In this role, you will play a crucial part in the design, implementation and maintenance of their data platform infrastructure, enabling data-driven decision-making and analytics across the organization. You will collaborate closely with cross-functional teams to ensure all cloud systems are robust, scalable, and optimized for performance.

Key Responsibilities:

• Engineer and implement projects, changes and improvements of the Azure Databricks platform with a focus on platform capabilities such as Monitoring, Scheduling, Load Balancing, Automation as well as Access and Security capabilities.

• Hands on experience with Azure DevOps and Azure Data Factory is a must, knowledge of Azure Synapse Analytics and Power BI are nice to have.

• Create and manage automation scripts using tools such as Python, PowerShell or Azure CLI to simplify deployment and management tasks.

• Implement best practices for performance and security.

• Write technical specifications, execute code reviews, and perform functional tests.

• Ensure the security, integrity, and high availability of cloud-based systems.

• Keep an eye on cloud infrastructure costs, pinpointing opportunities for optimization.

• Collaborate with cross-functional teams to enhance our cloud systems.

• Create guidelines and documentation to streamline processes and improve efficiency.

Qualifications:

• You have relevant and extensive experience as a Cloud Engineer for Databricks platforms on Azure. In addition, you bring relevant knowledge and experience in Azure Data Factory and Azure DevOps. Experience with Azure Synapse Analytics and Power BI are nice to have. In summary, you are an expert in establishing data platforms based on Azure Databricks and orchestrating data imports with a modern tool stack.

• You have hands-on experience optimizing Databricks clusters, implementing advanced Spark transformations, and building collaborative, high-performance environments for data engineers and scientists.

• You bring expertise in CI/CD pipelines with Azure DevOps, ensuring streamlined code deployment and system updates while maintaining robust security and compliance practices using Unity Catalog.

• With deep experience in Python, PowerShell and Azure CLI, you automate the deployment and management of cloud infrastructure, enabling rapid, error-free scalability with an infrastructure-as-code approach.

• You can show proficiency as a data engineer to manage multiple data formats and sources like CSV, JSON, JSON Lines, Parquet, Delta Lake, ZIP, Snappy, bzip2, Excel, Microsoft Access, Confluent Avro, IBM Db2 for z/OS and LUW, PostgreSQL, and REST APIs.

• Proficiency in English language, knowledge of German is a plus.