Description:
We are seeking a talented and motivated DevOps Platform Engineer to join our team.
As a Platform Engineer, you will play a crucial role in designing, implementing, and maintaining our data platform using Databricks on the Microsoft Azure cloud.
You’ll collaborate with cross-functional teams to ensure the scalability, reliability, and performance of our analytics and data solutions.
Architecture and Design:
Provide input into the strategic technology direction for our data platform.
Architect scalable and efficient data solutions using Azure Databricks.
Data Pipelines and Integration:
Design, implement, and manage data pipelines.
Ensure seamless data integration across various systems.
Optimize data processing workflows.
Infrastructure Automation:
Develop Terraform Infrastructure as Code (IaC) to automate Databricks environment deployments.
Create a library of scripts for automating MLOps environments.
Performance Monitoring and Tuning:
Monitor and analyze database performance.
Fine-tune and optimize the data platform.
Collaboration and Communication:
Work closely with interdisciplinary teams, including engineers, data scientists, and business stakeholders.
Communicate effectively to ensure alignment with business goals.
Skills:
Strong expertise in Databricks and Microsoft Azure.
Experience with Infrastructure as Code (IaC) and automation tools, preferably Terraform.
Knowledge of data catalog tools (e.g., Microsoft Purview).
Excellent problem-solving skills and ability to work in a collaborative environment.
Education:
Bachelor’s degree in Computer Science, Engineering, or related field.
Proven experience as a Platform Engineer or similar role.
Skills:
Required
Terraform
Microsoft azure
Dev ops
Problem-solving
Data pipelines
Additional
Data Integration
Languages:
English( Speak, Read, Write )
As an equal opportunity employer, ICONMA provides an employment environment that supports and encourages the abilities of all persons without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.