Databricks Platform Architect

To Apply for this Job Click Here

Title: Azure Databricks Platform Architect / Administrator (Remote – Full Time)
Location: Remote
Job Type: FTE

Overview:
We are seeking an experienced Azure Databricks Platform Architect / Administrator to design, implement, and manage an enterprise-grade Databricks environment. The ideal candidate will have deep technical expertise in Azure Databricks, data engineering, and data architecture, with a strong focus on scalability, performance, and security. This role will collaborate closely with data engineering and data science teams to support seamless integration of data pipelines and Lakehouse architecture.

Key Responsibilities

• Design, implement, and manage the Azure Databricks platform, ensuring high availability, scalability, and security.
• Configure and optimize Databricks clusters, jobs, and notebooks for performance and cost efficiency.
• Maintain accurate and up-to-date architecture documentation and environment inventories.
• Collaborate with Azure and Databricks support teams to troubleshoot and resolve platform issues.
• Continuously optimize cost and performance across the Databricks environment.
• Partner with data engineering teams to design, implement, and migrate data pipelines using industry best practices.
• Automate administrative tasks to improve platform efficiency and consistency.
• Develop and maintain Lakehouse architecture, ensuring data quality, integrity, and governance.
• Work with Azure IAM and engineering teams to implement role-based access control (RBAC) for Databricks assets.
• Design and maintain sandbox environments for data science teams while ensuring compliance and data security.
• Ensure the platform adheres to organizational security policies and regulatory standards (e.g., HIPAA, NIST, GDPR).
• Implement and maintain data encryption, access controls, and auditing mechanisms.
• Develop and maintain technical documentation for Databricks platform, data pipelines, and Lakehouse architecture.
• Promote knowledge sharing and best practices across data engineering and analytics teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience in IT infrastructure, system administration, or network engineering with a data-centric focus.
• Strong expertise in Azure Databricks and cloud platforms (Azure, AWS, or GCP).
• Experience with infrastructure automation tools such as Terraform, Ansible, or Kubernetes.
• Proficiency in Linux and Windows server environments.
• Solid understanding of cybersecurity, data privacy, and disaster recovery principles.
• Hands-on experience with monitoring and log management tools (e.g., Splunk, Datadog, Prometheus).
• Familiarity with containerization and microservices.
• Preferred certifications: Microsoft Azure Solutions Architect, AWS Solutions Architect, Cisco CCNP, or ITIL.
• Proven ability to lead technical initiatives and collaborate across multidisciplinary teams.

To Apply for this Job Click Here

Equal Employment Opportunity Statement
Gravity IT Resources is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, veteran status, or any other legally protected characteristic. All employment decisions are based on qualifications, merit, and business needs.