Databricks Platform Engineer / Administrator

Databricks Platform Engineer / Administrator

JD Code: TRX-26035
Experience: 5+ years overall, including 3+ years in Databricks Administration
Location: PAN India – Hybrid
Preferred Locations: Chennai, Bangalore, Hyderabad, Noida, Mumbai, Kolkata, Nagpur, Warangal, Bhubaneswar
Position Type: Full-Time Employment (FTE)
Budget: ₹22–23 LPA
Number of Resumes Required: 2
Function: Data Platform Engineering & Cloud Operations
Category: IT

Role Overview

We are looking for an experienced Databricks Platform Engineer / Administrator to manage, secure, automate, and optimize enterprise Databricks environments hosted on AWS. The ideal candidate will have hands-on experience in Databricks platform administration, Unity Catalog, cloud infrastructure, governance, automation, cost optimization, and production support.

Key Responsibilities

• Administer Databricks workspaces, clusters, compute policies, jobs, and user access controls.

• Manage Unity Catalog, data governance, workspace security, permissions, and access policies.

• Support AWS-based platform operations, monitoring, incident management, troubleshooting, and root cause analysis.

• Automate infrastructure provisioning and operational tasks using Terraform, Databricks REST APIs, CLI, Python, and shell scripting.

• Monitor and optimize platform performance, compute utilization, resource allocation, and cloud costs.

• Support platform deployments, CI/CD pipelines, capacity planning, and environment management.

• Maintain operational documentation, platform standards, security controls, and governance procedures.

• Ensure platform reliability, availability, scalability, and compliance with organizational security requirements.

Mandatory Skills

• 5+ years of overall IT experience, including at least 3 years of hands-on Databricks Administration.

• Strong experience in Databricks account and workspace administration and platform operations.

• Hands-on knowledge of Unity Catalog, cluster management, compute policies, permissions, and access governance.

• Experience with AWS services, including IAM, S3, VPC, KMS, CloudWatch, networking, and security controls.

• Experience with Terraform and Infrastructure as Code (IaC).

• Proficiency in Databricks REST APIs, CLI, Python automation, and shell scripting.

• Experience in production support, monitoring, incident management, troubleshooting, and root cause analysis.

• Knowledge of platform governance, cloud security, performance tuning, and cost optimization.

• Working knowledge of SQL, ETL pipelines, and workflow scheduling.

Good to Have

• Databricks Administrator or Data Engineer certification.

• AWS Associate-level certification or higher.

• Experience with CI/CD tools such as GitHub Actions, Jenkins, or Azure DevOps.

• Knowledge of Apache Spark, Kafka/streaming, Lakehouse architecture, and observability tools.

Education

A bachelor's degree in Computer Science, Information Technology, Engineering, or a related field is preferred.

Quick Screening Skills

Databricks Administration | Workspace Management | Unity Catalog | AWS | IAM | S3 | VPC | KMS | Terraform | Infrastructure as Code | REST APIs | Databricks CLI | Python | Shell Scripting | Production Support | Monitoring | Cost Optimization | Cloud Security