Job Title:
Databricks Admin

Company: Tech Mahindra

Location: santa clara, CA

Created: 2024-04-20

Job Type: Full Time

Job Description:

Greetings!Databricks AdminSanta Clara, CAThe candidate will work on building, scaling, and monitoring highly complex BigData platform on Databricks, Snowflake DB and ElasticSearch cloud.The candidate will work on building, scaling, and monitoring Data science and ML hosting platform based on Databricks.The candidate will be responsible for defining and implementing our Data platform, Data science workbench with ML hosting technology strategies in the Cloud.The candidate will also involve to design our architecture and define our roadmap.The candidate will be responsible to implement monitoring, alerting and observability solutions using CSP standard monitoring and analytical tools and also 3rd party tools like Zabbix and Datadog SaaS.The candidate has to be an expert in Docker and Cloud based containerization technologies.The candidate will also be responsible for building and improving our CICD pipelines and keeping themselves and their team up-to-date with the latest industry trends and technologies.Develop automation scripts in Terraform, YAML, Helm charts, az cli, aws-cli, Powershell and other cloud APIs.Participate in developer interaction calls and help.Participate in Management update calls and provide precise, timely updates.Skillset:Operations or systems administration experience, particularly on Linux.Hands-on administration experience, from setting up the Databricks environment to successfully administering it.Experience as the Databricks account owner, managing workspaces, Unity Catalog, audit logs, and high-level usage monitoringExperience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.Experience Databricks administration configuring and installing librariesExperience managing storage accounts access across a large user baseExperience managing cluster and jobs, policies, templates, pools configuration optionsExperience with Databricks security and privacy setupExperience troubleshooting end user and platform-level issuesExperience optimizing usage for performance and cost preferredExperience in strategizing and implementing Disaster recovery for BigData platforms based on Databricks.Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholdersStrong coding skills in SQL and Python (PySpark) with experience optimizing codeAssist in NW, Data security, IAM initiatives. Work with nw team to create PEs, troubleshoot network issues etc.ThanksSuman"Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at ."