Job Description: Azure Databricks Enterprise Architect

Job Type: Contract to Hire 

Job Summary

As an Azure Databricks Enterprise Architect, you will play a pivotal role in shaping the technological landscape of our organization. An Azure Databricks enterprise architect has a broader range of responsibilities than a solution architect. They're in charge of Databricks Account and Unity architectural domains to ensure that they align with company objectives. This may include assessing the resolutions of the solutions architect. They use IT techniques to influence a company's business decisions, resulting in a more efficient process. In addition, an enterprise architect takes charge of leadership and strategic planning of implementing Databricks.

You will be responsible for designing, implementing, and optimizing our Azure Databricks environment to ensure seamless integration, robust security, and efficient data governance across the enterprise. You will leverage your expertise in Azure Databricks deployment, Unity Catalog, Security applications, and platform management to create scalable solutions that address our business needs and enhance overall performance.

Job Responsibilities

· Develop and maintain the enterprise architecture for Azure Databricks across cloud implementation, Unity governance, Security and ML Operations to ensure alignment with business objectives and regulatory requirements.

· Design and configure Unity Catalog to manage data governance, access control, and data lineage.

· Implement and manage security protocols, including audit logging and access control, to safeguard sensitive data.

· Optimize the Databricks platform for performance, scalability, and cost-effectiveness.

· Collaborate with cross-functional teams to integrate Azure Databricks with other enterprise systems and applications.

· Provide technical leadership and guidance to development and data science teams.

· Monitor and analyze platform usage to identify areas for improvement and implement necessary changes.

· Stay current with emerging technologies and industry trends to ensure the organization remains competitive.

Skills and Qualifications

· Extensive experience with Azure Databricks, including Unity Catalog, and platform management.

· Strong understanding of data governance principles and best practices.

· Proficiency in implementing and managing security protocols, audit logging, and access control.

· Experience with cloud computing platforms, particularly Azure.

· Knowledge of networking concepts and security needs for Azure Databricks workspaces.

· Ability to design and optimize scalable data architectures.

· Strong problem-solving skills and ability to troubleshoot complex issues.

· Excellent communication and collaboration skills.

· Proven ability to lead technical teams and projects.

· Familiarity with industry trends and emerging technologies in data and AI.

· Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.

· Minimum of 5 years of experience in enterprise architecture and cloud computing.

· At least 3 years of hands-on experience with Azure Databricks.

· Previous experience in data governance, security management, and platform optimization.

· Experience leading technical teams and projects.

· Certifications in Azure or Databricks preferred.