Role overview
We are seeking an experienced Senior Databricks Architect to lead the design and delivery of comprehensive solutions on the Databricks platform. The ideal candidate will possess deep expertise in modern data architecture, hands-on experience with the latest Databricks services, and a proven track record in presales support, solution consulting, and large-scale implementations. This role requires strong collaboration with clients and internal teams to deliver scalable, secure, and optimized data solutions across one or more major cloud ecosystems (AWS, Azure, or GCP).
Key responsibilities
- Define and implement enterprise-grade architectures leveraging Databricks Lakehouse, Delta Lake, and advanced features like Unity Catalog, Delta Live Tables, and MLflow.
- Develop reference architectures and best practices for data engineering, analytics, and AI/ML workloads.
- Lead the full lifecycle delivery of Databricks projects, including assessment, design, migration, performance optimization, and governance.
- Integrate Databricks with cloud-native services (AWS, Azure, or GCP) for networking, security, and compliance.
- Partner with sales teams to provide technical expertise during RFP responses, client workshops, and proof-of-concept (POC) engagements.
- Build solution proposals, effort estimates, and architecture diagrams for pursuits.
- Guide teams on implementing Medallion architecture (Bronze, Silver, Gold layers) and advanced ETL/ELT patterns.
- Mentor engineers on Databricks best practices, performance tuning, and cost optimization.
- Stay current with the latest Databricks capabilities and cloud ecosystem advancements.
- Contribute to internal accelerators, reusable frameworks, and Go-To-Market strategies.
Required skills & qualifications
- Advanced knowledge of Databricks services, including Delta Lake, Unity Catalog, Delta Live Tables, MLflow, and Databricks SQL.
- Strong experience in PySpark, Spark SQL, and performance optimization techniques.
- Extensive hands-on experience with AWS, Azure, or GCP, including integration with Databricks.
- Familiarity with cloud-native security, IAM, networking, and cost management
- Proven track record in supporting presales activities, building proposals, and delivering client presentations.
- Expertise in data governance frameworks, security practices, and compliance standards.
Preferred skills/experience
- Experience with AI/ML workloads on Databricks.
- Certifications in Databricks and one major cloud platform (AWS/Azure)