Resident solution architect

• Strong experience with Databricks
• Strong Apache Spark / PySpark
• Strong SQL
• Strong Data Engineering fundamentals
• Experience designing data pipelines / data platforms
• Experience with Lakehouse / Data Warehouse / Big Data architecture
• Experience with at least one cloud:
• AWS
• Azure
• GCP
• Strong customer-facing / consulting experience
• Architecture/design experience
• Excellent communication and presentation skills

• →Work directly with enterprise customers as a trusted technical advisor.
• →Understand customer business and technical requirements and translate them into scalable data architectures.
• →Design and implement modern Lakehouse / Data + AI architectures using Databricks.
• →Develop and guide POCs, technical workshops and architecture demonstrations.
• →Work extensively with Apache Spark / PySpark, SQL and Databricks.
• →Design scalable data ingestion, transformation and processing pipelines.
• →Work with Delta Lake, Unity Catalog and Databricks platform capabilities.
• →Support data migration and modernization initiatives.
• →Integrate Databricks with cloud platforms such as AWS, Azure or GCP.
• →Troubleshoot performance, scalability, reliability and data pipeline issues.
• →Work with customer engineering, data science, architecture and leadership teams.
• →Provide technical recommendations around data engineering, analytics, ML/AI and cloud architecture.
• →Create reference architectures, technical documentation and implementation guidance.
• →Support production deployment and adoption of Databricks solutions.
• →Conduct technical workshops, enablement sessions and knowledge-sharing activities.

• Delta Lake
• Unity Catalog
• MLflow
• Kafka
• Streaming
• Data migration
• MLOps
• Machine Learning
• GenAI
• Data governance
• Terraform / CI/CD
• Snowflake
• Hadoop ecosystem

Databricks' own Solutions Architect requirements similarly emphasize customer-facing architecture, big-data/data-science expertise, SQL, programming, cloud and the ability to translate customer needs into technical solutions.

Must-have skills

Data Engineering, Python, Solution Architecture

Good-to-have skills

SQL, azure, Databricks