Job Description
Job Description Position : Databricks Solution Architect
Location : Malvern PA
Duration : Fulltime
Job Description:
Must Have Technical/Functional Skills:
- Databricks: Lakehouse, Delta Lake, Unity Catalog, DLT, Databricks SQL, MLflow
- Big Data: Spark, PySpark, Scala, Kafka, Streaming Architectures
- Cloud: Azure Databricks, ADF, ADLS, Synapse, AWS S3, Glue, EMR, Redshift
- Data Warehousing: Snowflake, Data Vault, Star/Snowflake Schema, CDC
- Integration: REST APIs, Event-Driven Architecture, Enterprise SaaS/ERP/CRM integrations
- DevOps: Terraform, Azure DevOps, GitHub Actions, Jenkins, CI/CD
- Governance: Data Quality, Metadata Management, Security & Compliance
Preferred: Databricks, Azure, AWS, and TOGAF certifications with experience in BFSI, Capital Markets, Asset Management, or large enterprise environments.
Roles & Responsibilities
- We are seeking a Databricks Solution Architect with 15 years of experience in designing and delivering enterprise-scale data platforms, cloud modernization initiatives, and complex system integrations.
- The ideal candidate will lead architecture strategy, define scalable Lakehouse solutions, and collaborate with business, engineering, and enterprise stakeholders to enable data-driven transformation.
Key Responsibilities
- Architect and implement enterprise data platforms using Databricks Lakehouse, Delta Lake, Unity Catalog, and Spark.
- Design scalable batch, streaming, CDC, and real-time data integration solutions across enterprise applications.
- Lead migration of legacy data warehouses, Hadoop ecosystems, and on-prem platforms to modern cloud architectures.
- Define data governance, security, lineage, metadata management, and compliance frameworks.
- Provide technical leadership, architecture governance, solution reviews, and mentoring for engineering teams.
- Partner with business stakeholders to build analytics, AI/ML, and GenAI-ready data ecosystems.
Generic Managerial Skills, If any:
- Ability to collaborate with an onsite-offshore model.
- Influence and guiding junior team members.