DataBricks || Praveen (NCS/Job/ 2526)

JD Databricks

12+ years of IT experience and minimum 4+ years of hands-on experience in Databricks with extensive experience in leading the design and implementation of scalable, secure, and cost-optimized data platforms on Databricks. Candidate need to own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions with focus on following:

• Proven expertise with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution, ACID compatibility, History capture, Lakehouse format interoperability etc.
• Integrating Databricks with various ETL/Orchestration tools and perform required operations.
• Strong expertise in fundamental areas like Spark ecosystems, Data frame API & Spark SQL with Python, Scala and SQL as language
• Hands on knowledge on Databricks native features like Workflows, Delta Live Tables, Unity Catalog, Lakeflow, Lakehouse Federation etc.
• Expertise in workspace and cluster configuration, performance tuning, cost optimization, data security and log monitoring.
• Experience with spark structured streaming jobs with autoloader integrating with different streaming platforms.
• Experience with CI/CD, DevOps, and infrastructure-as-code tools (Terraform, GitHub Actions, Azure DevOps)
• Create and maintain optimal data pipeline architecture with knowledge in best practices from Databricks platform
• Strong understanding of Data Modelling and defining conceptual logical and physical data models.
• Proven track record of building deep sales/technical relationships with CXO’s and practice building executives.
• Translate customer needs into technical solutions and design proposals (both proactive and RFx), presentations, and product demonstrations
• Experience in managing various client relationships to get consensus on solutions.

Nice to have - exposure to AI/Gen AI skill and/or any professional level Databricks/Cloud (AWS/Azure/GCP) certifications.