Big Data Developer(RARR Job 5170)

We are looking for an experienced Senior Software Engineer with deep expertise in Spark SQL / SQL development to lead the design, development, and optimization of complex database systems. As a Senior Spark SQL/SQL Developer, you will play a key role in creating and maintaining high-performance, scalable database solutions that meet business requirements and support critical applications. You will collaborate with engineering teams, mentor junior developers, and drive improvements in database architecture and performance.

Key Responsibilities:

• Design, develop, and optimize complex Spark SQL / SQL queries, stored procedures, views, and triggers for high-performance systems.
• Lead the design and implementation of scalable database architectures to meet business needs.
• Perform advanced query optimization and troubleshooting to ensure database performance, efficiency, and reliability.
• Mentor junior developers and provide guidance on best practices for SQL development, performance tuning, and database design.
• Collaborate with cross-functional teams, including software engineers, product managers, and system architects, to understand requirements and deliver robust database solutions.
• Conduct code reviews to ensure code quality, performance standards, and compliance with database design principles.
• Develop and implement strategies for data security, backup, disaster recovery, and high availability.
• Monitor and maintain database performance, ensuring minimal downtime and optimal resource utilization.
• Contribute to long-term technical strategies for database management and integration with other systems.
• Write and maintain comprehensive documentation on database systems, queries, and architecture.

Required Skills & Qualifications:

• Experience: 7+ years of hands-on experience in SQL Developer / data engineering or a related field.
• Expert-level proficiency in Spark SQL and extensive experience with Bigdata (Hive), MPP (Teradata), relational databases such as SQL Server, MySQL, or Oracle.
• Strong experience in database design, optimization, and troubleshooting.
• Deep knowledge of query optimization, indexing, and performance tuning techniques.
• Strong understanding of database architecture, scalability, and high-availability strategies.
• Experience with large-scale, high-transaction databases and data warehousing.
• Strong problem-solving skills with the ability to analyze complex data issues and provide effective solutions.
• Data testing and data reconciliation
• Ability to mentor and guide junior developers and promote best practices in SQL development.
• Proficiency in database migration, version control, and integration with applications.
• Excellent communication and collaboration skills, with the ability to interact with both technical and non-technical stakeholders.

Preferred Qualifications:

• Experience with NoSQL databases (e.g., MongoDB, Cassandra) and cloud-based databases (e.g., AWS RDS, Azure SQL Database).
• Familiarity with data analytics, ETL processes, and data pipelines.
• Experience in automation tools, CI/CD pipelines, and agile methodologies.
• Familiarity with programming languages such as Python, Java, or C#.

Education:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field (or equivalent experience).