java and spark develper (NCS/Job/ 2341)
Job Skills
Job Description
D:
We are seeking a skilled Developer with expertise in Java, Spring, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.
Responsibilities
• Develop and maintain Java-based applications using the Spring framework.
• Design and implement batch processing solutions using Spark Batch for large-scale data processing.
• Build real-time data pipelines using Spark Streaming for processing streaming data.
• Collaborate with cross-functional teams to define, design, and deliver new features.
• Optimize data processing workflows for performance, scalability, and reliability.
• Troubleshoot and resolve issues related to data processing, application performance, and system integration.
• Write clean, maintainable, and well-documented code following best practices.
• Participate in code reviews, unit testing, and system testing to ensure quality deliverables.
• Stay updated with emerging technologies and propose improvements to existing systems.
Required Skills and Qualifications
• Education: Bachelor’s degree in computer science, Engineering, or a related field.
• Experience: 7+ years of professional experience in Java development.
• Technical Skills:
o Strong proficiency in Java (version 8 or higher) and object-oriented programming.
o Hands-on experience with Spring (Spring Boot, Spring MVC, or Spring Data) for building enterprise applications.
o Expertise in Spark Batch for large-scale data processing and analytics.
o Experience with Spark Streaming for real-time data processing and streaming pipelines.
o Familiarity with distributed computing concepts and big data frameworks.
o Proficiency with version control systems like Git.
o Knowledge of build tools such as Maven or Gradle.
o Understanding of Agile/Scrum methodologies.
Soft Skills:
o Strong problem-solving and analytical skills.
o Excellent communication and teamwork abilities.
o Ability to manage multiple priorities and work independently.
Preferred Skills
• Experience with big data technologies like Hadoop, Kafka, or Hive.
• Knowledge of containerization tools like Docker or Kubernetes.
• Experience with CI/CD pipelines and tools like Jenkins.
• Understanding of data storage solutions like HDFS, Cassandra, or MongoDB.
