Pyspark Developer(NCS/Job/ 1398)

Role: Sr. PySpark Developer

No. of position: 5

Location : Bangalore /Hyderabad

Grade: C1 (5-8 years) : PYSPARK+PYTHON+Databricks

Skills:

· Apache Spark: In-depth knowledge of Spark Core, Pyspark, Spark SQL, DataFrames, Datasets, RDDs, Spark Streaming and Parquet partitioning concepts.

· Programming: Strong in Data Python (must avoid Application Python)

· Cloud Platforms: Experience with Data bricks. Ddesigning, developing, and maintaining data pipelines and solutions using Databricks.

· This role requires strong skills in PySpark, SQL, and experience with data warehousing and ETL/ELT processes. Senior developers also need to be proficient in cloud technologies and have experience with data governance and security.

· Databases: Strong experience with SQL.

· Tools: Knowledge of version control (Git), CI/CD tools, and Agile methodologies.

· Excellent communication.

· Should be ready to work from office all 5 days.

Nice to Have:

· Cloud Platforms: Experience with AWS S2, AWS Athena, AWS Glue. Should have understanding for AWS Athena.