Pyspark developer
Chennai/Hyderabad/KolkataSunware Technologies
...and log data into analysis-ready datasets in the Data Hub and analytical data marts.- Develop reusable and parameterized Spark jobs for batch and micro-batch processing.- Optimize performance and scalability of PySpark jobs across large data volumes.- Ensure data quality, consistency, lineage, and proper documentation across [...]
Category IT & Telecommunications
30+ days ago in Hirist