Lead/senior data engineer
PuneSpes Manning Solutions LLP
...processing.Key Responsibilities : - Build scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.- Perform data pre-processing, including cleaning, transformation, deduplication, normalization, encoding, and scaling to ensure high-quality input for downstream analytics.- Design and [...]
Category IT & Telecommunications