Data engineer - python/pyspark
ChennaiScoop Technologies
...Databricks and CI/CD practices.Key Responsibilities : - Design, develop, and optimize data pipelines using Python and PySpark- Work extensively with Azure Databricks for large-scale data processing- Develop and manage data ingestion and transformation workflows using Azure Data Factory and Dataflows- Implement and maintain [...]
Category IT & Telecommunications