Pyspark developer - azure databricks
Bangalorer3 Consultant
...Data Lake and Data Warehouse environments.- Optimize ETL workflows for performance, scalability, and cost efficiency using Spark SQL and PySpark.- Implement robust error handling, logging, and monitoring mechanisms for ETL jobs.- Design and implement data solutions following Medallion Architecture (Bronze, Silver, Gold [...]
Category IT & Telecommunications