Provana - technical lead - data engineering
NoidaPROVANA INDIA PRIVATE LIMITED
...clusters by exploring all available options like optimizing shuffle partitions, and managing "Small File" problems to reduce Azure consumption costs.- Data Governance : Implement and manage Databricks Unity Catalog for centralized fine-grained access control, lineage tracking, and data discovery.- Handle production issues, [...]
Category IT & Telecommunications