Idexcel technologies - data engineer - etl/pyspark
BangaloreIdexcel Technologies Private Limited
...Loader (cloudFiles), and Structured Streaming.- Optimize jobs : partitioning, bucketing, Z-Ordering, OPTIMIZE + VACUUM, broadcast joins, AQE, checkpointing.- Manage Unity Catalog : catalogs/schemas/tables, data lineage, permissions, secrets, tokens, and cluster policies.- CI/CD for Databricks assets : [...]
Category IT & Telecommunications