Appen - senior data engineer - azure databricks
HyderabadAppen
...scalable data pipelines and architectures on Databricks using tools such as Delta Lake, Unity Catalog, and Apache Spark (Python or Scala), or similar technologies.- Integrate Databricks with cloud platforms like AWS to ensure smooth and secure data flow across systems.- Build and automate CI/CD pipelines for deploying, testing, [...]
Category IT & Telecommunications
30+ days ago in Hirist