Data engineer - hadoop/spark
HyderabadAmpcus Tech
...for Spark transformations and helper methods- Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API- Work closely with Business Analysts team to review the test results and obtain sign off- Prepare necessary design/operations documentation for future usage Perform peers- Code [...]
Category IT & Telecommunications
30+ days ago in Hirist