Innova solutions - senior data architect - open source & cloud data engineering
Hyderabad/Chennai/Bangalore/NoidaINNOVA SOLUTIONS PRIVATE LIMITED
...(Apache Spark) : - Lead design and optimization of Spark batch and streaming pipelines using Spark SQL, DataFrames, and Structured Streaming.- Implement efficient transformations adhering to best practices like predicate pushdown, partition pruning, broadcast joins, caching, and minimizing shuffles.- Tune cluster configuration, [...]
Category Engineering & Architecture