Data engineer - python/apache spark
Work From HomeSDOD TECHNOLOGIES PRIVATE LIMITED
...cases.- Build and manage ETL/ELT pipelines using AWS Glue, integrating data from S3, RDS, APIs, and flat files.- Develop scalable data processing jobs using Apache Spark (PySpark), preferably on AWS EMR.- Perform data modeling, query tuning, and performance optimization for large datasets.- Create and maintain dashboards and [...]
Category IT & Telecommunications