Globality Bid - AWS EMR Engineer (Spark PySpark, Python, Shell Scripting) SMI, RI - Bid Due: 3/13/25 Job at Goli Tech, Roanoke, VA

TWVoTmp2Ymt4UHRNZms3WGdZODI5MFZKaVE9PQ==
  • Goli Tech
  • Roanoke, VA

Job Description

Job Title: AWS EMR Engineer (Spark/PySpark, Python, Shell Scripting)

Key Responsibilities:

  • Design, develop, and optimize data processing workflows on AWS EMR using Spark/PySpark.

  • Write efficient Python and Shell scripts to automate data processing tasks.

  • Implement data processing solutions with large-scale datasets in a cloud environment.

  • Work closely with data teams to identify and address performance bottlenecks.

  • Troubleshoot and resolve issues in data pipelines and production environments.

  • Ensure the scalability, reliability, and efficiency of data solutions.

Required Skills:

  • Strong experience with AWS EMR and Apache Spark/PySpark.

  • Proficient in Python and Shell scripting for data pipeline automation.

  • Experience working with large-scale data processing and distributed systems.

  • Familiarity with AWS services such as S3, EC2, Glue, and Redshift.

  • Strong knowledge of data processing concepts, ETL processes, and performance optimization.

Required Skills : Amazon Web Services (AWS),Python

Basic Qualification :

Additional Skills :

Background Check : No

Drug Screen : No

Job Tags

Similar Jobs

Incyte Corporation

Medical Director, Global Risk Management & Safety Surveillance (GRMSS) - Pharmacovigilance Job at Incyte Corporation

 ...Primary function) The Medical Director, Global Risk Management & Safety Surveillance (GRMSS), reporting into the Head of GRMSS, will be...  ...safety strategies that are in alignment with the company's drug development and commercialization strategies. Perform drug safety... 

Red Wing Brands of America

Retail Industrial Manager Job at Red Wing Brands of America

 ...to support your health and financial security. You can find retail jobs just about anywhere. So, why work at Red Wing Shoes? From...  ...operations including recruitment, team development, profitably, managing expenses, accounts receivable, developing new business, store inventory... 

Assisting Hands Home Care of Palm Beach

Weekend Driver for Non-Emergency Medical Transport Job at Assisting Hands Home Care of Palm Beach

 ...Company will provide paid in field training, vehicle to use when transporting customers, and a fuel card It is the responsibility of the...  ..., dialysis, physical therapy, pharmacies, or any other medical appointments on time, while adhering to federal, state and local... 

O'Neill Insurance

Commercial Risk Advisor Job at O'Neill Insurance

 ...Responsibilities:New Sales:Generate leads and a maintain a healthy pipeline of opportunities through outbound prospecting, including cold...  ...insurance prospects for insurability and quality of riskSurvey loss exposures, needs, and possible uninsurable or difficult to... 

The Faulkner Automotive Group

IT Director Job at The Faulkner Automotive Group

 ...The Faulkner Automotive Group is looking for an enthusiastic, self-motivated IT Director to join our team! Faulkner is a place you can establish a career and grow with the organization. We provide training to all our employees and offer continued growth opportunities for...