Data Engineer Job at CG Infinity, United States

TnVoT2dmL2d4UGxPZjBiVmpZbzg4a3hNalE9PQ==
  • CG Infinity
  • United States

Job Description

We are seeking an experienced Data Engineer to design, build, and maintain scalable data processing pipelines using modern big data technologies. The ideal candidate will have strong development skills and experience with distributed computing frameworks.

Required Skills & Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 5+ years of software development experience
  • Strong proficiency in Python, Java or Scala programming languages
  • Extensive hands-on experience with Apache Spark, including:
    • Spark SQL
    • Spark Streaming and its data sources KAFKA, CDC feed, etc
    • Performance optimization and tuning
    • Data transformation and processing
  • Hands on Experience working with cloud-based Spark platforms (Databricks, AWS EMR, AWS Glue)
  • Strong understanding of Hive, Unity catalog, Glue catalog
  • Hands on Experience working with any data quality framework/tools
  • Hands on Experience working with Observability and monitoring for data processing pipelines
  • Strong understanding of distributed computing concepts
  • Proficiency in version control systems (Github/GitLab/Bitbucket)
Technical Requirements:
  • Experience building and maintaining high-volume data processing pipelines
  • Knowledge of data modeling and ETL / ELT best practices
  • Familiarity with SQL and NoSQL databases
  • Understanding of data warehouse concepts and dimensional modeling
Preferred Qualifications:
  • Experience with real-time data processing and streaming architectures
  • Knowledge of Delta Lake or similar data lakehouse technologies
  • Experience with CI/CD pipelines
  • Cloud platform expertise (AWS/Azure/GCP)
  • Contributions to open-source projects
Key Responsibilities:
  • Design and implement scalable data pipelines
  • Optimize existing data workflows for performance and reliability
  • Collaborate with data scientists and analysts to support their data needs
  • Implement data quality checks and monitoring
  • Maintain documentation for data processes and architectures
Soft Skills:
  • Strong problem-solving abilities
  • Excellent communication skills
  • Team collaboration
  • Ability to work independently
  • Strong attention to detail
The ideal candidate should have a proven track record of developing and maintaining production-grade data pipelines and be passionate about working with large-scale data systems.

Please note this position requires an active IRS MBI clearance. 

 

Job Tags

Full time,

Similar Jobs

Mod Op

Junior Data Engineer Job at Mod Op

 ...Data Engineer Job Description: Mod Op is a full-service advertising agency with offices across several US locations, Panama City, Panama, and Canada. With continued growth and a dynamic leadership team, we offer a generous time-off package, access to high-quality healthcare... 

Baisch Engineering

Process Engineer Summer Intern Job at Baisch Engineering

 ...all voices are heard? If so, we are looking for driven, goal-oriented people like you to join our team as a Process Engineering Intern. Here's what you will need to do: Work alongside design engineers to analyze systems using discipline-specific software packages... 

University of Tampa

Art Model (Part-Time) 2025-2026 Academic Year Job at University of Tampa

 ...Art Model (Part-Time) 2025-2026 Academic Year R0009300 Tampa If you are a current University of Tampa student, please search for and apply to student jobs here via Workday. Job applications for current students will not be considered if submitted through the... 

Sound Physicians - Phoenix, AZ - Sound Physicians

Anesthesiology - Physician Job at Sound Physicians - Phoenix, AZ - Sound Physicians

 ...Anesthesiology - Physician at Sound Physicians - Phoenix, AZ - Sound Physicians summary: The position is for an anesthesiologist at Banner University Medical Center in Phoenix, Arizona, offering flexible scheduling and a collaborative care team environment. Candidates... 

Dover Corporation

Assembler I - Insulator Job at Dover Corporation

 ...our customers that they choose the best when they choose to work with the people of Dover Food Retail. SUMMARY: Assembles, installs and repairs sheet metal products, parts and equipment. ESSENTIAL DUTIES AND RESPONSIBILITIES: Assembles units, exhaust...