We are seeking a detail-oriented and technically skilled Data Pipeline Operations Engineer to manage and execute our weekly scanning process. This critical role ensures the timely flow of customer data through our research, scanning, and UI ingest pipeline. The ideal candidate has a mix of programming, database, and Linux system administration skills to handle the various steps in the scanning workflow.
SixMap is the leading Automated Cyber Defense Platform for continuous threat exposure management (CTEM) across today’s largest, most complex and dynamic enterprise and government environments. With zero network impact and zero agents, SixMap automatically discovers all Internet-facing assets across IPv4 and IPv6 to deliver the most comprehensive external attack surface visibility. The platform identifies vulnerabilities, correlates proprietary and open-source threat intelligence, and provides actionable insights to defend against imminent threats with supervised proactive response capabilities. The SixMap team brings deep intelligence community expertise and best practices to the defense of both U.S. Federal agencies and Fortune 500 corporations.
Manage the weekly scanning process, ensuring customer data progresses through research, scanning, and UI ingest phases according to defined SLAs
Prepare input files and kick off processes on the scanning cluster via Airflow
Monitor and troubleshoot jobs, adjusting parameters like rate files as needed to optimize runtimes
Perform data ingest into production databases using SQL and Python
Clear data artifacts and caches in between ingest cycles
Execute post-ingest data refresh routines
Perform quality checks on ingested data to validate contractual obligations are met
Identify process bottlenecks and suggest or implement improvements to the automated tooling to increase speed and reliability
Required Skills:
Preferred Additional Skills:
Familiarity with network scanning tools and methodologies
Experience optimizing database performance
Scripting skills to automate routine tasks
Understanding of common network protocols and services
Knowledge of AWS services like EC2
...OnTrac is hiring a Package Handler Lead! Are you eager to join a dynamic and expanding company where you can both learn and make a meaningful impact? If you possess a strong sense of empathy, enjoy assisting others, thrive in a fast-paced environment, and excel at...
...About CyberArk : CyberArk (NASDAQ: CYBR ), is the global leader in Identity Security . Centered on privileged access management, CyberArk provides... ...or Facebook . Job Description The Sr. Director, Global Sales Operations is a critical role to deliver...
...Want to help people see the world while growing your own income? Join us as a Global Vacation Planner and create custom travel experiences for clients everywhere, from tropical beaches to bustling cities. Imagine turning your passion for travel into an opportunity...
.... ~ Areas: South, East Coast, and Midwest. ~ No-touch freight. ~ Flexible Home Time. ~ Flexible Weekly Miles - You Choose. ~7 Days OTR Preferred. ~ Paid weekly and on time every time. About us: We are a small company that has enough time to talk to...
...We are looking for an assistant teacher for our After School program Monday through Friday each week. Hours for the position would be 2 pm to approximately 6 pm daily. Responsibilities would include: Driving a 15-passenger van to pick up children from one of the...