Role: Senior Data Engineer
Remote (US) - Anywhere in the US (EST and CST preferred)
Job Type: W2 Contract
Note: Visa Independent candidates are highly preferred (Third party or C2C is not accepted)
Required Skills (Primary):
Hadoop, Apache Spark, Apache Airflow, CI/CD, Kafka
Short Overview of the Role:
Data Engineer with 6 10 years of experience in building and maintaining scalable, high-performance data pipelines and processing frameworks.
The ideal candidate will have strong hands-on expertise in orchestration using Apache Airflow and distributed data processing with Apache Spark (EMR).
This role requires a solid understanding of big data architecture, data engineering best practices, and a commitment to delivering efficient, reliable, and maintainable data solutions that align with business and technical requirements.
Qualifications Required:
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
6 10 years of experience in data engineering or related roles.
Strong experience with Apache Airflow for data orchestration and workflow management.
Proven expertise in building and tuning distributed data processing applications using Apache Spark (PySpark), including both Structured Streaming and Batch.
Experience with AWS cloud-based data ecosystems, particularly Athena and Redshift.
Proficient in SQL (Athena version) and experienced in working with large datasets from various sources (structured and unstructured).
Experience with data lakes, data warehouses, and batch/streaming data architectures.
Familiarity with CI/CD pipelines, version control, and DevOps practices in a data engineering context.
Preferred Qualifications:
Experience working in Agile/Scrum environments.
Knowledge of data quality frameworks and validation engines.
Experience with data catalog tools.
...APAC Alabama, Inc. is an Affirmative Action and Equal Opportunity Employer and an E-Verify Participant. We are searching for a Field Engineer to join our Team! In this role you will learn and become fully entrenched in the asphalt and road construction business.Our...
...growth opportunities. Join the Abacus family. Position: Stand-up Reach Operator Location: Phoenix, AZ 85043 Compensation: $21.5... .... 8. Maintain proper licenses and certifications for forklifts such as reach trucks, electric pallet jacks, and other heavy...
...Matrix Providers is hiring a Licensed Practical Nurse (LPN/LVN) to join our team of talented professionals who provide health care... ...This is an hourly position. ~ Schedule: Mon-Sun 0700-1900- Clinic open on all Federal Holidays ~ Benefits: Competitive financial...
...Orthopedic Surgery, with experience in completing Independent Medical Exams. The ideal candidate will be willing to have licensure... ...advisor services Fully prepped cases, streamlined case flow, transcription services at no cost, and user-friendly work portal ...
Sand Springs company needs Heavy Equipment/Truck Mechanic $20-$28 Must be able to work on large equipment dozers, magnet cranes, scrapers, front end loaders, excavators This includes hydraulics, electrical and pneumatics Some repair welding Must have own tools...