Data Engineer 4
5+ Month W2 Contract
San Jose, CA (Hybrid)

Here’s how you’ll make an impact on the team:

• Design, develop, and maintain scalable and reliable data pipelines to support large-scale data processing.
• Build and optimize data workflows using orchestration tools like Apache Airflow and Spark to support scheduled and event-driven ETL/ELT processes.
• Implement complex parsing, cleansing, and transformation logic to normalize data from a variety of structured and unstructured sources.
• Collaborate with data scientists, analysts, and application teams to integrate, test, and validate data products and pipelines.
• Operate and maintain pipelines running on cloud platforms (AWS) and distributed compute environments (e.g., Databricks).
• Monitor pipeline performance, perform root cause analysis, and troubleshoot failures to ensure high data quality and uptime.
• Ensure proper security, compliance, and governance of data across systems and environments.
• Contribute to the automation and standardization of data engineering processes to improve development velocity and operational efficiency.

Here’s what you’ll need to be successful in this role:

• Proficient in Python and PySpark for data processing and scripting.
• Strong experience with SQL for data manipulation and performance tuning.
• Deep understanding of distributed data processing with Apache Spark.
• Hands-on experience with Airflow or similar orchestration tools.
• Experience with cloud services and data tools in AWS (e.g., S3, Lambda, SQS, Gateway, Networking).
• Expertise with Databricks for collaborative data engineering and analytics.
• Solid understanding of data modeling, data warehousing, and best practices in data pipeline architecture.
• Strong problem-solving skills with the ability to work independently on complex tasks.
• Familiarity with CI/CD practices and version control (e.g., Git) in data engineering workflows.

Pay Range: 

$90.00 - $99.13/hour

Benefits That Matter to You: 

• NextDeavor offers health, vision and dental benefits for contract employees
• Paid sick leave eligibility is contingent on state of residence
• Optional 401k Plan (excludes employer match)

Ready to take the next step? Apply today and be part of a team that transforms businesses and fuels growth!

Apply with Pioneers here <https://nextdeavor.thepioneers.ai/jobs/Adobe--data-engineer-4>!