Data Platform Engineer
- Job Title
- Data Platform Engineer
- Job ID
- 27768303
- Location
- San Jose, CA
- Other Location
- Description
-
Data Platform Engineer
7+ Month W2 Contract
San Jose, CA
Benefits You’ll Love:- NextDeavor offers health, vision and dental benefits for contract employees
- Paid sick leave eligibility is contingent on state of residence
- Optional 401k Plan (excludes employer match)
Here’s how you’ll make an impact on the team:
- Setup and maintain production scale Databricks environment on public cloud such as Microsoft Azure and AWS
- Handle production-scale data storage platforms like ADLS and S3 for multiple tenant teams within our Data Platform
- Coordinate production-scale microservices that support the daily operations of our data platform, including job scheduling, security, financial, and administrative services
- Maintain enterprise-scale SQL Server and SSAS environments
- Provide triage and mentorship to the team on various support issues raised by our tenants
- Develop tools and automation solutions for configuration management, service deployments, monitoring, and alerting
- Ensure security and privacy compliance, implementing Adobe Security & Compliance solutions to secure data in our data lake
- Explore GenAI technologies to integrate technical improvements and improve user experience
- Collaborate with various 3rd party vendors to resolve issues, conduct proof of concepts, and improve our product
Here’s what you’ll need to be successful in this role:
- BS in Computer Science, Computer Engineering, or similar
- Cloud Infrastructure Administration and Automation:
- AWS
- Azure
- Proficiency in Storage Technologies:
- ADLS Gen2
- S3
- MongoDB
- Vector Databases
- AI Agent Development and Maintenance:
- Langchain
- Setup and Operation:
- Databricks
- SQL Server & SSAS
- Airflow
- Azure Kubernetes Service or Elastic Kubernetes Service
- Monitoring and Alerting:
- DBX System Tables
- Prometheus
- Splunk
- MLFlow
- Maintenance:
- Linux Servers
- Kubernetes Environment
- Operational Tools:
- Jira
- Service Now
Pay Range:
$70.00 - $79.56 /hour
Ready to make your mark? Take the leap and apply directly here: https://nextdeavor.thepioneers.ai/jobs/d8b304ee--data-platform-engineer – your application is in good hands.