Lead Quality Engineer (Financial Services)

Pittsburgh, Pennsylvania

Must be a US Citizen, or Permanent US Resident (no visa sponsorship available)

Must be able to work onsite 5 days a week.

@Orchard LLC has an immediate requirement for a Lead Quality Engineer to join the Enterprise Document Management team, supporting a large US Bank, working in an advanced technology environment. The Lead Quality Engineer is responsible for defining and driving the quality strategy, validation standards, and release readiness for the Document Management platform, focused on user-centric application capabilities and integration across existing enterprise systems.

This role establishes quality frameworks, automation strategies, and validation models across document access, metadata integrity, search (including vector-based semantic retrieval), and governance controls, forming the foundation for AI-powered search and agentic workflows.

Your responsibilities will include.

·       Define and own the end-to-end quality strategy, standards, and release governance.

·       Establish quality gates, automation frameworks, and validation metrics across application and integration layers.

·       Partner with Engineering, Product, and Architecture to drive shift-left quality practices and early defect prevention.

·       Enable data-driven release decisions, providing clear visibility into quality metrics, risks, and readiness.

·       Provide technical leadership and oversight across QE practices, automation, and continuous improvement.

·       Document Management Application + Existing System Integration.

·       Define and lead end-to-end validation strategies for document management workflows, including document submission, access, and retrieval across systems.

·       Establish validation frameworks for search and retrieval capabilities, including:
Metadata-driven and full-text search.

·       Vector-based semantic search (embedding similarity, ranking accuracy, relevance tuning).

·       Entitlement enforcement and context-aware results.

·       Define and govern validation for metadata quality, taxonomy alignment, and data integrity across systems.

·       Ensure document lifecycle and governance validation, including retention, auditability, traceability, and compliance enforcement.

·       Lead validation of AI-powered retrieval and agentic workflows, ensuring accuracy, grounding, and consistency.

·       Define and oversee validation of federated integrations, ensuring consistency in document access, metadata alignment, and cross-system behavior.

·       Establish testing strategies for API and event-driven integrations, including data integrity, resilience, retry handling, and failure scenarios.

·       Ensure end-to-end traceability, auditability, and regulatory compliance across application and integration layers.

·       Define and oversee security and access control validation (RBAC) across all document and retrieval scenarios.

·       Lead performance and scalability testing strategies for search, retrieval, and integration workloads.

·       Drive automation-first quality practices, including CI/CD-integrated test pipelines and continuous validation.

·       Establish quality observability, including dashboards, reporting, and actionable insights on coverage, defects, and system performance.

Your background will include.

·       Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent practical experience.

·       6+ years of experience in quality engineering, software testing, or enterprise platform validation.

·       3+ years leading quality strategy or providing technical leadership on large-scale delivery programs.

·       Proven experience validating document management systems, enterprise search platforms, or metadata-driven applications.

·       Strong expertise in test strategy design, quality gates, and automated validation frameworks.

·       Experience testing API-driven, microservices, and event-driven architectures.

·       Hands-on experience with Microsoft Azure, CI/CD pipelines, and test automation frameworks.

·       Strong understanding of:

o   Search Relevance and metadata validation

o   Vector/semantic search and AI-driven retrieval validation.

o   Experience validating security, RBAC, and compliance controls in regulated environments.

·       Familiarity with AI/ML, LLM-based retrieval, or agentic workflows.

·       Strong communication skills with the ability to present quality metrics, risks, and release readiness to stakeholders.

Compensation: Compensation ranges are determined by several factors, including skill set, experience, licensure and certifications, and location. The anticipated range for a base salary for this role is between $90K & $140K. There may be some flexibility for exceptionally qualified individuals.

Established in 2010, @Orchard LLC has an exceptional reputation, providing staffing solutions to time-sensitive, talent-scarcity issues to deliver better talent management ROI.  Our specialty lies in the critical area of program talent acquisition and resource management, not in one narrow skillset, but across many areas of technical and functional delivery. To learn more about our other exciting opportunities, visit our Jobs Page at www.atOrchard.com.