AI QA Engineer

About Us At Litify, we’re revolutionizing the Legal industry by being the platform powering legal’s top performers. As a trailblazer in legal technology, Litify delivers an all-in-one legal operating solution that empowers law firms and legal departments to achieve consistent success by continually standardizing, measuring, and improving their legal operations. Our mission is clear: to deliver better business outcomes to our clients, so they can focus on delivering the best legal service and outcomes to their clients. 400+ enterprise businesses and 55K+ legal professionals trust Litify to amplify their impact with innovative technology and service that stands the test of time. Backed by Bessemer Venture Partners, Litify is proud to be recognized as one of Inc. 5000 and Deloitte Technology Fast 500’s fastest-growing private companies in America along with numerous awards for our unparalleled software. With offices in the vibrant cities of New York and New Orleans, we’re at the heart of legal innovation. About the Role Litify is looking for an AI QA Engineer to join our Product & Engineering team! This is a high-impact, AI-first role where you will own quality end-to-end within an agile squad. In this role, you will play a crucial part in ensuring the quality of our legal software, which is built on the Salesforce platform. The ideal candidate has a strong background in both manual and automated testing and will thrive in a hands-on, team-oriented, and fast-paced agile environment. We are actively transforming how QA works at Litify; shifting from traditional manual test execution to an AI-augmented model where AI agents perform initial test passes and human QA engineers focus on reviewing AI-generated results, exploratory edge-case testing, and making critical judgment calls on quality and risk. You will be the person who drives this transformation on the ground. Your day-to-day will involve reviewing and validating AI test outputs, identifying gaps the AI missed, performing targeted exploratory testing on high-risk areas, and building scalable Playwright automation to reach 80% coverage by end of year. You'll use Claude, GitHub Copilot, and other AI tools not just as productivity boosters, but as core components of your testing workflow. Our product is built on the Salesforce platform, and we need someone who can navigate complex enterprise software with confidence. The ideal candidate is excited about redefining what QA looks like in 2026, and can lead teammates through this transition. You can be located anywhere in the United States. In this role, you will: Review and validate AI-generated test results. Critically assess AI test outputs for accuracy, completeness, and false positives/negatives, applying your domain expertise and judgment to determine pass/fail outcomes. Perform execution of manual test cases, targeted exploratory and edge-case testing. Focus human testing effort where it matters most: complex workflows, boundary conditions, integration points, and scenarios where AI coverage is insufficient. Own QA strategy and execution for your squad, including test planning, risk assessment, and release readiness decisions. Write and maintain automated tests in Playwright, following Page Object Model (POM) design patterns, and expand POM coverage to support a scalable, maintainable automation suite. Leverage AI development tools (Claude, GitHub Copilot) as core parts of your workflow to generate test cases, write automation scripts, debug failures, and accelerate coverage growth. Report defects, track bugs, and provide clear, actionable suggestions for product enhancements. Work closely with development, product management, and delivery teams throughout the entire software development lifecycle (SDLC). Communicate clearly and effectively, working independently while managing multiple projects and priorities. Collaborate with our Customer Support team to triage complex application issues. To be successful in this role, you have (required): 3+ years of experience in a QA role, with a strong foundation in both manual and automated testing. 2+ years of hands-on experience with Playwright (preferred) or strong experience with a modern automation framework (Cypress, Selenium, WebdriverIO, etc.) and willingness to ramp quickly on Playwright. Proven ability to create and own test plans, define test strategies, and make risk-based decisions about release readiness. Familiarity with Xray or a comparable test management tool integrated with Jira. Strong Jira proficiency, including ticket workflows, bug reporting, sprint board management, and defect classification. Comfortable working in a fast-paced, highly collaborative, and dynamic Agile/Scrum environment. A clear understanding of what it means to own "code quality" for a development team. Strong verbal and written communication skills with the ability to articulate issues, priority, and impact in a clear and concise way. The ability to interact and coordinate test activities among multiple teams. Nice-to-have skills: 4+ years of experience with Playwright. Experience with Salesforce or testing Salesforce-based applications. Familiarity with Salesforce debugging logs or similar platform-level diagnostic tools. Prior experience working within legal technology or document management products. Experience with CI/CD pipelines and integrating automated tests into deployment workflows. Familiarity with AI testing concepts such as output validation, hallucination detection, or confidence scoring. Disclosure: The estimated base salary pay range for this role is $100,000-$110,000. You may also be offered a bonus and benefits. Our salary ranges are based on paying competitively for our size and industry, and are one part of many compensation, benefits and other reward opportunities we provide. Individual pay rate decisions are based on a number of factors, including qualifications for the role, experience level, skill set, and balancing internal equity relative to peers at the company. The range above is for the expectations as laid out in the job description, however we are often open to a wide variety of profiles, and recognize that the person we hire may be less experienced (or more senior) than this job description as posted. If that ends up being the case, the updated salary range will be communicated to you as a candidate.