QA / Testing (Functional / Automation) - Sr. QA / Tester

Digital Optimization Testing Analyst

We are seeking a Digital Optimization Testing Analyst to support website and app experimentation, including A/B and multivariate testing. This role partners with business, analytics, and technology teams to define testing requirements, develop hypotheses, launch experiments, monitor performance, and deliver recommendations that improve digital customer experiences.

Key Responsibilities
• Partner with stakeholders to define digital testing needs, business goals, hypotheses, and success metrics.
• Develop test plans and strategies for web/app optimization opportunities.
• Manage multiple tests at various stages, from intake and planning through launch, monitoring, analysis, and recommendation.
• Launch and manage experiments using Optimizely, Adobe Target, or a similar testing platform.
• Use Adobe Analytics, Google Analytics, or similar tools to build reports, analyze test performance, and interpret results.
• Provide weekly test updates, final analysis, lift reporting, and business recommendations.
• Partner with technical teams to assess feasibility, gather technical specs, and understand platform capabilities.
Required Qualifications
• 6+ years of experience in business, digital, analytics, or technical roles involving quantitative and qualitative analysis.
• Hands-on experience leading A/B and multivariate testing for websites, apps, or digital experiences.
• 4+ years of experience with Optimizely, Adobe Target, or a similar experimentation platform.
• 4+ years of experience with Adobe Analytics, Google Analytics, or similar digital analytics tools.
• Ability to build reports, analyze raw data, and translate testing results into clear business recommendations.
• Basic understanding of HTML, CSS, and JavaScript.
• Strong stakeholder management skills and comfort working in a large, matrixed environment.
• Experience using workflow tools such as Jira or similar.
Preferred Qualifications
• Optimizely experience.
• Adobe Analytics experience.
• Glassbox or similar digital experience analytics/session replay tool experience.
• Financial services, insurance, banking, or large enterprise experience.
• Familiarity with statistical significance, lift, confidence levels, sample size, and test validity.