Online Experimentation and Data Lead
Home Depot View all jobs
- Toronto, ON
- $75,000-105,000 per year
- Permanent
- Full-time
Toronto, ON M3C 4H9Req176718Full TimeExisting VacancyCorporate$75,000 - $105,000OnsiteJob DescriptionPay Range: $75,000 - $105,000At The Home Depot Canada, we want you to feel valued and supported. The pay range you see represents base salary only. In addition, your total rewards may include: semi-annual bonuses tied to business performance; Deferred Profit-Sharing Program to assist with retirement savings; comprehensive paid benefits; a 15% discount on Home Depot stock purchases; and merit-based salary increases. We are committed to recognizing your efforts and supporting your growth with us.Are you someone who thrives on helping others succeed, enjoys making an impact, and takes pride in guiding customers to the right solutions for their projects? If you're also naturally curious and eager to keep learning, consider starting or growing your career with us at The Home Depot.Position Overview:As the Online Experimentation and Data Lead, you will be the architect of curiosity and the guardian of statistical rigor for our digital storefront. Sitting within the Ecommerce Analytics team, your mission is to transform "I think" into "the data shows."You will lead the end-to-end experimentation lifecycle-from tracking implementation and hypothesis generation to sophisticated statistical analysis and executive storytelling. Whether we are optimizing the checkout flow for power tools or refining the UX of our "Kitchen Visualizer," you ensure every change is backed by data and executed with precision.Key Responsibilities:Experimentation Strategy & Execution
- End-to-End Ownership: Lead the design, execution, and analysis of A/B, Multivariate (MVT), and Experience Targeting (XT) tests using Adobe Target.
- Statistical Rigor: Apply core statistical principles to ensure test validity. This includes calculating minimum detectable effect (MDE), power analysis, sample size requirements, and interpreting $p$-values and confidence intervals to avoid Type I and Type II errors.
- Roadmap Management: Prioritize the testing backlog based on potential ROI, effort, and strategic alignment with Home Improvement business goals.
- Implementation Leadership: Act as the Subject Matter Expert (SME) for Adobe Experience Platform (AEP) Tags (formerly Launch). You will define data layer requirements and manage tag configurations to ensure seamless data collection.
- SDR Management: Maintain and update the Solution Design Reference (SDR) to ensure all experimental variables and custom events (eVars, props, success events) are captured accurately in Adobe Analytics.
- Quality Assurance: Perform rigorous QA on tracking deployments to ensure data integrity across different devices and browsers.
- Analysis Workspace: Build advanced projects in Adobe Analytics, Tableau to deep dive into test performance, segmenting data by customer loyalty tiers, product categories, or DIY vs. Pro personas.
- Automated Dashboarding: Create executive-level dashboards that track the long-term impact of experimentation on North Star metrics like Conversion Rate (CVR), Average Order Value (AOV), and RPV (Revenue Per Visitor).
- Data Storytelling: Translate complex statistical outcomes into actionable business "so-whats." You won't just report numbers; you'll tell the story of the customer journey.
- Cross-Functional Collaboration: Partner with Product Managers, UX Designers, and Merchandising teams to foster a culture of "test and learn."
- Executive Influence: Present findings to senior leadership, providing clear recommendations on whether to "roll out," "iterate," or "pivot."
- Strong grasp of frequentist statistics, hypothesis testing, and data distribution
- Web Analytics (Implementation and Reporting)
- Stakeholder management and Insight Presentation
- Mastery of Adobe Target, Adobe Analytics, and Tableau. Proficiency in Adobe Launch (Tags).
- Data storytelling and insight translation
- Exceptional presentation skills; ability to navigate "HiPPO" (Highest Paid Person's Opinion) environments with data-backed diplomacy.
- Reports to: Manager, Web Analytics Implementation
- Minimal
- Standard office environment; extended computer and data analysis work
- In Office (Mon-Fri in office)
- Office environment
- Bachelor's Degree or master's degree in Statistics, Mathematics, Data Science, Computer Science, or Economics. Equivalent practical experience may be considered
- 5+ years of professional experience in data science, analytics, or statistical modeling
- Not required
- None required
- Mastery of Adobe Target, Adobe Analytics, and Tableau. Proficiency in Adobe Launch (Tags). Experience working with cloud platforms, preferably Google Cloud Platform (BigQuery, Vertex AI, Cloud Storage)
- Strong grasp of frequentist statistics, hypothesis testing, and data distribution.
- Experience with JavaScript, CSS, and HTML (specifically for test setup and troubleshooting). Understanding of Data Layers.Knowledge of retail analytics, including demand forecasting, pricing, inventory, and promotions
- Exceptional presentation skills; ability to navigate "HiPPO" (Highest Paid Person's Opinion) environments with data-backed diplomacy.Ability to communicate complex technical findings to non-technical stakeholders
- Experience in Ecommerce (Retail/Home Improvement preferred).