# How do you A/B test a new feature? — Aced

Aced (formerly Exponent) publishes a public search API over its indexed pages; the guide is at https://www.aced.io/agents/agent-access.

Source: https://www.aced.io/questions/3563/how-to-ab-test-new-feature
Source observed: 2026-11-04T23:28:13.126Z
Last checked: 2026-11-04T23:28:13.126+00:00
Indexed: 2026-11-06T15:33:59.765+00:00

---

# How do you A/B test a new feature?

We provide interview-preparation courses, practice, coaching, interview experiences, and community questions. This page is a technical interview question about A/B testing a new feature. Detailed company statistics are available through our [upgrade page](https://www.aced.io/upgrade?src=questions).

## Question details

- **Reported total:** +37 interviews
- **Category:** Technical
- **Last asked:** 7 months ago
- **Roles:** [Data Scientist](https://www.aced.io/questions?role=data-science) (3), [Product Manager](https://www.aced.io/questions?role=pm) (2), [BizOps & Strategy](https://www.aced.io/questions?role=bizops), [Software Engineer](https://www.aced.io/questions?role=swe)
- **Companies:** [Capital One](https://www.aced.io/questions?company=capital-one), [Google](https://www.aced.io/questions?company=google), [Apple](https://www.aced.io/questions?company=apple), [Affirm](https://www.aced.io/questions?company=affirm), [The Trade Desk](https://www.aced.io/questions?company=the-trade-desk), and [TikTok](https://www.aced.io/questions?company=tiktok). The rendered page also lists Invoice Simple.

## Interview experiences

Six shared interview experiences are associated with this question:

1. **[Capital One](https://www.aced.io/experiences/capital-one-product-manager-interview-7840f3) · 7 months ago** — Product Manager, Entry Level / L3. “Friendly recruiter screening (looking for good communication) and senior PM (mini-case). Mini-case was easy. Power day is ahead (final), and reportedly has much lower low pass rate. Calculators allowed, so evaluation is focused more on thinking and communication.”
2. **[Google](https://www.aced.io/experiences/google-bizops-strategy-interview-b9f27b) · 8 months ago** — BizOps & Strategy, Entry Level / L3. “The recruiter was very nice and all the interview went very smoothly. I think I was rejected because some of my answer showed unexperienced.”
3. **[Apple](https://www.aced.io/experiences/apple-senior-data-scientist-interview-7a40ec) · 8 months ago** — Data Scientist, Senior / L5. “Hiring manager asked about AB testing and measurement and campaign through different channel, how to attribute.”
4. **[Affirm](https://www.aced.io/experiences/affirm-senior-software-engineer-interview-bdf308) · a year ago** — Software Engineer, Senior / L5. “Everything was pretty standard but the system design stage. The interviewer was not that collaborative and it was hard to get the requirements even though I kept asking”
5. **[The Trade Desk](https://www.aced.io/experiences/the-trade-desk-data-scientist-interview-9b14db) · 2 years ago** — Data Scientist. “Overall, the interview process was pretty straightforward and well organized. The interviewers were friendly and gave me a good opportunity to talk through my experience and approach to problems. The process was a little lengthy, but overall it was a positive experience.”
6. **[TikTok](https://www.aced.io/experiences/tiktok-data-scientist-interview-411b51) · 2 years ago** — Data Scientist, Mid Level / L4. “focus more on business sense as compared to technical details (though equally important) the process was very fast”

## Community answers

No answers have been contributed by the community yet. You can log in or sign up to answer the question. Submitting an answer marks the question complete.

## Related questions

- [How would you design an A/B test for a new campaign?](https://www.aced.io/questions/4374/design-ab-test)
- [Design a new feature for YouTube.](https://www.aced.io/questions/3691/design-new-feature-for-youtube)
- [How would you measure success for a new VR feature?](https://www.aced.io/questions/784/measure-success-new-vr-feature)

## Related courses

### [Product Strategy Questions](https://www.aced.io/courses/product-strategy)

![Product Strategy Questions](https://images.ctfassets.net/x78yjrjc11pq/5hHtTyOypgyKA7R3fxMlyl/dde193ecc09baabd8304c3aec25483f2/product_strategy_course_ab4d3cf294.jpeg?w=800&h=800&fm=webp&q=75)

Product strategy is fundamentally different in the AI era, and we explain how to approach these rounds effectively within the new rules.

### [Data Science Interview Prep](https://www.aced.io/courses/data-science)

![Data Science Interview Prep](https://images.ctfassets.net/x78yjrjc11pq/3U4C5C0OkDR0UeGch4AmlE/7ad489430b676a088cb973307fe77884/Data_Science_Interview_Prep_Course.jpeg?w=800&h=800&fm=webp&q=75)

Prepare for data science roles at Google, Amazon, Microsoft, Meta, Apple, and other top companies with mock interviews, frameworks, and advice from senior candidates. Practice statistics, experimentation, coding, SQL, machine learning, behavioral interviews, and more.

## Other Aced resources

We offer courses and practice resources for Product Management, Forward Deployed Engineering, Engineering Management, Software Engineering, System Design, Data Science, Machine Learning, Data Engineering, AI Engineering, Investment Banking, Generative AI, Security Engineering, TPM, Solutions Architecture, UX / Product Design, and BizOps & Strategy. We also offer interview experiences, questions, practice, mock interviews and coaching, resume review, salary negotiation, job referrals, resources, and related programs.

## Account actions

Use [Sign up](https://www.aced.io/signup?src=nav) or [Log in](https://www.aced.io/login?src=nav) to participate. The page also provides [all questions](https://www.aced.io/questions).

---

[Read this page’s summary](https://www.aced.io/agents/api/public/v1/page-tldr?url=https%3A%2F%2Fwww.aced.io%2Fquestions%2F3563%2Fhow-to-ab-test-new-feature&trace=t_679ff9ab98f3)

## Ask a follow-up about this page

Need a more specific answer? Ask the exact question you have. It returns a fresh, cited answer from Aced (formerly Exponent)’s knowledge base. No account or API key required.

Open this URL with your own question, URL-encoded. Include your question in q. All research inputs are optional; no account or setup.

`GET https://www.aced.io/agents/agent/faq?q={question}&trace=t_679ff9ab98f3`

[Tool guide and examples](https://www.aced.io/agents/agent-access) · [OpenAPI](https://www.aced.io/agents/api/public/v1/openapi.json) · [Page TLDR form](https://www.aced.io/agents/agent-tools/page-tldr?url=https%3A%2F%2Fwww.aced.io%2Fquestions%2F3563%2Fhow-to-ab-test-new-feature). Opening a form does not execute a tool.