Question Bank
Math & Statistics interview questions
A formula is useful when you understand its assumptions and can explain the result. Review probability, statistics and mathematics used in data problems. Pair calculations with interpretation and an example of what happens when assumptions fail.
Showing 15 of 35 questions
What is a 95% confidence interval? Is it correct to say 'there's a 95% probability the true parameter is in this interval'?
How to assess statistical significance for ratio metrics (e.g., revenue per user) in A/B tests? Why can t-test be incorrect?
Explain the Monty Hall problem using Bayesian updating. Generalize to n doors.
Explain CUPED. Derive the optimal θ and show the variance reduction.
Derive the posterior for Bayesian updating with normal likelihood and normal prior. How is this related to ridge regression?
How to correctly run A/B test with multiple metrics (5+ KPIs)? Explain multiple comparisons problem and correction methods.
Explain the delta method for variance estimation of nonlinear functions of random variables. Give an example for ratio metrics in A/B tests.
Можешь сказать, в каком интервале будут находиться значения логарифмированной вероятности?
Можешь сказать, как мы можем рассчитать вероятность того, что тысячу раз подбросили и тысячу раз у нас выпал орел?
Could you describe your experience with A/B testing?
Do you know what an A/A test is and why we need it?
Suppose an A/B test shows statistically significant results for 5 out of 100 randomly selected metrics after two weeks. Should we switch to the new version? Why or why not?
а вы какой-то ABT-тест проводили, ты говоришь, что просто разделили model, то есть как дизайнили ABT-ст?
А, ну, как-то оценивали перед БТС там, например, сколько вам надо абонентов в группу Б добавить?
Prepare for your next interview with Vibe Interview.
Download Vibe Interview