System Design interview questions

How would you design a system that selects the best banking product using an LLM-based digital twin of the customer?

ML System Design: Design a system that predicts port delays to optimize ship speeds and reduce fuel consumption.

How would you construct the target for a port delay prediction model? What aggregation granularity is optimal?

What features would you propose for a port delay prediction model?

ML System Design: Optimize the selection of security questions for customer verification in a bank call center. Choose the five best questions for each customer from a set of 100.

ML System Design: Design a TikTok-like short-video recommendation system with an infinite feed.

What is approximate nearest neighbor search (ANN)? Which algorithms do you know?

ML System Design: Design an outfit recommendation system that selects shoes, a top, and accessories to match a skirt.

What problems do you anticipate when building an LLM agent that generates SQL queries for a legacy database?

Should existing company reports be integrated as tools for an LLM? What problems might arise?

System Design: Design a ranking system for e-commerce search. Start with a simple solution, then develop a more complex one.

How would you scale a ranker to a million candidates when users cannot wait for boosting inference on all of them?

Have you designed an ML architecture from scratch? Describe an example.

System Design: Design a recommendation system for a feed of used-car listings.

After adding a transformer ranker, latency and throughput deteriorated sharply. What would you do?

An A/B test of a recommendation system showed no statistically significant improvement. What would you do?

What methods of communication between microservices do you know?

What are the advantages and disadvantages of a microservice architecture?

How do you deploy a model to production? Is there a separate ML environment?

How are models deployed to production?