Solutions Architect Interview Experience

Interview process

This is for [Senior Delivery Consultant- GenAI/ML, AWS, Industries](https://www.amazon.jobs/it/jobs/3119299/senior-delivery-consultant-genai-ml-aws-industries) interview # **Recruiter Screen (over Phone)** - Have you productionized any machine learning systems? - What metrics did you use to track those models in production? - Did you optimize models at scale? How? # **Technical Interview (Chime - Video)** ## **Machine Learning Fundamentals** - What is bias vs variance? - What is overfitting? - How do you handle an overfitted model? ## **Model Optimization** - How do you optimize a machine learning model? ## **RAG / LLM Systems** - How do you improve a RAG system? - How do you reduce latency in a RAG pipeline? ## **Production ML / MLOps** - How do you measure the performance of a deployed model? - How do you improve a model over time in production? - How do you detect and handle data drift and concept drift? - How do you continuously retrain models? - How do you detect inefficiencies in production models? # **Behavioral** - Tell me about a time you handled a difficult customer - Tell me about a time you stepped in and fixed something that was broken - How do you handle multiple conflicting priorities?