If the quality of inferences suddenly goes down, ensure that you have Model Monitoring turned on (in Vertex AI).
It continuously tracks performance of your model in Production
Monitored Metrics include:
- ACCURACY
- PRECISION
- RECALL
Use Case – Sudden Inference Degradation
by