Mistral-7B-Instruct-v0.3

Quality falls to 63.8 as creative performance collapses to 6

Mistral-7B-Instruct-v0.3 on OVH AI Endpoints continues a troubling downward trajectory, dropping another 5.3 points to an overall quality score of 63.8. This marks the second consecutive window of quality decline, bringing the total drop to over 10 points. The most alarming change is the creative category, which has plummeted to just 6 points, indicating severe degradation in tasks requiring imaginative or open-ended responses. While coding performance improved from 83 to 92 and factual capabilities surged from 32 to 94, these gains cannot offset the creative collapse. Reasoning stabilized at 63 points, a moderate level that suggests inconsistent logical processing. Multilingual testing was not included in the current window, making it impossible to assess whether that previously strong category remains stable. Latency improved slightly from 6.7 to 5.9 seconds at the median, offering a minor silver lining. Users requiring creative text generation, content writing, or storytelling should look elsewhere, as this model appears fundamentally compromised in that domain. Those focused purely on coding assistance or factual retrieval may still find value, but the overall instability raises concerns about reliability across deployment scenarios.