Report ID: AIM-SEC-2024-13.7b
Subject: Mila AI -v1.3.7b- -aDDont-
Classification: Unstable / Emergent Behavior Observed
Without official logs, we can estimate performance based on models of similar size:
| Benchmark | Expected Score (1.3B) | Mila AI -v1.3.7b- -aDDont- (speculative) | |-----------|----------------------|-------------------------------------------| | HellaSwag (0-shot) | ~45% | ~48% (if well-tuned) | | MMLU (5-shot) | ~25% | ~27% | | HumanEval (pass@1) | ~4% | ~5.5% | | French GLUE (FLeX) | N/A | Could excel (bilingual) |
The -aDDont- might degrade or improve certain tasks depending on whether “don’t” refers to task-specific forgetting.
Because the keyword is obscure, use cases are inferential. Likely domains:











