The user submits a question to the SLM-MUX system
The question is sent to 3 different SLMs. Each SLM generates 3 independent responses.
Confidence is calculated by counting how many times each SLM gives the same answer.
SLM 1: 2/3 answers are (A) → 67% confidence
SLM 2: 2/3 answers are (B) → 67% confidence
SLM 3: Only 1/3 answers match → 33% confidence
SLM 1 | SLM 2 | SLM 3 | |
---|---|---|---|
Confidence | 67% ✔ | 67% ✔ | 33% ✖ |
SLM 1 and SLM 2 both have 67% confidence (tie!).
We use Validation Accuracy as a tie-breaker: SLM 1 has higher validation accuracy.
SLM 1 | SLM 2 | SLM 3 | |
---|---|---|---|
Confidence | 67% ✔ | 67% ✔ | 33% ✖ |
Validation Accuracy | High ✔ | Low ✖ | Low ✖ |
The system outputs the most frequent answer from the selected SLM (SLM 1)