Add MathAlea French math MCQ community task

[Lduignan1]

Summary

• Add community_tasks/mathalea.py — a multiple-choice math benchmark for French middle and
  high school students (cinquième, quatrième, troisième, première, terminale)
• Dataset: OpenLLM-BPI/MathAleaMCQ
• 6 task configs: mathalea:all (full dataset) + 5 per-grade subtasks
• Uses loglikelihood_acc metric with single-letter choices (A, B, C, D)

Test plan

• Verify task loads: lighteval accelerate "model_name=..." "community|mathalea:all|0"
• Verify per-grade subtasks load correctly
• Confirm dataset is accessible on HuggingFace

[Jeronymous]

The ultimate test should be to have good results with a SOTA model that is not too big (SmolLM 3B) ?

You chose to expose only the MCF formulation. Which exclude pretrained models, and in my (small) experience is challenging to make work with instruct models.
Maybe you can propose several formulations (CF, MCF and hybrid) by doing something similar to https://github.com/huggingface/lighteval/blob/main/src/lighteval/tasks/multilingual/tasks/mlmm_arc_challenge.py

[Jeronymous]

You could such a function to normalize the subset names

import unicodedata

def remove_accents(text: str) -> str:
    return ''.join(
        c for c in unicodedata.normalize('NFD', text)
        if unicodedata.category(c) != 'Mn'
    )

[Jeronymous]

This can be factored, by treating "all" as other subsets

[Jeronymous]

If you add "Réponse :" in the end, don't you want to add "Question :" prefix here?
Or even better, with first an instruction such that "Réponds à la question à choix multiple suivante, en répondant avec le format LETTER, où LETTER est une lettre parmi A, B, C ou D.".

Aussi, est-ce qu'on veut que les modèles soient autorisés à raisonner avant de répondre?
Si oui, il faut faire quelque chose à la "gpqa_diamond_instruct " -- https://github.com/huggingface/lighteval/blob/main/src/lighteval/tasks/tasks/gpqa.py
(c'est un dataset assez compliqué, les modèles ne sont pas sensés pouvoir répondre directement la bonne lettre sans réfléchir avant).

[Jeronymous]

est une lettre parmi A, B, C ou D.

Oh wait, it seems that sometimes there are less than 4 possible answers, right ?