Issues

• Verify evals on Papers with Code

  allenai/OLMoE#53 · Filter by author NielsRogge opened on Sep 14, 2026

• Profile-based routing for OLMoE: making experts swappable post-training?

  allenai/OLMoE#52 · Filter by author washingtoneimae-dot opened on Jul 31, 2026

• Question about expert choice rouiting

  allenai/OLMoE#46 · Filter by author lionel-me opened on Jan 17, 2026
  1

• per checkpoint evaluation metrics for OLMoE

  allenai/OLMoE#44 · Filter by author Muennighoff opened on Jan 6, 2026
  3

• Availability of Checkpoints with Shared Expert

  allenai/OLMoE#42 · Filter by author hxu105 opened on Jan 2, 2026
  1

• Dataset questions

  allenai/OLMoE#41 · Filter by author Muennighoff opened on Dec 26, 2025
  4

• Question on Router Z-Loss Normalization: Why Include Top-K in the Scaling Denominator?

  allenai/OLMoE#39 · Filter by author james-yw opened on Dec 8, 2025
  1

• StarCoder data

  allenai/OLMoE#38 · Filter by author Muennighoff opened on Nov 21, 2025
  2

• Why OpenWebMath in released dataset is larger than the size reported in Readme?

  allenai/OLMoE#36 · Filter by author LZY-the-boys opened on Aug 18, 2025
  1

• shell script running issue

  allenai/OLMoE#33 · Filter by author RealTapeL opened on Jun 3, 2025

• Dense counterpart and pretraining data for OLMo model

  allenai/OLMoE#32 · Filter by author aditi184 opened on May 1, 2025
  25

• Does the OLMoE model and its code support customizing the MoE routing mechanism for fine-tuning?

  allenai/OLMoE#30 · Filter by author fendi001 opened on Apr 5, 2025
  1

• Request for Official HF → OLMoE Checkpoint Conversion Script

  allenai/OLMoE#26 · Filter by author aditi184 opened on Mar 2, 2025
  14

• A question about eos_token_id

  allenai/OLMoE#25 · Filter by author Harry-Miral opened on Feb 28, 2025
  4

• Kind Request for Open-Sourcing Ablation Study Checkpoints

  allenai/OLMoE#24 · Filter by author MufanQiu opened on Feb 20, 2025
  16

• Time of tokenize data too long

  allenai/OLMoE#23 · Filter by author obananas opened on Feb 19, 2025
  2

• Is it possible to customize an MOE model configuration in the ablations directory and train it?

  allenai/OLMoE#22 · Filter by author BLZxiaopang opened on Feb 19, 2025
  1

• Failed to load dataset

  allenai/OLMoE#21 · Filter by author obananas opened on Feb 10, 2025
  3

  

• Tokenized dataset?

  allenai/OLMoE#10 · Filter by author joelburget opened on Sep 15, 2024
  4