All pull requests

Pull requests

• Add opt-in binary Bayes@N evaluation summaries

  #322·mohsenhariri opened Oct 20, 2026·

  ·
  1

• docs: clarify OpenAI-compatible endpoint configuration

  #321·lakshya-dhariwal opened Oct 1, 2026·

  ·
  1

  1

• fix(data): honor HumanEval+ version when loading and hashing

  #316·JianYan11 opened Sep 10, 2026·

  ·

• feat(mbpp): add cross-family-validated FP-hardening subset of MBPP+ plus tests

  #310·toffee-desuwa opened Jul 14, 2026·

  ·

• fix: detect return-value deception via dunder override (same exploit class as HumanEval)

  #306·AUTHENSOR opened Jul 14, 2026·3 tasks done·

  ·

• Fix timeout parsing and add bounded Ollama generation controls

  #303·jamesjennens opened Jul 4, 2026·

  ·

• Fix input_tokens assignment for device transfer

  #298·Seas0 opened Apr 15, 2026·

  ·
  1

• Change EOS to a list in base.py

  #290·m0radt opened Oct 24, 2025Contributor·

  ·

• Add support for Ollama, Palm, Claude-2, Cohere, Replicate Llama2, CodeLlama, Hugging Face (100+LLMs) - using LiteLLM

  #25·ishaan-jaff opened Oct 5, 2023·

  ·
  2