Skip to content

Add Grok 4.6 to live bench - #5

Open
anthonypizzolato-abacus wants to merge 1 commit into
mainfrom
add-grok-4-6
Open

anthonypizzolato-abacus wants to merge 1 commit into
mainfrom
add-grok-4-6

Conversation

@anthonypizzolato-abacus

Copy link
Copy Markdown

Adds Grok 4.6 (xAI) to the live bench, mirroring the DeepSeekAPI first-party pattern:

  • lcb_runner/lm_styles.py — new LMStyle.XAIAPI; LanguageModel("grok-4.6", "Grok-4.6", LMStyle.XAIAPI, datetime(2026, 8, 12), link="https://docs.x.ai/developers/grok-4-6") appended to LanguageModelList
  • lcb_runner/runner/xai_runner.py — new XAIRunner (OpenAI client, XAI_API env key, base_url https://api.x.ai/v1), mirroring DeepSeekRunner
  • lcb_runner/runner/runner_utils.pybuild_runner branch for LMStyle.XAIAPI
  • lcb_runner/prompts/code_generation.pyXAIAPI added to the generic-chat-prompt style list ([LMStyle.OpenAIChat, LMStyle.DeepSeekAPI, LMStyle.XAIAPI])

Model facts (official docs, https://docs.x.ai/developers/grok-4-6):

  • Provider API ID: grok-4.6 (xAI first-party, OpenAI-compatible)
  • Context window: 500,000 tokens
  • Released: 2026-08-12

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant