Usage

Install the terminal-bench CLI

uv tool install terminal-bench

Run the benchmark

tb run \
  --dataset-name terminal-bench-core \
  --dataset-version head \
  --agent terminus \
  --model-name anthropic/claude-3-7-sonnet-latest \
  --livestream \
  --task-id sympy__sympy-18189

New to terminal-bench? See our quickstart guide.

Instructions

diophantine: incomplete results depending on syms order with permute=True ``` In [10]: diophantine(n**4 + m**4 - 2**4 - 3**4, syms=(m,n), permute=True) Out[10]: {(-3, -2), (-3, 2), (-2, -3), (-2, 3), (2, -3), (2, 3), (3, -2), (3, 2)} In [11]: diophantine(n**4 + m**4 - 2**4 - 3**4, syms=(n,m), permute=True) Out[11]: {(3, 2)} ``` diophantine: incomplete results depending on syms order with permute=True ``` In [10]: diophantine(n**4 + m**4 - 2**4 - 3**4, syms=(m,n), permute=True) Out[10]: {(-3, -2), (-3, 2), (-2, -3), (-2, 3), (2, -3), (2, 3), (3, -2), (3, 2)} In [11]: diophantine(n**4 + m**4 - 2**4 - 3**4, syms=(n,m), permute=True) Out[11]: {(3, 2)} ```

Tags

debugging, swe-bench