Search results

Feasible-task evaluators return reward=1 without verifying the task was done (loose substring matching, no causation/delta check)

Status: Open.

#518 In xlang-ai/OSWorld;

· JeffPengCoder opened on Jun 6, 2026

Pixel-blind CLI agent scores 77.9% on OSWorld test_all (vs 64.3% vision) — sharing a CLI baseline + intent-aware judge

Status: Open.

#517 In xlang-ai/OSWorld;

· Wanli-Lee opened on Jun 6, 2026

Guest VM shows a Snap Store "software updates available" popup on reset, derailing screenshot agents

Status: Open.

#515 In xlang-ai/OSWorld;

· JeffPengCoder opened on Jun 5, 2026

Proposal: trace diagnostics for computer-use agent failures

Status: Open.

#514 In xlang-ai/OSWorld;

· lucasagudiez opened on Jun 4, 2026

Container starts but Chrome DevTools port returns 400, even with clean happysixd/osworld-docker image and verified proxy

Status: Open.

#495 In xlang-ai/OSWorld;

· LYXFOREVER opened on Apr 26, 2026

Make OSWorld a native benchmark on Hugging Face

Status: Open.

#489 In xlang-ai/OSWorld;

· NielsRogge opened on Apr 22, 2026

[Bug] Non-deterministic test_suite.py causes flaky scoring in check_python_file_by_test_suite tasks

Status: Open.

#487 In xlang-ai/OSWorld;

· KosmoCHE opened on Apr 11, 2026

Cleanup fails to write result.txt when container connection is lost

Status: Open.

#484 In xlang-ai/OSWorld;

· roeex5 opened on Apr 9, 2026

Evaluator crashes with PIL error when validating GIF output

Status: Open.

#483 In xlang-ai/OSWorld;

· roeex5 opened on Apr 9, 2026

Evaluator crashes with NoneType error on LibreOffice Writer formatting tasks

Status: Open.

#482 In xlang-ai/OSWorld;

· roeex5 opened on Apr 9, 2026

Evaluator crashes with ValueError on relative dates crossing year boundaries

Status: Open.

#481 In xlang-ai/OSWorld;

· roeex5 opened on Apr 9, 2026

阿里云配置有问题

Status: Open.

#480 In xlang-ai/OSWorld;

· gitGurugu opened on Apr 9, 2026