Skip to content

Commit 892367a

Browse files
committed
feat: added steps to run benchmarking in comments
1 parent f405fc7 commit 892367a

File tree

2 files changed

+12
-0
lines changed

2 files changed

+12
-0
lines changed

.gitignore

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,3 +18,8 @@
1818
utils/reload/*.js
1919
utils/reload/injections/*.js
2020
public/manifest.json
21+
22+
# benchmarking
23+
/results
24+
tasks_test.jsonl
25+
webwand_test_log.txt

benchmark.py

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,10 @@
1+
"""
2+
To run benchmark testing, copy and paste corresponding test dataset from https://github.com/MinorJerry/WebVoyager/blob/main/data/WebVoyager_data.jsonl
3+
to the tasks_test.jsonl file.
4+
Then in terminal, first run "pnpm dev" to start the webwand server.
5+
Then run "python benchmark.py"
6+
"""
7+
18
import base64
29
import os
310
import json

0 commit comments

Comments
 (0)