Merge pull request #17 from nttcslab/2024t2/v3.x.x

Fixed test scripts using evaluation data

Author: noboru2000

02a_test_2024t2.sh

@@ -31,8 +31,17 @@ then
     dataset_list="DCASE2024T2bearing DCASE2024T2fan DCASE2024T2gearbox DCASE2024T2slider DCASE2024T2ToyCar DCASE2024T2ToyTrain DCASE2024T2valve"
 elif [ "${dev_eval}" = "-e" ] || [ "${dev_eval}" = "--eval" ]
 then
-    echo eval data has not been published yet.
-    exit 1
+    dataset_list="\
+        DCASE2024T23DPrinter \
+        DCASE2024T2AirCompressor \
+        DCASE2024T2Scanner \
+        DCASE2024T2ToyCircuit \
+        DCASE2024T2HoveringDrone \
+        DCASE2024T2HairDryer \
+        DCASE2024T2ToothBrush \
+        DCASE2024T2RoboticArm \
+        DCASE2024T2BrushlessMotor \
+    "
 fi
 
 for dataset in $dataset_list; do

02b_test_2024t2.sh

@@ -31,8 +31,17 @@ then
     dataset_list="DCASE2024T2bearing DCASE2024T2fan DCASE2024T2gearbox DCASE2024T2slider DCASE2024T2ToyCar DCASE2024T2ToyTrain DCASE2024T2valve"
 elif [ "${dev_eval}" = "-e" ] || [ "${dev_eval}" = "--eval" ]
 then
-    echo eval data has not been published yet.
-    exit 1
+    dataset_list="\
+        DCASE2024T23DPrinter \
+        DCASE2024T2AirCompressor \
+        DCASE2024T2Scanner \
+        DCASE2024T2ToyCircuit \
+        DCASE2024T2HoveringDrone \
+        DCASE2024T2HairDryer \
+        DCASE2024T2ToothBrush \
+        DCASE2024T2RoboticArm \
+        DCASE2024T2BrushlessMotor \
+    "
 fi
 
 for dataset in $dataset_list; do

README.md

@@ -38,6 +38,9 @@ This system consists of three main scripts (01_train.sh, 02a_test.sh, and 02b_te
     - This script makes a CSV file for each section, including the anomaly scores for each WAV file in the directories `data/dcase2024t2/dev_data/raw/<machine_type>/test/`.
     - The CSV files will be stored in the directory `results/`.
     - It also makes a csv file including AUC, pAUC, precision, recall, and F1-score for each section.
+  - "Evaluation" mode: **Newly added!!**
+    - This script makes a CSV file for each section, including the anomaly scores for each wav file in the directories `data/dcase2024t2/eval_data/raw/<machine_type>/test/`. (These directories will be made available with the "evaluation dataset".)
+    - The CSV files are stored in the directory `results/`.
 
 - 02b_test_2024t2.sh (Use Mahalanobis distance as a score function for the Selective Mahalanobis mode)
   - "Development" mode:
@@ -294,11 +297,17 @@ We developed and tested the source code on Ubuntu 20.04.4 LTS.
 - fasteners == 0.18
 
 ## Change Log
+### [3.2.2](https://github.com/nttcslab/dcase2023_task2_baseline_ae/releases/tag/v3.2.2)
+
+#### Fixed test script
+
+- Updated to fix issues in 02a_test_2024t2.sh and 02b_test_2024t2.sh.
+
 ### [3.2.1](https://github.com/nttcslab/dcase2023_task2_baseline_ae/releases/tag/v3.2.1)
 
 #### Fixed download shell script
 
-- The URL to download DCASE2024T2 Evaluation dataset was incorrect, so I fixed data_download_2024eval.sh.
+- The URL to download DCASE2024T2 Evaluation dataset was incorrect. Updated to fix issues in data_download_2024eval.sh.
 
 ### [3.2.0](https://github.com/nttcslab/dcase2023_task2_baseline_ae/releases/tag/v3.2.0)