Warning on nonexistent datasets + fix for requirements (black) (#684)

* fix: raise error on nonexistent datasets

* style: run linters

* fix: warn instead of returning

* fix: `logger` -> `logging`

* style: run linter

* chore: fix typo

* fix: specify subset name if possible

* Update promptsource/templates.py

* quick fix for the tests (black dependency)

Co-authored-by: Victor SANH <victorsanh@gmail.com>

Author: jaketae

promptsource/templates.py

@@ -1,3 +1,4 @@
+import logging
 import os
 import random
 import uuid
@@ -361,6 +362,11 @@ def read_from_file(self) -> Dict:
         """
 
         if not os.path.exists(self.yaml_path):
+            dataset_name = f"{self.dataset_name} {self.subset_name}" if self.subset_name else self.dataset_name
+            logging.warning(
+                f"Tried instantiating `DatasetTemplates` for {dataset_name}, but no prompts found. "
+                "Please ignore this warning if you are creating new prompts for this dataset."
+            )
             return {}
         yaml_dict = yaml.load(open(self.yaml_path, "r"), Loader=yaml.FullLoader)
         return yaml_dict[self.TEMPLATES_KEY]

requirements.txt

@@ -1,4 +1,4 @@
-black
+black<=21.12b0
 datasets>=1.7.0
 flake8
 isort==5.8.0