https://blogs.gentoo.org/ago/2020/07/04/gentoo-tinderbox/ Issue: sci-libs/evaluate-0.4.0-r2 fails tests. Discovered on: amd64 (internal ref: ci)
Created attachment 861896 [details] build.log build log and emerge --info
Error(s) that match a know pattern: "Connection error, and we cannot find the requested files in" ConnectionError: in case of unreachable url E ConnectionError: Couldn't reach 'beans' on the Hub (ConnectionError) E ConnectionError: Couldn't reach 'evaluate/conll2003-ci' on the Hub (ConnectionError) E ConnectionError: Couldn't reach 'evaluate/imdb-ci' on the Hub (ConnectionError) E ConnectionError: Couldn't reach 'evaluate/squad-ci' on the Hub (ConnectionError) E ConnectionError: Couldn't reach https://github.com/tensorflow/nmt/raw/master/nmt/scripts/bleu.py (ConnectionError(MaxRetryError('HTTPSConnectionPool(host=\'github.com\', port=443): Max retries exceeded with url: /tensorflow/nmt/raw/master/nmt/scripts/bleu.py (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f63e38a7890>: Failed to resolve \'github.com\' ([Errno -3] Temporary failure in name resolution)"))'))) E ConnectionError: Couldn't reach https://huggingface.co/spaces/evaluate-metric/bleu/resolve/v0.4.0/bleu.py (ConnectionError(MaxRetryError('HTTPSConnectionPool(host=\'huggingface.co\', port=443): Max retries exceeded with url: /spaces/evaluate-metric/bleu/resolve/v0.4.0/bleu.py (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f63e3988210>: Failed to resolve \'huggingface.co\' ([Errno -3] Temporary failure in name resolution)"))'))) E ConnectionError: Couldn't reach https://huggingface.co/spaces/evaluate-metric/squad_v2/resolve/v0.4.0/squad_v2.py (ConnectionError(MaxRetryError('HTTPSConnectionPool(host=\'huggingface.co\', port=443): Max retries exceeded with url: /spaces/evaluate-metric/squad_v2/resolve/v0.4.0/squad_v2.py (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f63e2fd93d0>: Failed to resolve \'huggingface.co\' ([Errno -3] Temporary failure in name resolution)"))'))) E ConnectionError: Couldn't reach https://huggingface.co/spaces/lvwerra/test/resolve/v0.4.0/test.py (ConnectionError(MaxRetryError('HTTPSConnectionPool(host=\'huggingface.co\', port=443): Max retries exceeded with url: /spaces/lvwerra/test/resolve/v0.4.0/test.py (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f63e365c850>: Failed to resolve \'huggingface.co\' ([Errno -3] Temporary failure in name resolution)"))'))) E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/accuracy/accuracy.py. Module 'accuracy' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/bleu/bleu.py. Module 'bleu' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/cer/cer.py. Module 'cer' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/evaluate/evaluation-suite-ci/evaluation-suite-ci.py. Module 'evaluate/evaluation-suite-ci' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/f1/f1.py. Module 'f1' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/lvwerra/test/test.py. Module 'lvwerra/test' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/seqeval/seqeval.py. Module 'seqeval' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/squad/squad.py. Module 'squad' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/wer/wer.py. Module 'wer' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: Couldn't find a module script at /var/tmp/portage/sci-libs/evaluate-0.4.0-r2/work/evaluate-0.4.0/word_count/word_count.py. Module 'word_count' doesn't exist on the Hugging Face Hub either. E FileNotFoundError: [Errno 2] No such file or directory: '/var/tmp/portage/sci-libs/evaluate-0.4.0-r2/temp/tmpmlcj6wvaevaluator_trainer_parity_test/transformers' E FileNotFoundError: [Errno 2] No such file or directory: '/var/tmp/portage/sci-libs/evaluate-0.4.0-r2/temp/tmpzee1xoplevaluator_trainer_parity_test/transformers' E huggingface_hub.utils._errors.LocalEntryNotFoundError: Connection error, and we cannot find the requested files in the disk cache. Please try again or make sure your Internet connection is on. E OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like hf-internal-testing/tiny-random-bert is not the path to a directory containing a file named config.json. E OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like lysandre/tiny-vit-random is not the path to a directory containing a file named config.json. E OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like moussaKam/frugalscore_tiny_bert-base_bert-score is not the path to a directory containing a file named config.json. err_msg = 'No such file or directory' errpipe_data = bytearray(b'OSError:2:noexec') E urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name resolution> except ChildProcessError: except ConnectionError: except LocalEntryNotFoundError: except RepositoryNotFoundError: except RevisionNotFoundError: except ValueError: exc_msg = ("OSError: We couldn't connect to 'https://huggingface.co' to load this file, " exc_msg = ("OSError: We couldn't connect to 'https://huggingface.co' to load this file, " exc_msg = ('urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name ' exc_msg = ('urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name ' FAILED tests/test_evaluation_suite.py::TestEvaluationSuite::test_empty_suite FAILED tests/test_evaluation_suite.py::TestEvaluationSuite::test_running_evaluation_suite FAILED tests/test_evaluator.py::TestAutomaticSpeechRecognitionEvaluator::test_class_init FAILED tests/test_evaluator.py::TestAutomaticSpeechRecognitionEvaluator::test_overwrite_default_metric FAILED tests/test_evaluator.py::TestAutomaticSpeechRecognitionEvaluator::test_pipe_init FAILED tests/test_evaluator.py::TestEvaluator::test_device_placement - OSErro... FAILED tests/test_evaluator.py::TestEvaluator::test_model_init - OSError: We ... FAILED tests/test_evaluator.py::TestEvaluator::test_model_str_init - OSError:... FAILED tests/test_evaluator.py::TestEvaluator::test_pipe_init - OSError: We c... FAILED tests/test_evaluator.py::TestEvaluator::test_wrong_task - OSError: We ... FAILED tests/test_evaluator.py::TestImageClassificationEvaluator::test_class_init FAILED tests/test_evaluator.py::TestImageClassificationEvaluator::test_overwrite_default_metric FAILED tests/test_evaluator.py::TestImageClassificationEvaluator::test_pipe_init FAILED tests/test_evaluator.py::TestQuestionAnsweringEvaluator::test_class_init FAILED tests/test_evaluator.py::TestQuestionAnsweringEvaluator::test_data_loading FAILED tests/test_evaluator.py::TestQuestionAnsweringEvaluator::test_overwrite_default_metric FAILED tests/test_evaluator.py::TestQuestionAnsweringEvaluator::test_pipe_init FAILED tests/test_evaluator.py::TestText2TextGenerationEvaluator::test_class_init FAILED tests/test_evaluator.py::TestText2TextGenerationEvaluator::test_pipe_init FAILED tests/test_evaluator.py::TestText2TextGenerationEvaluator::test_translation FAILED tests/test_evaluator.py::TestTextClassificationEvaluator::test_class_init FAILED tests/test_evaluator.py::TestTextClassificationEvaluator::test_data_loading FAILED tests/test_evaluator.py::TestTextClassificationEvaluator::test_overwrite_default_metric FAILED tests/test_evaluator.py::TestTextClassificationEvaluator::test_perf - ... FAILED tests/test_evaluator.py::TestTextClassificationEvaluator::test_pipe_init FAILED tests/test_evaluator.py::TestTextClassificationEvaluatorTwoColumns::test_pipe_init FAILED tests/test_evaluator.py::TestTextGenerationEvaluator::test_class_init FAILED tests/test_evaluator.py::TestTokenClassificationEvaluator::test_class_init FAILED tests/test_evaluator.py::TestTokenClassificationEvaluator::test_data_loading FAILED tests/test_evaluator.py::TestTokenClassificationEvaluator::test_overwrite_default_metric FAILED tests/test_load.py::ModuleFactoryTest::test_cache_with_remote_canonical_module FAILED tests/test_load.py::ModuleFactoryTest::test_cache_with_remote_community_module FAILED tests/test_load.py::ModuleFactoryTest::test_HubEvaluationModuleFactory_with_external_import FAILED tests/test_load.py::ModuleFactoryTest::test_HubEvaluationModuleFactory_with_internal_import FAILED tests/test_load.py::ModuleFactoryTest::test_HubEvaluationModuleFactoryWithScript FAILED tests/test_metric_common.py::LocalModuleTest::test_load_measurement_honest FAILED tests/test_metric_common.py::LocalModuleTest::test_load_metric_bleu - ... FAILED tests/test_metric_common.py::LocalModuleTest::test_load_metric_frugalscore FAILED tests/test_metric.py::TestEvaluationcombined_evaluation::test_modules_from_string FAILED tests/test_trainer_evaluator_parity.py::TestEvaluatorTrainerParity::test_image_classification_parity FAILED tests/test_trainer_evaluator_parity.py::TestEvaluatorTrainerParity::test_question_answering_parity FAILED tests/test_trainer_evaluator_parity.py::TestEvaluatorTrainerParity::test_text_classification_parity FAILURE = 1 fatal: unable to access 'https://github.com/huggingface/transformers/': Could not resolve host: github.com FileNotFoundError: in case of non-recoverable file 'huggingface_hub.utils._errors.LocalEntryNotFoundError: Connection error, and ' "OSError: We couldn't connect to 'https://huggingface.co' to load this file, " 'urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name ' 'we cannot find the requested files in the disk cache. Please try again or ' 'socket.gaierror: [Errno -3] Temporary failure in name resolution\n'
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=bde90d926e277b7ea59c487e38559c3a6813edd6 commit bde90d926e277b7ea59c487e38559c3a6813edd6 Author: Alfredo Tupone <tupone@gentoo.org> AuthorDate: 2023-05-20 14:09:13 +0000 Commit: Alfredo Tupone <tupone@gentoo.org> CommitDate: 2023-05-20 14:10:25 +0000 sci-libs/evaluate: skip tests that require network access Closes: https://bugs.gentoo.org/906681 Signed-off-by: Alfredo Tupone <tupone@gentoo.org> sci-libs/evaluate/evaluate-0.4.0-r2.ebuild | 1 + sci-libs/evaluate/files/evaluate-0.4.0-tests.patch | 198 ++++++++++++++++++--- 2 files changed, 176 insertions(+), 23 deletions(-)
