medcat.utils.regression.regression_checker

Module Contents

Functions

main(model_pack_dir, test_suite_file[, total, ...])

Check test suite against the specifeid model pack.

Attributes

logger

parser

medcat.utils.regression.regression_checker.logger
medcat.utils.regression.regression_checker.main(model_pack_dir, test_suite_file, total=None, phrases=False, hide_empty=False, hide_failures=False, jsonpath=None, overwrite=False, jsonindent=None)

Check test suite against the specifeid model pack.

Parameters:

  • model_pack_dir (Path) – The path to the model pack

  • test_suite_file (Path) – The path to the test suite YAML

  • total (Optional[int]) – The total number of (sub)cases to be tested (for progress bar)

  • phrases (bool) – Whether to show per-phrase information in a report

  • hide_empty (bool) – Whether to hide empty cases in a report

  • hide_failures (bool) – Whether to hide failures in a report

  • jsonpath (Optional[Path]) – The json path to save the report to (if specified)

  • overwrite (bool) – Whether to overwrite the file if it exists. Defaults to False

  • jsonindent (int) – The indentation for json objects. Defaults to 0

Raises:

ValueError – If unable to overwrite file or folder does not exist.

Return type:

None

medcat.utils.regression.regression_checker.parser