agentlab.experiments.reproducibility_util
Functions
|
Append the info and results to the reproducibility journal. |
|
Make sure that the two info dicts are compatible. |
|
Retrieve a dict of information that could influence the reproducibility of an experiment. |
- agentlab.experiments.reproducibility_util.append_to_journal(info, report_df: DataFrame, journal_path=None, strict_reproducibility=True)
Append the info and results to the reproducibility journal.
- agentlab.experiments.reproducibility_util.assert_compatible(info: dict, old_info: dict, raise_if_incompatible=True)
Make sure that the two info dicts are compatible.
- agentlab.experiments.reproducibility_util.get_reproducibility_info(agent_names: str | list[str], benchmark: Benchmark, study_id: str = '', comment=None, changes_white_list=('*/reproducibility_script.py', '*reproducibility_journal.csv', '*main.py', '*inspect_results.ipynb'), ignore_changes=False, allow_bypass_benchmark_version=False)
Retrieve a dict of information that could influence the reproducibility of an experiment.