Skip to content

Releases: autogluon/fev

v0.3.1

05 Mar 20:02
e6f78cc
Compare
Choose a tag to compare

Changes:

  • Rerun evaluations using the latest version of datasets on Hugging Face (v1.3.0). This includes the fix to the frequency of the monash_hospital and dominick datasets
  • Remove monash_saugeenday dataset to fix the discrepancy between the Chronos paper and the leaderboard
  • Include results for TimesFM-2.0
  • Make the error message caused by dataset fingerprint mismatch more informative

Full Changelog: v0.3.0...v0.3.1

v0.3.0

17 Dec 15:39
Compare
Choose a tag to compare

Changes:

  • Add method fev.utils.convert_long_df_to_hf_dataset for converting long format pd.DataFrame datasets to Hugging Face datasets.Dataset format
  • Extend documentation for datasets, tasks, benchmarks and models

Full Changelog: v0.2.1...v0.3.0

v0.2.1

13 Dec 21:57
Compare
Choose a tag to compare

Changes:

  • Remove harmonic mean aggregation from fev.analysis.leaderboard()

Full Changelog: v0.2.0...v0.2.1

v0.2.0

12 Dec 15:58
Compare
Choose a tag to compare

Changes:

  • Add a new column trained_on_this_dataset to the evaluation summary that tracks whether the model is used in zero-shot mode
  • Support new input formats for leaderboard() and pivot_table() methods

Full Changelog: v0.1.0...v0.2.0

v0.1.0

09 Dec 15:11
Compare
Choose a tag to compare

Initial release