Code

Evaluate subevents#43

Code

Merged

i-be-snek merged 66 commits intomainVUB-HYDR/Wikimpacts:mainfrom evaluate-subeventsVUB-HYDR/Wikimpacts:evaluate-subeventsCopy head branch name to clipboardJul 31, 2024

+1,490-137

Commits

Commits on Jul 30, 2024

• ✨ Add Event_ID decimal to UUID mapping

  Show description for 811da81
  i-be-snek

  committed
  811da81

  Copy full SHA for 811da81

• 📦️ Convert flat datatable to specific instances with short uuid Event_ID

  i-be-snek

  committed
  a0cefd2

  Copy full SHA for a0cefd2

• 📝 Fix docs + move to parent dir

  i-be-snek

  committed
  9cd8321

  Copy full SHA for 9cd8321

• 🐛 Parse columns named "Damage", not ending with "_Damage"

  i-be-snek

  committed
  9755dee

  Copy full SHA for 9755dee

• 🚨 Fix lint warnings + formatting

  i-be-snek

  committed
  9974bf4

  Copy full SHA for 9974bf4

• ♻️ Refactor location extraction return (tuple of empty lists, not single None)

  i-be-snek

  committed
  9f2cbf7

  Copy full SHA for 9f2cbf7

• ➕ Add pytest deps + init

  i-be-snek

  committed
  f2c196b

  Copy full SHA for f2c196b

• ✨ Add minimal specific instance matcher

  i-be-snek

  committed
  cb04871

  Copy full SHA for cb04871

• ✅ Add unit test for matcher

  i-be-snek

  committed
  b30fc7c

  Copy full SHA for b30fc7c

• ✅ Add negative example to unit test

  i-be-snek

  committed
  71d3901

  Copy full SHA for 71d3901

• 🍻 Add unfinished code

  i-be-snek

  committed
  04e0e57

  Copy full SHA for 04e0e57

• ⚡️ Calculate distance for matching subevents with Comparer

  i-be-snek

  committed
  ba283d9

  Copy full SHA for ba283d9

• ✨ Create matcher for specific instances

  i-be-snek

  committed
  8c4b527

  Copy full SHA for 8c4b527

• 🥅 Fail when column name is unsupported

  i-be-snek

  committed
  2eeec45

  Copy full SHA for 2eeec45

• ♻️ Fix imports

  i-be-snek

  committed
  a88cac5

  Copy full SHA for a88cac5

• ✅ Update similarity calculator test

  i-be-snek

  committed
  e911065

  Copy full SHA for e911065

• ✅ Update error handling for unsupported column names

  i-be-snek

  committed
  2ed2ea8

  Copy full SHA for 2ed2ea8

• ✅ Add test for specific instance matching functionality

  i-be-snek

  committed
  443ea01

  Copy full SHA for 443ea01

• 🔥 Remove debug code

  i-be-snek

  committed
  333a8a2

  Copy full SHA for 333a8a2

• ⚰️ Remove unnecessary del of var

  i-be-snek

  committed
  5b7dee7

  Copy full SHA for 5b7dee7

• ✅ Add example for testing matching and padding

  i-be-snek

  committed
  2b3181f

  Copy full SHA for 2b3181f

• ✅ Update similarity calc test with clearer param names

  i-be-snek

  committed
  6bc3eb6

  Copy full SHA for 6bc3eb6

• 🚨 Fix lint warning

  i-be-snek

  committed
  43b9ceb

  Copy full SHA for 43b9ceb

• 💬 Update column names -> shorter variation

  i-be-snek

  committed
  91135e0

  Copy full SHA for 91135e0

• 🐛 Preserve Event_ID when creating padding for specific instances

  i-be-snek

  committed
  0c9cfa1

  Copy full SHA for 0c9cfa1

• 🔊 Add logging

  i-be-snek

  committed
  6006616

  Copy full SHA for 6006616

• 🥅 Catch unsupported columns with warning

  i-be-snek

  committed
  0d77572

  Copy full SHA for 0d77572

• 🦺 Validate schema for specific instances when matching

  i-be-snek

  committed
  ad9e374

  Copy full SHA for ad9e374

• 🔥 Remove debug code

  i-be-snek

  committed
  33f527f

  Copy full SHA for 33f527f

• ✅ Update matcher test with exception case

  i-be-snek

  committed
  50e7001

  Copy full SHA for 50e7001

• 👷 Add CI workflow (testing eval scripts)

  i-be-snek

  committed
  0372d31

  Copy full SHA for 0372d31

• 🚚 More tests out of Evaluation dir

  i-be-snek

  committed
  483c087

  Copy full SHA for 483c087

• 🔧 Update pytest config

  i-be-snek

  committed
  372ac1b

  Copy full SHA for 372ac1b

• 💚 Fix tests path in ci workflow

  i-be-snek

  committed
  6572c4a

  Copy full SHA for 6572c4a

• 🐛 Fix modulenotfound error

  i-be-snek

  committed
  9d68f34

  Copy full SHA for 9d68f34

• Revert "🐛 Fix modulenotfound error"

  Show description for 95a255a
  i-be-snek

  committed
  95a255a

  Copy full SHA for 95a255a

• 🔧 Update pytest configs to fix relative imports

  i-be-snek

  committed
  1c5f8c8

  Copy full SHA for 1c5f8c8

• ⚗️ Experiment with relative import .module

  i-be-snek

  committed
  8cd1abf

  Copy full SHA for 8cd1abf

• ⚗ Experiment with relative import ..module

  i-be-snek

  committed
  aabc1f0

  Copy full SHA for aabc1f0

• ⏪️ Revert to original, correct import

  i-be-snek

  committed
  62893b1

  Copy full SHA for 62893b1

• ⚡️ Fix module imports for Evaluation and Database/scr packages

  i-be-snek

  committed
  ad75a53

  Copy full SHA for ad75a53

• ➕ Add spacy[transformers] dep

  i-be-snek

  committed
  7af86c0

  Copy full SHA for 7af86c0

• 🧑‍💻 Set pythonpath for pytest

  i-be-snek

  committed
  f3ea9b3

  Copy full SHA for f3ea9b3

• 🔧 Fix syntax error in pytest config

  i-be-snek

  committed
  1b54090

  Copy full SHA for 1b54090

• 🚧 WIP: adapt evaluation script to subevent evaluation

  i-be-snek

  committed
  337fb3c

  Copy full SHA for 337fb3c

• 📝 Remove outdated todo boxes + lint

  i-be-snek

  committed
  f5cb803

  Copy full SHA for f5cb803

• 🐛 Fix small bugs in matcher

  Show description for 0530a20
  i-be-snek

  committed
  0530a20

  Copy full SHA for 0530a20

• 🧑‍💻 Improve error message informativeness & readability

  i-be-snek

  committed
  a3c4c9d

  Copy full SHA for a3c4c9d

• 🐛 Fix bug that creates excess event pairs

  i-be-snek

  committed
  9a77711

  Copy full SHA for 9a77711

• ✨ Specific instances sorted by Evnet_ID + num

  i-be-snek

  committed
  71f331d

  Copy full SHA for 71f331d

• 🐛 Handle bug in scoring similarity between specific instances

  i-be-snek

  committed
  5058679

  Copy full SHA for 5058679

• 🔧 Reduce null penalty for comparer when matching specific instances

  i-be-snek

  committed
  0df2762

  Copy full SHA for 0df2762

• ✅ Update tests with threshold + null_penalty

  i-be-snek

  committed
  34197b8

  Copy full SHA for 34197b8

• ✅ Update test with None example (to test null penalty)

  i-be-snek

  committed
  28e33cb

  Copy full SHA for 28e33cb

• ♻️ Allow passing null_penalty into matcher

  i-be-snek

  committed
  5735055

  Copy full SHA for 5735055

• 🚨 Fix lint errors

  i-be-snek

  committed
  dd937ef

  Copy full SHA for dd937ef

• ✨ Support empty sys_list or gold_list when no specific instances are found for an event_id

  i-be-snek

  committed
  eca9b6d

  Copy full SHA for eca9b6d

• ✅ Update tests to cover cases of empty gold_list/sys_list

  i-be-snek

  committed
  ce6769b

  Copy full SHA for ce6769b

• ✨ Evaluate sub-events (specific instances)

  i-be-snek

  committed
  abf1e37

  Copy full SHA for abf1e37

• 📝 Update docs on how to evaluate subevents

  i-be-snek

  committed
  ca3fbb3

  Copy full SHA for ca3fbb3

• ✨ Add average error rate for specific instances grouped by event_id

  i-be-snek

  committed
  75a0ad9

  Copy full SHA for 75a0ad9

• 📝 Update docs with info on eval results for specific instances

  i-be-snek

  committed
  026534b

  Copy full SHA for 026534b

• 📦️ Add dummy files for sys/gold for specific instance eval

  i-be-snek

  committed
  6fa7fcb

  Copy full SHA for 6fa7fcb

• 🔥 Remove dead files

  i-be-snek

  committed
  be57029

  Copy full SHA for be57029

• ⚡️ Match events based on similarity matrix (not in linear order)

  i-be-snek

  committed
  b4cd571

  Copy full SHA for b4cd571

• ✅ Update expected test output (due to change in final indexing of matched events)

  i-be-snek

  committed
  94b9cd9

  Copy full SHA for 94b9cd9