Skip to content

Editing Evaluation, Reproducibility, Benchmarks Meeting 37

Nicholas Heller edited this page Jul 16, 2025 · 1 revision

Minutes of Meeting 37

Date: 16th July, 2025

Present

  • Carole
  • Olivier
  • Nick
  • Michela
  • Lena
  • Nicola
  • Annika
  • Anne

Update From Advisory Board Meeting

  • We need to give a brief (5 min) presentation to the board
    • The second Tuesday of August (12th)

Presentation At MONAI Advisory Board

  • Michela will provide a single slide about data efforts
  • Could we integrate the probability of false claims formula into MONAI? Carole is happy to
    • Will be online soon, can talk about this in the presentation
    • Clarification: This tool is used to estimate p-value in case where we don't have the results on individual data. If a person has their own data from their own model, they would be better served by a different formula
    • It would be better to have an implementation for the case when the raw data is available as well

Individual Who Would Like to Join The Group

  • This was an applicant to Lena/Annika's group
  • We don't currently have a process for people joining the group
  • We should come up with something
    • Letter of intent
    • CV
    • Chat with the board to discuss
  • Does MONAI have a policy on how people can join? Not that we're aware of
  • Other working groups mention on their websites for people to join their meetings, but don't tell you how
  • Is there anything we can do to increase the diversity of this group? We are primarily Europe and North America
    • Could we send out a call for people specifically mentioning other regions?
    • We tried this with the SIG for challenges and it was not very successful

Preliminary Results from Detective Project

  • Most challenges (tasks) did not have a clear license
  • Many licenses are used incorrectly/in contradictory ways

Next Meeting

  • Off on August for summer break
  • Will coordinate via email for presentation and other action items
  • Move next meeting to week of September 15th to avoid scheduling over MICCAI
  • MONAI Tech days are Sep 16-17
  • Anne Mickan will be out for about 6 months beginning in ~Oct
Clone this wiki locally