Skip to content

adds uncertainty sampling #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Conversation

naxatra2
Copy link

@naxatra2 naxatra2 commented Jun 4, 2025

Adds #13

This PR adds uncertainty sampling and Query by Committee (QBC) method for sampling images. Both of them have a very basic implementation as of now. I am planning to add more sampling techniques and improve the ones already present.

@naxatra2
Copy link
Author

naxatra2 commented Jun 6, 2025

I used binary-focused uncertainty rather than multi-class methods (like entropy sampling) since:

Our model outputs single confidence scores, not multi-class probabilities. But I am confused on whether I should also add the multi-class functionalities. Binary margin sampling is computationally efficient and better for our use case.

Entropy sampling would yield nearly identical results for binary classification but it will add unnecessary complexity
The most uncertain samples (scores closest to 0.5) get prioritized for annotation, which should help improve model performance around the decision boundary where it's currently struggling.

I am currently also exploring a new sampling technique "MC Dropout"

@bw4sz
Copy link
Collaborator

bw4sz commented Jun 6, 2025

This is great, and I welcome it. But to be clear, the GSOC project should contribute to the DeepForest repo, but maybe you are just also adding this. The BOEM repo isn't really ready for outside use, the data comes from internal, the tests aren't stable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants