Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Standard method for rolling up taxa ranks #50

Open
mihow opened this issue Nov 20, 2024 · 0 comments
Open

Standard method for rolling up taxa ranks #50

mihow opened this issue Nov 20, 2024 · 0 comments

Comments

@mihow
Copy link
Collaborator

mihow commented Nov 20, 2024

Background: It would be more helpful if Antenna never shows low-confidence results (eg. "I am 0.01% certain this is a Spotted tussock moth"). Instead it's ideal if we keep rolling up to the next higher taxon rank until the confidence score is above a given threshold, until we can say "I am 60% certain this is in the family of Erebidae moths".

Find the method used in Fagner's evaluation code as a starting point.

If the calibrated softmax scores of a prediction are below a threshold, roll up all predictions for that image to the next taxon level, re-weight the scores and repeat until the top-1 prediction is above the threshold. Or use another method?

The inference API should return more in-depth data about each prediction.

Depends on #43

@mihow mihow changed the title Standard method for rolling up taxa levels Standard method for rolling up taxa ranks Jan 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant