Objectness mAP Evaluation for Custom Model

[abdul2706]

Hi, I wanted to evaluate my custom model using objectness mAP criteria rather than default coco mAP criteria. I tried to figure out the objectness evaluation criteria working, from the code in this repo, but it seems to be divided into multiple files, which is difficult for me to use in my implementation.

I wanted to request that if you could help me with either of the following, then I will be very thankful to you.

1. Please provide the objectness evaluation criteria as a single function (or file).
2. or, please guide me to compute it from the default coco evaluator.
3. or, kindly provide an algorithm to calculate it as an independent evaluation function.

Thanking you in advance.

[kheffah]

@abdul2706 Apologies for the delay in getting back to you. Well, this codebase does exactly that. It takes the coco evaluator and makes modifications in places where needed to allow the calculation of objectness AP. The simplest approach would be to simply make sure that both truth and your predictions are remapped so that they only have one class (nucleus), all before instantiating the coco evaluator. I can't remember all the nuances at the moment because did this a while back, but I think that's all you need actually.

[abdul2706]

@kheffah Thanks for providing helpful guildelines.