support multilabel confusion matrix

[0ssamaak0]

using sklearn multilabel_confusion_matrix

sample usage:

confusion_metric  = evaluate.load("confusion_matrix", config_name="multilabel")


y_true= np.array([[0, 0, 0, 0, 1], [1, 0, 1, 0, 0], [0, 0, 1, 0, 1], [1, 0, 0, 0, 0]])
y_pred= np.array([[0, 1, 0, 0, 1], [0, 0, 1, 0, 0], [0, 0, 1, 1, 1], [1, 0, 1, 0, 1]])

confusion_metric.compute(references= y_true, predictions= y_pred)

output:

{'confusion_matrix': array([[[2, 0],
         [1, 1]],
 
        [[3, 1],
         [0, 0]],
 
        [[1, 1],
         [0, 2]],
 
        [[3, 1],
         [0, 0]],
 
        [[1, 1],
         [0, 2]]])}

[0ssamaak0]

@lvwerra

[lvwerra]

Thanks for the PR, added a few small comments!

[0ssamaak0]

There was a problem with file formatting, I reformatted it and comitted the new code

[0ssamaak0]

There's an error in tests, I can't understand it, it seems to be unrelated with the code 😅 sorry for inconvenience

[osanseviero]

Overall LGTM, but I wonder if it should be a separate metric to keep 1:1 mapping to sklearn

[0ssamaak0]

Overall LGTM, but I wonder if it should be a separate metric to keep 1:1 mapping to sklearn

I'm not sure 100% what is the optimal way, but I think the main idea behind evaluate is to be an abstraction.

anyway, if you think if it's better to be in a seperate module I can do it.

thank you ☺️

[0ssamaak0]

@osanseviero will you accept the request? I've done the suggested edites

[0ssamaak0]

thanks for rerunning the workflow, but I don't understand what's the problem 😬

[0ssamaak0]

I fixed the problem in docstring example that causes unit test failure, can you run the test and merge please? @lvwerra
thank you