The update method in the UCB algorithm is inconsistent with the paper and code

[kerala21]

Q(p) for each prompt in the UCB algorithm of the paper is updated to Q(p) + r/N(p),

The following table describes the project update code

def update(self, chosen, scores):

    for i, score in zip(chosen, scores):
        self.counts[i] += self.num_samples
        self.scores[i] += score * self.num_samples

Doesn't match

[donglixp]

The jpg file is unavailable.