Opt: refector tag list pagination support

[njucjc]

Not need to list all tag in paging.

[milosgajdos]

Can you please describe in detail what is it you are trying to accomplish with this PR.

[njucjc]

Can you please describe in detail what is it you are trying to accomplish with this PR.

@milosgajdos #4315 (reply in thread)

According to this discussion, it's not necessary to load all tags to memory in pagination case.

[milosgajdos]

yeah that's not been released yet

[njucjc]

yeah that's not been released yet

Yeah, maybe we shall wait until a new stable release is cut

[njucjc]

yeah that's not been released yet

@milosgajdos
This PR can be executed in two stages:

1. to optimize the tag list pagination. I propose transitioning from loading all tags simultaneously into memory to a mechanism that leverages the last parameter for pagination. This method will start querying from the last fetched item, reducing memory load. This optimization will yield benefits when pagination parameters are specified. I think this stage could merge to upstream firstly.
2. after the release of a new version of the distribution-spec, we plan to expand the maximum page size allowed for pagination. This enhancement aims to prepare for future scalability needs.

I will submit another PR to complete the first stage.