Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changes on tiktok side breaks user posts retreival (new signature?) #94

Open
vdemay opened this issue Nov 9, 2022 · 10 comments
Open

Changes on tiktok side breaks user posts retreival (new signature?) #94

vdemay opened this issue Nov 9, 2022 · 10 comments
Assignees
Labels
bug Something isn't working

Comments

@vdemay
Copy link

vdemay commented Nov 9, 2022

Get user videos does not work anymore probably due to a change on tiktok tt-parameter generation

How to reproduce:
1/ go to https://proxitok.pabloferreiro.es/@willsmith -> working because content has been captured while getting user info
2/ go to the bottom of the page and click Next -> Error

Actually I suppose the end point user/item_list needs a new signing method or new parameters to work properly.

@vdemay vdemay added the bug Something isn't working label Nov 9, 2022
@vdemay
Copy link
Author

vdemay commented Nov 9, 2022

Same ticket open here : carcabot/tiktok-signature#168

@pablouser1
Copy link
Owner

Fixed thanks to carcabot/tiktok-signature#168 (comment), thanks @carcabot!

If anyone reading this is a webmaster hosting ProxiTok, remember to also upgrade tiktok-signature/SignTok!

@pablouser1 pablouser1 unpinned this issue Nov 22, 2022
@vdemay
Copy link
Author

vdemay commented Nov 23, 2022

Hello,

Thanks for the update. But unfortunately, it still does not work.

I suppose the first page for willsmith account is now in cache so it display well. But if you try with another account it does not work.

Tiktok puts probably a short expiration time on one of the parameters of the request leading the fix of @carcabot to work only for a short period of time - see carcabot/tiktok-signature#168

This can also be useful - same issue - davidteather/TikTok-Api#974

Thanks for your work on this

@pablouser1 pablouser1 reopened this Nov 23, 2022
@pablouser1
Copy link
Owner

pablouser1 commented Nov 23, 2022

Thanks for the heads up, I'll check it out and implement it when I have time.

I suppose the first page for willsmith account is now in cache so it display well. But if you try with another account it does not work.

The first page is scraped from the html in order to save a request to the API, that's why the first page always works correctly.

@pablouser1
Copy link
Owner

pablouser1 commented Jan 25, 2023

Looks like changing the User Agent of the scraper to a smartphone (Mozilla/5.0 (Linux; Android 11; SAMSUNG SM-G973U) AppleWebKit/537.36 (KHTML, like Gecko) SamsungBrowser/14.2 Chrome/87.0.4280.141 Mobile Safari/537.36 is currently in use) helps.

Why? ¯\_(ツ)_/¯ I really don't know. I don't know if this will work with many requets, we'll see.

@NoPlagiarism
Copy link
Contributor

I guess, it's time to create /health endpoint? Or idk.

@LukeLR
Copy link

LukeLR commented Feb 14, 2023

In #126 I exposed the user_agent parameter of the TikScraper API as an environment variable. However, setting the value recommended by @pablouser1 there does not fix the 503 Error when clicking next on a user's page. Am I doing something wrong, or does this approach no longer work?

@desbest
Copy link

desbest commented Mar 1, 2023

Is there an update on this?

@SuperSonicHub1
Copy link

SuperSonicHub1 commented Jul 20, 2023

This is still a problem for me, both with ProxiTok and using TikScraper directly in a project for work. It seems errors with requesting stuff with a non-zero cursor can be overcome by reloading the page multiple times, albeit rarely.

@Sainttttttttttt
Copy link

I cant use it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

7 participants