TikTokApi response breaks tool

[GalenReich]

The TikTok API initially returns a Warning, and then Errors with an unexpected status code 10201, resulting in no posts found:

2024-02-19 11:22:02 WARNING | Encountered error None -> TikTok returned an empty response when fetching data, retrying in headed mode

2024-02-19 11:22:12,695 - TikTokApi.tiktok - ERROR - Got an unexpected status code: {'log_pb': {'impr_id': '###'}, 'statusCode': 10201, 'statusMsg': '', 'status_code': 10201, 'status_msg': ''}

2024-02-19 11:22:12,695 - TikTokApi.tiktok - ERROR - Got an unexpected status code: {'log_pb': {'impr_id': '###'}, 'statusCode': 10201, 'statusMsg': '', 'status_code': 10201, 'status_msg': ''}

2024-02-19 11:22:12 ERROR | Got an unexpected status code: {'log_pb': {'impr_id': '###'}, 'statusCode': 10201, 'statusMsg': '', 'status_code': 10201, 'status_msg': ''}

2024-02-19 11:22:12 WARNING | No posts were found for the hashtag: winter

2024-02-19 11:22:12 INFO | Scraped 0 new posts containing the hashtag 'winter', with 0 posts previously scraped

The None -> TikTok returned an empty response error is discussed variously here: davidteather/TikTok-Api#1090 davidteather/TikTok-Api#1097 davidteather/TikTok-Api#1104

Error 10201 is discussed here and may be "invalid entity or invalid parameter". Another post suggests it is related to CAPTCHA.

This is probably the same error as davidteather/TikTok-Api#1069 but running in headed mode (which happens automatically in this tool) does not seem to solve the issue.

[andre-santos1]

Same here. Any solutions?

[PwccaCode]

Any updates to this?

[GalenReich]

Judging from the content of the other issues it looks like it may be a result of running in headless mode (i.e. no browser opens up while the tool is running).

Adding the --headed flag may cause it to work, I would be interested to know if it works for you both?

[PwccaCode]

problem is count = 1000

tiktok new limit to count is 35 change and it works

[GalenReich]

Interesting! Does passing --limit 35 as a command line argument fix it for you?

[GalenReich]

It fixes it for me, I'm going to suggest changing the default to limit=35 for now.

We should look to add pagination of results, or some date-based bifurcation once #29 is addressed.

[trislee]

This PR (davidteather/TikTok-Api#1126) for the TikTokApi scraper should fix this issue, but in the meantime I'll approve Galen's fix.