AttributeError: 'NoneType' object has no attribute 'find_all'

[Johann-gif]

Hello, is there a version compatible with the new version of Webtoon website?

[alumag]

Hey @Johann-gif , it seems like the ReleaseHook and WeeklyHotHook still work as intended with python 3.6.6 and python 3.7, would you like to try this python version?

[Johann-gif]

It does not work for me despite python in 3.6.6...see attachment

This error comes from the package obtained with the command pip install WebtoonHooks

[alumag]

I didn't succeed to reproduce the bug, I've tried to install the package on multiple environments and it works just fine.

However, I have a few guesses. it seems like the div tags with the class daily_section _list_<DAY IN CAPITAL> are not found when you are downloading the page https://www.webtoons.com/en/dailySchedule on your environment, while these classes still exist in the new website.

1. Please provide the output for pip list, I would like to check the versions of beautifulsoup4 and lxml. I use the latest versions, but the project run since 2019...
2. In get_daily_releases function, debug and check the CSS class name at line 84. It should be equal (today) to daily_section _list_TUESDAY.
3. Try to change line 84 to daily = soup.find("div", {'class': "daily_section _list_" + day.upper()}), basically add another whitespace between the class names.
4. Save the output of Session.get_page("dailySchedule") and upload here. We will debug it together :)

I'm sorry I couldn't find a quick solution, I hope it helps
Happy debugging!

[alumag]

Found the problem, you need to set the locale time to English:

import locale
locale.setlocale(locale.LC_ALL, 'en.utf8')

[Johann-gif]

it doesn't work with the locale time to English either.

See the version of beautifulsoup4 and lxml down below

I am French, so it is possible that there are new issues not identified.
I already ran into the problem when I cloned a project to download images from the website, I had to change 30% of the project to work on my end, largely due to the age verification page.
I will try to debug on my side, do not hesitate to give me a feedback in the meantime if you find a solution.

[Johann-gif]

As i thought, the age verification page is the problem.
The header provided in the code is not sufficient to bypass the age verification page, in my other project the only solution I could find was to enter all my browsing cookies manually with jar = requests.cookies.RequestsCookieJar () and jar.set('blabla', 'blabla', domain='.webtoons.com', path='/') and addings.headers.update ({'referer': 'https://www.webtoons.com/en/gdpr/ageGate'}), is there a way to do it more cleanly?

[alumag]

Bypassing the age gate by automation is not a task I'm willing to do, It will make this small project too complex. however, It seems that the age gate is active only in Europe (because of GDPR), I've tested it with VPN, which explains why I couldn't reproduce the bug (I'm from Israel).
Try to use a VPN, I found that I can't reach the age gate from Israel, South Korea, India, Canada... basically any VPN server outside Europe should do the work for you :)

[Johann-gif]

Hello,
I tried again using a vpn (protonVPN) passing through the United States.
I manage to receive the hot of the week embed but not that of the daily schedule.
The text seems too long for the embed, have you encountered this error on your end?

python
>>> import WebtoonHooks
>>> release = WebtoonHooks.ReleaseHook()