Srapping Angular websites

[earandap]

from scrapling import Fetcher, PlayWrightFetcher

page = PlayWrightFetcher().fetch('https://www.pulitzer.org/prize-winners-by-year')
winners = page.find_all('div', class_='table-cat-winners')
for winner in winners:
    print(winner.html_content)

This is the response to the above code.

[2025-02-05 19:10:36] INFO: Fetched (200) <GET https://www.pulitzer.org/prize-winners-by-year> (referer: https://www.google.com/search?q=pulitzer)

Process finished with exit code 0

When I inspect the HTML page in the browser, I see that there are divs with the class table-cat-winners. Am I missing something?

[earandap]

I also attempted to add a wait selector, but I got a Timeout 30000ms exceeded.

from scrapling import PlayWrightFetcher

page = PlayWrightFetcher().fetch('https://www.pulitzer.org/prize-winners-by-year', wait_selector='#winners-landing', wait_selector_state='visible')
winners = page.find_all('div', 'table-cat-winners')
for winner in winners:
    print(winner.html_content)

[earandap]

Using real_chrome=True. It worked. Here is the working example:

from scrapling import PlayWrightFetcher

page = PlayWrightFetcher().fetch('https://www.pulitzer.org/prize-winners-by-year', wait_selector='#winners-landing', wait_selector_state='visible', real_chrome=True)
winners = page.css('.table-cat-winners')
for winner in winners:
    print(winner.html_content)