Discussions

• 1 You must be logged in to vote

  💡

  Add special "session" option to RequestOptions & EnqueueLinksOptions or session/cookie sharing for new requests

  WebStrider started Dec 1, 2022 in Ideas

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  How to setcookie and user agent header from crawler.run?

  am1ru1 asked Nov 29, 2022 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to avoid memory overflow?

  dawangraoming asked Nov 29, 2022 in Q&A · Unanswered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  How can I delay requests with HttpCrawler?

  viconx98 asked Nov 9, 2022 in Q&A · Answered

  

  

  

  

  18
• 1 You must be logged in to vote

  💬

  Guide on submitting the same form multiple times in parallel?

  galaczi started Oct 16, 2022 in General

  

  

  4
• 1 You must be logged in to vote

  🙏

  How can I get response time?

  todordev asked Nov 3, 2022 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  💡

  Great framework, but I ran into some a sticky problem

  feature Issues that represent new features or improvements to existing features.

  ytrsoft started Oct 9, 2022 in Ideas

  

  

  

  

  2
• 1 You must be logged in to vote

  💬

  How can I change the filename of SDK_CRAWLER_STATISTICS_1.json?

  galaczi started Nov 3, 2022 in General

  

  

  2
• 1 You must be logged in to vote

  💡

  requestHandler and postNavigationHooks seem redundant

  feature Issues that represent new features or improvements to existing features.

  matjaeck started Oct 26, 2022 in Ideas

  

  

  2
• 1 You must be logged in to vote

  🙏

  How can I get raw body of response?

  todordev asked Nov 3, 2022 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Lambda Issue

  tsrdatatech asked Oct 20, 2022 in Q&A · Unanswered

  

  

  

  

  13
• 1 You must be logged in to vote

  🙏

  Is it possible to run a crawler forever?

  galaczi asked Oct 28, 2022 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  .ts import in CLI Puppeteer TS project results in "Cannot find module"

  galaczi asked Oct 23, 2022 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  deploying in docker

  bug Something isn't working.

  i-CNNN asked Oct 11, 2022 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  💬

  Cloudflare Pages / DigitalOcean

  sharkstate started Oct 9, 2022 in General

  

  

  2
• 3 You must be logged in to vote

  💬

  Approach to store scrapped data in database (postgres)

  acanimal started Oct 7, 2022 in General

  

  

  1
• 2 You must be logged in to vote

  🙏

  Purge non default RequestQueue

  nikis asked Oct 4, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to make additional request inside addHandler() function?

  shinebayar-g asked Oct 3, 2022 in Q&A · Answered

  

  

  2
• 2 You must be logged in to vote

  🙏

  Turn off storage

  tsrdatatech asked Sep 9, 2022 in Q&A · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Crawlee Basic Crawler using ts is not compliling with tsc

  bug Something isn't working.

  codera21 asked Sep 12, 2022 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  My crawlee with CLI but it's not work

  question Further information is requested.

  rcx100 asked Sep 2, 2022 in Q&A · Answered

  

  

  3
• 2 You must be logged in to vote

  💡

  Dataset options for CRAWLEE_STORAGE_DIR and DATASET_ID besides env vars

  feature Issues that represent new features or improvements to existing features.

  tsrdatatech started Aug 30, 2022 in Ideas

  

  

  4
• 1 You must be logged in to vote

  🙏

  Using Dataset vs. writing to JSON file?

  janzheng asked Sep 3, 2022 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How do I use crawlee to download PDFs?

  KishoreKalkur asked Aug 26, 2022 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  📝

  docs/introduction/adding-urls

  giscus bot announced Aug 28, 2022 in Comments

  

  

  3