Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

https 301 redirect #89

Open
paulboenisch opened this issue Jul 17, 2019 · 3 comments
Open

https 301 redirect #89

paulboenisch opened this issue Jul 17, 2019 · 3 comments

Comments

@paulboenisch
Copy link

Q A
Bug report? yes
Feature request? no
BC Break report? no
RFC? no

There are no pages crawled if https redirect present.
@Cruiser13
Copy link
Contributor

I forgot how I solved this issue earlier so I'm leaving a comment here to remember it next time.
You can use https redirects but you have to allow the scheme. Sample config.yml:

lucene_search:
    enabled: true
    allowed_schemes: ['https']
    seeds:
        - 'https://yourdomain.com/'
    filter:
        valid_links:
            - '@^https://yourdomain.com.*@i'
    view:
        max_per_page: 10
    crawler:
        content_max_size: 4
        content_start_indicator: '<body>'
        content_end_indicator: '</body>'

@dpfaffenbauer
Copy link
Contributor

@Cruiser13 Just so you know, this bundle is sort of deprecated and will be replace with dynamic-search.... so better not use it anymore.

@Cruiser13
Copy link
Contributor

@dpfaffenbauer yes I know but we could not get dynamic-search to work the way we need it to so far (docs are missing too). And we got nice integrations with coreshop product search and this bundle so we will continue using it for a while I think.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Cruiser13 @dpfaffenbauer @paulboenisch