Docs: "Migration from VuePress" and "Migration from VitePress 0.x" not discoverable by search

[olets]

Describe the bug

In Bing, DuckDuckGo, Ghostery Search, and Google, my top result for "migrate from vuepress to vitepress" is https://vitepress.dev/guide/migration-from-vuepress

I only used a search engine after searching the VuePress and VitePress docs and getting nothing.

Looking at the source, I see there's also https://vitepress.dev/guide/migration-from-vitepress-0

Reproduction

Search for "migration" in the VitePress docs. See that there are no results.

Expected behavior

Searching for "migration" in the VitePress docs finds the VuePress guide and the VitePress 0.x guide.

System Info

n/a

Additional context

If these pages were meant to be retired, they could get a "not actively maintained" notice at the top. The fact that they don't turn up in search, and that I haven't found anything in the source saying "exclude these pages from search", makes me wonder if the VitePress docs' search is buggy, and whether that means my VitePress sites' search is buggy.

Validations

• Check if you're on the latest VitePress version.
• Follow our Code of Conduct
• Read the docs.
• Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.

[brc-dd]

and that I haven't found anything in the source saying "exclude these pages from search",

Those files are intentionally removed from sitemap and have no direct link from any content or sidebar/navbar, that's why algolia's crawler can't find them.

vitepress/docs/.vitepress/config/shared.ts

Lines 31 to 36 in 5649071

	sitemap: {
	hostname: 'https://vitepress.dev',
	transformItems(items) {
	return items.filter((item) => !item.url.includes('migration'))
	}
	},

Stuff like search: false in frontmatter is only required for local search.

In Bing, DuckDuckGo, Ghostery Search, and Google, my top result for "migrate from vuepress to vitepress" is https://vitepress.dev/guide/migration-from-vuepress

This might be because of vitepress.dev's ranking and the fact that we haven't added no-index header like this:

vitepress/netlify.toml

Lines 15 to 18 in 5649071

	[[headers]]
	for = "/_translations/*"
	[headers.values]
	x-robots-tag = "noindex"

Those guides aren't useful at all. They just list 2-3 differences. Might be better to just exclude them from build.