Getting a new website indexed by Google is harder than ever. Many site owners submit a sitemap and wait, only to find pages ignored or dropped from the index. This guide explains the modern indexing landscape and provides actionable steps to ensure your content gets crawled, indexed, and retained.

Why Indexing Has Become More Difficult
Google's algorithm has evolved. In the past, submitting a sitemap was enough to get a new site indexed quickly. Today, multiple SEO practitioners report that even after submitting a sitemap, pages remain unindexed for weeks. Manual indexing requests via Google Search Console often work better.
Several factors contribute to this shift:
- Increased emphasis on content quality: Google prioritizes pages that demonstrate expertise, authority, and trustworthiness (E-E-A-T). Thin or low-value content is often ignored.
- Crawl budget constraints: New sites have a limited crawl budget. Googlebot won't waste resources on pages it deems unimportant.
- Algorithm updates: Google continuously refines its indexing pipeline, making it more selective.
Sitemap Best Practices for 2026
A well-structured sitemap is still essential, but it's not a magic bullet. Follow these guidelines:
- Submit both XML and HTML sitemaps: HTML sitemaps are making a comeback because they provide a user-friendly navigation path that also helps crawlers discover pages.
- Keep sitemaps lean: Include only canonical, indexable pages. Exclude parameter-heavy URLs, duplicate content, and paginated archives.
- Use a sitemap index file: If you have more than 50,000 URLs, create a sitemap index that references multiple sitemaps.
- Update sitemaps regularly: Whenever you add or remove content, regenerate and resubmit your sitemap.
- Prioritize URLs: Use the
<priority>tag wisely—only give high priority to your most important pages (e.g., home page, key landing pages).
Manual Indexing Requests: A Proven Workaround
When sitemaps fail, manual requests often succeed. Here's how to do it efficiently:
- Use Google Search Console: Navigate to the URL Inspection tool, enter the page URL, and click "Request Indexing."
- Batch requests: While Google doesn't offer bulk manual requests, you can automate the process using the Google Indexing API (for job posting and livestream pages) or third-party tools that simulate manual requests.
- Focus on priority pages: Don't request indexing for every page. Prioritize:
- Home page
- Product/service pages
- Cornerstone content (guides, tutorials)
- Pages with high search potential

Crawl Budget Optimization
Crawl budget refers to the number of URLs Googlebot will crawl on your site within a given timeframe. New sites have a small budget, so you must use it wisely.
How to Maximize Crawl Budget
- Block low-value pages: Use
robots.txtornoindextags to prevent crawling of thin pages, tag archives, and staging environments. - Improve server response time: Slow servers waste crawl budget. Aim for a Time to First Byte (TTFB) under 200ms.
- Fix broken links: 404 errors and redirect chains waste budget. Use tools like Screaming Frog to find and fix them.
- Use internal linking wisely: Link to important pages from your home page and top-level navigation. This signals priority to Google.
- Submit a clean sitemap: As mentioned, a lean sitemap helps Googlebot focus on what matters.
Content Quality Signals That Affect Indexing
Google's indexing decisions are heavily influenced by content quality. Even if your page gets crawled, it may not be indexed if it fails quality checks.
Key Quality Signals
- Originality: Avoid duplicate or AI-generated content that adds no value. Google can detect low-effort AI content and may deindex it.
- Comprehensiveness: Cover topics in depth. A 300-word product page is less likely to be indexed than a 1,500-word guide with structured data.
- User engagement signals: Pages with high bounce rates or low time-on-page may be dropped from the index.
- E-E-A-T: Demonstrate Experience, Expertise, Authoritativeness, and Trustworthiness. Include author bios, citations, and clear sourcing.
Common Mistakes
- Publishing thin content: Pages with little text or value are often ignored.
- Overusing keywords: Keyword stuffing harms readability and indexing.
- Ignoring on-page SEO: Missing title tags, meta descriptions, and heading structure can prevent indexing.
Step-by-Step Indexing Workflow for New Sites
Follow this checklist to get your new site indexed quickly:
Ensure technical readiness:
- Set up Google Search Console and verify ownership.
- Create and submit an XML sitemap.
- Create an HTML sitemap and link to it from the footer.
- Check
robots.txtto ensure it's not blocking important pages.
Optimize content:
- Write unique, valuable content for each page (minimum 500 words for product pages, 1,000+ for guides).
- Use structured data (e.g., Product, FAQ, Article) to enhance visibility.
- Ensure fast loading times (Core Web Vitals pass).
Request indexing manually:
- For the first 10-20 pages, use the URL Inspection tool to request indexing individually.
- For larger sites, consider the Indexing API or a tool like Rank Math's IndexNow (works with Bing and Yandex, but Google may also respect it).
Build internal links:
- Link from your home page to key pages.
- Use breadcrumbs and related posts sections.
Monitor and iterate:
- Check the Index Coverage report in Search Console weekly.
- Re-request indexing for pages that remain "Discovered - currently not indexed."
- Improve content quality for pages that are "Crawled - currently not indexed."
Tools to Help with Indexing
- Google Search Console: Free tool for monitoring indexing status.
- Screaming Frog SEO Spider: Crawls your site to find technical issues.
- Ahrefs Webmaster Tools: Provides crawl budget analysis and index status.
- Sitebulb: In-depth technical SEO audits.
- IndexNow: Protocol to instantly notify search engines of content changes.
Browse our SEO tools directory for more options.
Common Indexing Issues and Fixes
| Issue | Possible Cause | Fix |
|---|---|---|
| Page not in index | Sitemap not submitted or contains errors | Resubmit sitemap, check for blocked URLs |
| Discovered but not indexed | Crawl budget exhausted or low-quality content | Improve content, reduce number of low-value pages |
| Indexed but dropped | Content quality declined or duplicate content | Update content, add canonical tags |
| Manual request ignored | Server errors or redirects | Fix server issues, ensure page is accessible |
Summary
Indexing a new site requires a multi-faceted approach. Don't rely solely on sitemaps—combine them with manual indexing requests, crawl budget optimization, and high-quality content. Monitor your progress in Search Console and adapt as needed.
For a deeper dive into technical SEO concepts, visit our SEO glossary.
FAQ
Why is my new site not indexed even after submitting a sitemap? Google may not crawl your sitemap immediately due to crawl budget constraints. Try requesting indexing manually via Search Console, and ensure your content is unique and valuable.
How long does it take for a new site to get indexed? It varies. With proper optimization, key pages can be indexed within a few days to a week. Without it, it may take weeks or months.
Does Google still use HTML sitemaps? Yes, HTML sitemaps are becoming popular again as they help both users and crawlers navigate your site, potentially improving indexing.
Can I use the Indexing API for all pages? The Indexing API is limited to job posting and livestream pages. For other content, use manual requests or third-party tools that simulate them.
What should I do if a page is "Discovered - currently not indexed"? This means Google found the page but hasn't crawled it yet. Improve internal linking, update the sitemap, and request indexing manually. If it persists, consider improving the page's content quality.