Anyone having an indexation problem these days? 🙂 Google takes too long to index my pages
Explored but not indexed 🙁
5 👍🏽5 22 💬🗨
I'm not 100% sure here, but it seems like Google is making a bit of a transition.
A lot of parts of the ranking algo in Google take time to sort out and make sense of – the signals come from many sources outside of the one page that the content is on. Plus, Google is doing a lot more in terms of actually trying to understand the content – which requires certain on-page things happening in order to do that quickly and accurately too.
In the past, Google would make certain assumptions about things when new content is discovered. Off page patterns established for older content can be a good signal of what the offpage patterns for this content might be. On page things could be assumed based upon several factors too – even if it's not quite sure what it really means.
Right now, though – if the offpage signals don't show a consistent pattern for a site and the onpage markup and IA factors aren't sending strong, reliable signals – Google seems much more hesitant to make these assumptions.
I come to this conclusion from a fairly limited set of data, though. About half our clients are working from sites that existed before we took over the account. The sites aren't perfect, but they seemed "Good Enough" to not necessarily "NEED" a total rebuild before we started. So they opted out of doing the rebuild. The other half either NEEDED the rebuild or opted for it even though we presented it as optional. When I rebuild a site, I build a whole punch of stuff into it with semantic html elements, proper labeling, and a whole new IA that helps put things into context and gives it meaning. (In other words, if you knew about a new page on one of those sites but had never even looked at it, you could have a really good idea of exactly what that page was going to be about. And then the markup on the page helps the machines to confirm that assumption quickly and easily).
Now… the thing here (from the 20 or so sites I monitor), the "Good Enough" but no rebuild sites are having some troubles with new content. We post it and it can take days or even weeks before it really shows up and starts doing anything. On the other hand, the sites we have on a solid foundation and that explain everything in a way that a machine can understand – well, those don't have that problem unless we're building out an entire new section. We even added a new page last week that had a featured snippet for what we wanted to rank for appearing in under 36 hours of publication.
So basically… it just seems like Google doesn't want to rank pages until it ACTUALLY "understands" what it all means. So if you're not using proper markup, schema, and other things that confirm and affirm that meaning quickly for the machines, it's likely going to take a bit.
Again.. this is from observations from a very small set of sites, but… within that set, the ones where I've done my Semantic SEO foundational work don't have problems. The ones without that – well, they're taking a while.
According to the content, it is good quality content pages, optimized images, strong key words, no technical errors, good page speed ..
Jacob Funnell » Stockbridge Truslow
My read on what you're saying is putting things in categories a la the HubSpot topic clusters model. This often means taking stuff that's randomly in blogs and restructuring it into a coherent resource. Is that right, or have I got it wrong?
I've been doing a fair bit of the following:
– Get new client
– Do keyword research
– Build out suggested site structure in spreadsheet that puts keywords into logical categories and subcategories
– Give recs for all the traditional on-page optimization around keywords / secondary keywords / semantically related keywords (from SEMrush for the semantically related ones)
– In the build, make sure they apply breadcrumbs, nav/footer links where it makes sense, and general internal linking
– Apply schema where necessary
Does this all sound about sufficient in outline for the site structure stuff, or would there be any steps you'd add?
(Always looking to improve my processes! :))
Stockbridge Truslow 🎩 » Jacob Funnell
Yes. Those are all good steps.
I'd be looking at identifying which keywords are known entities too. There are tools like InLinks, Kalicube, and Google's Natural Language Processing (NLP) Application Programming Interface (API) that can help with that – but just typing in the keywords and seeing if you're hit with a ton of enhanced listings (and to what extent they exist) can be a great indicator, too.
Those can then give you clues as to how the knowledge graph is classifying things – and, then you can ease in that way.
(Though I have a client where their whole industry had horrible web sites for decades… the knowledge graph was getting built, but it was all wrong, crazy, and utter madness. In that instance, we've had to not try to fit ourselves into the knowledge graph, but instead actually influence the knowledge graph so that it would take a reasonable and accurate shape. Difficult, but some of the most fun I've had in Search Engine Optimization (SEO) in years. lol)
In most cases, though – you're just trying to attach yourself to the knowledge graph so finding the entities and attributes that you connect on and then presenting them to confirm that that's the connection you're trying to make goes a long way.
Jacob Funnell » Stockbridge Truslow
While I had some sense of 'entities', I had really only thought about them in the case of optimizing news stories.
Going beyond that is new stuff to me, which is kinda embarrassing really but also just what I wanted. I have some homework to do on this now. Thanks! 😃
Stockbridge Truslow 🎩
Welcome down the rabbit hole, Alice.
Here – give this video a watch. It's a few years old now, but it's the best I've seen to date that introduces the concepts and explains the basics of implementation. It's the best 30 minutes you can spend this weekend.
Jason Barnard – How to Help Google Make Sense of a Chaotic, Unstructured Web #SEOisAEO
Stockbridge Truslow 🎩
Since the reply thread got a bit out of sync… I'll add this note here… This response is to Norah's comment above…
Those aren't really the things it needs to understand the page, though.
Keywords – at least some of them on the page – need to map to entities. (The ones that are not mapped to entities need to strive to be doing so, but that's something else).
Structured data helps with that. Using Semantic HTML elements on the page help Google understand what purpose various parts of the page are serving (and then using those elements properly helps, too.) "Where" the page appears on your site – be it within categories or having parent pages that give context as to what it's going to be about – that helps.
Honestly, Search Engine Optimization (SEO) has always been changing and the SEO industry as a whole has almost always been a few steps behind the game. With machine learning, it's evolving faster and faster. Five years ago, it used to take me 6-8 months to establish a brand entity. I can do that in 2-4 weeks nowadays. You can establish a new product entity (so long as there are similar things out there that line up) in a matter of a week or so.
If you're writing about things that Google doesn't have in it's knowledge graph at all – then you can still play the "match the keyword" game and be fairly successful. If you're in a niche where the knowledge graph is starting to form and all your competitors are still playing the "match the keyword" game – you can still be fairly successful. But if you are in a niche where the Knowledge Graph is well established and now you're playing in the Semantic SEO big leagues – it's going to be very difficult to compete playing "match the keywords".
I really think we're nearly at the tipping point, now. The knowledge graph is growing FAST. And it's growing WIDE. Every second that passes is one whole swath of the Internet where you can't play the "match the keyword" game anymore (except for very long tail terms).
For some background on what is going on and how search is actually evolving now – this is probably the best primer piece:
What is Semantic SEO? – Go Fish Digital
Embed a related video, create a video sitemap. Instant index.
Another process is having at least one image and having image sitemap. (Indexes within a day or two)
Have multiple sitemaps : video, image, normal sitemap, html sitemap. Google will index,
PS: i indexed a million pages last month.
These may satisfy you:
» Block crawling via Robots.txt, Add NoIndex Meta Tags on each page, Password Protect the pages | What do they mean?
» Guest Post | Backlink | Press Release | Pagerank | Links Indexed By Google Start Affecting SEO (an Opinion to Discuss)