|
|
 |
|
| Author |
 Topic  |
|
|
yogamonster
20 Posts |
|
|
yogani
USA
5238 Posts |
 Posted - Mar 23 2014 : 09:55:00 AM
|
Hi YM:
So what you are saying is that certain Google searches are going to the print pages, rather than to the actual forum topics? (Fortunately, the print pages include links to the actual topics.)
aypsite.org and the forums are site mapped with code set up by our tech consultant years ago. As far as I know, the site mapping is working, because the actual forum topics receive a lot of traffic from Google.
I will have our tech consultant look into the anomaly you mentioned to see what is going on. It could be that certain public pages, like the print pages, will come up with particular search term configurations like you tried. But not all searches will be like that, and hopefully most are going to the actual forum topics. I don't know that we could account for every variation in search terms that might lead to public pages in the forum that are not actual topics. There are thousands of search term variations and thousands of forum pages. But we will take a look.
Thanks for pointing this out.
The guru is in you.
PS: Whether a robots.txt file is a solution or not is for our tech consultant to decide. I only know how to use it for blocking search engines, and we are certainly not going to do that. 
|
 |
|
|
yogani
USA
5238 Posts |
Posted - Mar 23 2014 : 2:59:08 PM
|
Hi YM:
The feedback from our tech consultant is that it is not possible to predict what Google ranking algorithms will produce, and second guessing them could be counterproductive. Who knows why Google may sometimes rank a print page above the actual page? (at least we have the real link on the print page) We don't want to block those print pages from Google, because it could adversely affect the visibility of related pages.
You did not mention how widespread this issue is. If it involves hundreds or thousands of pages, we can take a closer look. But if it is affecting only a few pages, then it is probably best to leave it alone.
Thanks!
The guru is in you.
|
|
|
|
yogamonster
20 Posts |
Posted - Mar 31 2014 : 11:17:32 PM
|
Fair enough I guess. Currently there's no robots.txt on the AYP site as far as I can tell:
http://www.aypsite.org/robots.txt
Preventing print pages from being indexed is easy enough - just create a text file at the above location and add something like this:
User-agent: *
Disallow: /pop_printer_friendly.asp
I don't think doing this will have negative consequences in terms of ranking because the main pages beginning with /topic.asp have the same content. Seems that searching for minor topics on Google usually produces this kind of "anomaly":
https://www.google.com/search?q=sit...ite.org+weor
Anyway it's obviously up to you and the tech consultant to decide what to do with it - just wanted to report the issue because I was experiencing it every other time I did site search on Google.
|
|
|
|
yogani
USA
5238 Posts |
Posted - Apr 01 2014 : 10:23:54 AM
|
Hi YM:
The question is, if blocked, where will those "searches for minor topics" go? If not to AYP, then it would be a net loss of traffic.
Correct, there is no robots.txt file on aypsite.org . We do have one blocking the entire aypsite.com site from the search engines, because mirror sites are not permitted by Google, and both would be blocked by them if one was not blocked by us. Years ago, aypsite.org was chosen as the search site, because it includes both the lessons and the forums, whereas aypsite.com is the lessons only. As mentioned before, aypsite.org (including the forum) is site mapped for improved search engine exposure.
The thing with doing search engine access modifications is that no one knows what the Google algorithms are, and there is risk in it. We could end up shooting ourselves in the foot for the sake of a few errant search results, which have links to the corresponding topics anyway. Very often, "upgrades" result in unexpected downsides due to unknown factors in the technology.
So from the perspective of a long time, well-established search engine exposure program, this is a case of, "If it ain't broke, don't fix it." At least not for now... 
Thanks for poking around. We are always looking for ways to improve the AYP resources and their visibility. But at this stage we are not inclined to do modifications that offer a small benefit coupled with a potentially big downside risk.
The guru is in you.
|
|
|
|
Yogaman
USA
295 Posts |
Posted - Apr 01 2014 : 10:46:18 AM
|
Most likely what you want to do is to redirect these links to the main pages, not block them. This can be done with what are called "regular expressions" to grab all pages that match a pattern in the URL structure. Redirecting pages is common, as people move content and rename pages (and entire websites). I've done this plenty of times with my business site which relies heavily on ranking high in Google results, and have never seen a negative impact.
Your comment regarding duplicate content is correct, but keep in mind that having both a webpage and the print page show up in search results might be seen by Google as duplicate content (which it is).
That said, I also agree with "if it ain't broke don't fix it". But as Wayne Gretsky said, you miss 100% of the shots you don't take :)
The question is whether Google penalizes for this, and it is probably one area they do reveal their stance on. The other question is if it is a pain for new visitors, does it turn them off from exploring AYP's website? |
|
|
|
Yogaman
USA
295 Posts |
|
|
yogani
USA
5238 Posts |
Posted - Apr 02 2014 : 11:43:06 AM
|
Hi YM and YM:
We will look into this some more. We don't want multiple results for forum pages turning up often in Google, as it could reduce exposure.
Thanks!
TGIIY
|
|
|
| |
Topic |
|
|
|
| AYP Public Forum |
© Contributing Authors (opinions and advice belong to the respective authors) |
|
|
|
|
robots.txt for the AYP website
