Post by AdieB » Thu Jul 22, 2021 4:08 pm

I am busy working on increasing organic traffic to my site so have embarked on some SEO stuff. I have decided to use the www as my site default. I however don't want bots to crawl the non www as it causes duplicate meta descriptions and duplicate title tags error. I have searched and this topic is generally not well documented. Is this setting done in robots.txt or .htaccess or otherwise and would anyone be able to kindly point me in the right direction?
Can I also assume that Screaming Frog spider will crawl immediate changes, while Google may take a while to reflect any changes made?
Site is https://www.ic-express.co.za

Error is as per Ubersuggest
41 pages with duplicate meta descriptions
page url example with duplicate meta descriptions
Courier both International documents and non documents | ICExpress International Courier Service
https://ic-express.co.za/index.php?rout ... tion_id=22
https://www.ic-express.co.za/index.php? ... tion_id=22

New member

Posts

Joined
Mon May 19, 2014 9:01 pm

Post by straightlight » Thu Jul 22, 2021 5:25 pm

AdieB wrote:
Thu Jul 22, 2021 4:08 pm
I am busy working on increasing organic traffic to my site so have embarked on some SEO stuff. I have decided to use the www as my site default. I however don't want bots to crawl the non www as it causes duplicate meta descriptions and duplicate title tags error. I have searched and this topic is generally not well documented. Is this setting done in robots.txt or .htaccess or otherwise and would anyone be able to kindly point me in the right direction?
Can I also assume that Screaming Frog spider will crawl immediate changes, while Google may take a while to reflect any changes made?
Site is https://www.ic-express.co.za

Error is as per Ubersuggest
41 pages with duplicate meta descriptions
page url example with duplicate meta descriptions
Courier both International documents and non documents | ICExpress International Courier Service
https://ic-express.co.za/index.php?rout ... tion_id=22
https://www.ic-express.co.za/index.php? ... tion_id=22
- viewtopic.php?f=181&t=223026#p817888
- viewtopic.php?f=199&t=223533#p819767
- viewtopic.php?t=213870#p765477
- viewtopic.php?f=10&t=224548
- viewtopic.php?f=201&t=224601#p824142
- viewtopic.php?f=199&t=224695#p824689

Dedication and passion goes to those who are able to push and merge a project.

Regards,
Straightlight
Programmer / Opencart Tester


Legendary Member

Posts

Joined
Mon Nov 14, 2011 11:38 pm
Location - Canada, ON

User avatar
Guru Member
Online

Posts

Joined
Mon Aug 22, 2011 11:01 pm
Location - London Gatwick, United Kingdom

Post by EvolveWebHosting » Thu Jul 22, 2021 10:15 pm

paulfeakins wrote:
Thu Jul 22, 2021 5:42 pm
Generally we'd recommend this: https://www.antropy.co.uk/blog/how-to-r ... and-https/
This is the way to go. Simple and effective.

Opencart Hosting Plans, Domain Registration, Microsoft and Google Email and More
Visit our website for great deals and most importantly, fast and friendly support - www.evolvewebhost.com


User avatar
Active Member

Posts

Joined
Fri Mar 27, 2015 11:13 pm
Location - Denver, Colorado, USA
Who is online

Users browsing this forum: No registered users and 258 guests