*

Burton

  • ***
  • 128
Re: robots.txt file for osdate?
« Reply #15 on: February 10, 2015, 08:20:08 AM »
Hi Phil,

Thank you for your quick reply,

I added this to my .htaccess file, as I have both of these.

Code: [Select]
RewriteRule ^robots.txt$ robots.txt$1

RewriteRule ^sitemap.xml$ sitemap.xml$1

I now have a .htaccess and a .htaccess.txt file, both have the same content, is that ok?

*

Pharg

  • *****
  • 2,060
  • osDate Version: osDate Evo v1.0
Re: robots.txt file for osdate?
« Reply #16 on: February 10, 2015, 11:39:14 AM »
Hi Phil,

Thank you for your quick reply,

I added this to my .htaccess file, as I have both of these.

Code: [Select]
RewriteRule ^robots.txt$ robots.txt$1

RewriteRule ^sitemap.xml$ sitemap.xml$1

I now have a .htaccess and a .htaccess.txt file, both have the same content, is that ok?

Hi Burton,

That's all fine, you don't need the .htaccess.txt that's the original file from the install.
Regards,
Pharg ( Phill )

REMEMBER: ALWAYS BACKUP BEFORE YOU MAKE ANY CHANGES!!

osDate v2.7 & osDateEvo v1.0 | PHP: 5.3.42 & PHP: 5.6.18 | MySQL: 5.5.35

*

Burton

  • ***
  • 128
Re: robots.txt file for osdate?
« Reply #17 on: February 11, 2015, 03:19:36 AM »
Hi Phil,

For some reason my robots.txt file is - You don't have permission to access /robots.txt on this server.

The robot.txt file has 644 permisions

Could it be because of this in .htaccess?

# Protect files depending on extension
<FilesMatch "^(.*)\.(inc|inc\.php|tpl|tpl\.php|sql|txt|dat|csv|exe|dll)$">
  Order deny,allow
  Deny from all
</FilesMatch>

your help appreciated :)

*

Pharg

  • *****
  • 2,060
  • osDate Version: osDate Evo v1.0
Re: robots.txt file for osdate?
« Reply #18 on: February 11, 2015, 03:36:40 AM »
Hi Phil,

For some reason my robots.txt file is - You don't have permission to access /robots.txt on this server.

The robot.txt file has 644 permisions

Could it be because of this in .htaccess?

# Protect files depending on extension
<FilesMatch "^(.*)\.(inc|inc\.php|tpl|tpl\.php|sql|txt|dat|csv|exe|dll)$">
  Order deny,allow
  Deny from all
</FilesMatch>

your help appreciated :)

Hi Burton,

In the code remove the txt  as below:

Code: [Select]
# Protect files depending on extension

<FilesMatch "^(.*)\.(inc|inc\.php|tpl|tpl\.php|sql|dat|csv|exe|dll)$">
  Order deny,allow
  Deny from all
</FilesMatch>
Regards,
Pharg ( Phill )

REMEMBER: ALWAYS BACKUP BEFORE YOU MAKE ANY CHANGES!!

osDate v2.7 & osDateEvo v1.0 | PHP: 5.3.42 & PHP: 5.6.18 | MySQL: 5.5.35

*

Burton

  • ***
  • 128
Re: robots.txt file for osdate?
« Reply #19 on: February 11, 2015, 03:52:32 AM »
Hi Phil,

Thank you for the seedy reply,

Yes I thought it was |txt| yet wanted your opinion,

Removed and now robots.txt is accessible  :)

*

Pharg

  • *****
  • 2,060
  • osDate Version: osDate Evo v1.0
Re: robots.txt file for osdate?
« Reply #20 on: March 06, 2015, 09:41:30 PM »
Remove both the Sitemaps from the robots.txt

Code: [Select]
Sitemap: http://YOUR-DOMAIN-NAME/sitemap.xml

Sitemap: http://YOUR-DOMAIN-NAME/urllist.txt

Then put in the .htaccess

Code: [Select]
RewriteRule ^robots.txt$ robots.txt$1

RewriteRule ^sitemap.xml$ sitemap.xml$1

RewriteRule ^urllist.txt$ urllist.txt$1

RewriteRule ^sitemap.txt$ sitemap.txt [L]

Make sure it's named robots.txt Not robots.text

still gives error, no robots.txt found,

Hi mnarkyp77,

I was just going through the forum and spotted my mistake for your website on here.
Yours should be https not http

So it should look like this.
Code: [Select]
Sitemap: https://YOUR-DOMAIN-NAME/sitemap.xml

Sitemap: https://YOUR-DOMAIN-NAME/urllist.txt

Sorry I didn't notice before if you haven't already fixed it  ;D
Regards,
Pharg ( Phill )

REMEMBER: ALWAYS BACKUP BEFORE YOU MAKE ANY CHANGES!!

osDate v2.7 & osDateEvo v1.0 | PHP: 5.3.42 & PHP: 5.6.18 | MySQL: 5.5.35