microsoul
  • Posts: 65
  • Joined: 03/04/2008
Someone has already written the file Robots.txt for yaf 1.9.1.8?

My Forum: Synology italia 
Sponsor
test2005
  • Posts: 761
  • Joined: 12/02/2005

The robots.txt file is not YAF version specific. You can take this file from any app (if it's missing). If your wondering what the file should contain, try Googlin "robots.txt" and you'll get some great examples.

:-P

.....the man in black fled across the desert..........and the gunslinger followed.....
microsoul
  • Posts: 65
  • Joined: 03/04/2008
It was just to know what files yaf include in robots.txt
My Forum: Synology italia 
test2005
  • Posts: 761
  • Joined: 12/02/2005

Aside from those already listed....a quick search of this forum has people adding...

posts.ascx, posts.ascx.cs, framehelper.aspx

But you can add any file you feel you need to hide from search engines.

HTH

:-P

.....the man in black fled across the desert..........and the gunslinger followed.....
microsoul
  • Posts: 65
  • Joined: 03/04/2008
I for example remove all yaf_profile * robots.txt but does not accept *.
How can I do?
My Forum: Synology italia 
test2005
  • Posts: 761
  • Joined: 12/02/2005
If you want to exclude everything try this...


User-agent: *
Disallow: /


you can also change the META tag to


<META NAME="ROBOTS" CONTENT="NONE,NOARCHIVE"> 


HTH

:-P
.....the man in black fled across the desert..........and the gunslinger followed.....
microsoul
  • Posts: 65
  • Joined: 03/04/2008
test2005 wrote:

If you want to exclude everything try this...


User-agent: *
Disallow: /


you can also change the META tag to


<META NAME="ROBOTS" CONTENT="NONE,NOARCHIVE"> 


HTH

:-P


Yes, but i want exclude only yaf_profile *
My Forum: Synology italia 
Users browsing this topic
    Forum Jump  
    • You cannot post new topics in this forum.
    • You cannot reply to topics in this forum.
    • You cannot delete your posts in this forum.
    • You cannot edit your posts in this forum.
    • You cannot create polls in this forum.
    • You cannot vote in polls in this forum.

    About Us

    The YAF.NET is an open source .NET forum project. YAF.NET is supported by an team of international developers who are build community by building community software.

    Powered by Resharper Donate with PayPal button

    Project Twitter Updates

    Copyright © YetAnotherForum.NET & Ingo Herbote. All rights reserved