microsoul
  •  microsoul
  • 89.60001% (Honored)
  • YAF Lover Topic Starter
2008-04-27T06:09:54Z
Someone has already written the file Robots.txt for yaf 1.9.1.8?

My Forum: Synology italia 
Sponsor
test2005
2008-04-27T06:12:55Z

The robots.txt file is not YAF version specific. You can take this file from any app (if it's missing). If your wondering what the file should contain, try Googlin "robots.txt" and you'll get some great examples.

:-P

.....the man in black fled across the desert..........and the gunslinger followed.....
microsoul
  •  microsoul
  • 89.60001% (Honored)
  • YAF Lover Topic Starter
2008-04-27T07:56:32Z
It was just to know what files yaf include in robots.txt
My Forum: Synology italia 
test2005
2008-04-27T12:45:52Z

Aside from those already listed....a quick search of this forum has people adding...

posts.ascx, posts.ascx.cs, framehelper.aspx

But you can add any file you feel you need to hide from search engines.

HTH

:-P

.....the man in black fled across the desert..........and the gunslinger followed.....
microsoul
  •  microsoul
  • 89.60001% (Honored)
  • YAF Lover Topic Starter
2008-05-01T04:17:02Z
I for example remove all yaf_profile * robots.txt but does not accept *.
How can I do?
My Forum: Synology italia 
test2005
2008-05-01T19:17:57Z
If you want to exclude everything try this...


User-agent: *
Disallow: /


you can also change the META tag to


<META NAME="ROBOTS" CONTENT="NONE,NOARCHIVE"> 


HTH

:-P
.....the man in black fled across the desert..........and the gunslinger followed.....
microsoul
  •  microsoul
  • 89.60001% (Honored)
  • YAF Lover Topic Starter
2008-05-11T04:50:52Z
test2005 wrote:

If you want to exclude everything try this...


User-agent: *
Disallow: /


you can also change the META tag to


<META NAME="ROBOTS" CONTENT="NONE,NOARCHIVE"> 


HTH

:-P


Yes, but i want exclude only yaf_profile *
My Forum: Synology italia 
Users browsing this topic

    About Us

    The YAF.NET is an open source .NET forum project. YAF.NET is supported by an team of international developers who are build community by building community software.

    Powered by Resharper Donate with PayPal button

    Project Twitter Updates

    Copyright © YetAnotherForum.NET & Ingo Herbote. All rights reserved