How can I use robots.txt?

egafutura's picture

egafutura
April 13, 2011
11:56am

Hi community!

There is a robots.txt file or similar? We have under constructions pages like http://www.egafutura.com/precios and we want to hide that specific pages from the search engenes.

How we can do that?

Status: Resolved

Comments

Moderator
jbeach April 13, 2011
12:01pm

If you don't want the content accessible to users either, you can leave it unpublished and then only admins will be able to access it. 

Jesse
Senior Front End Engineer | Amateur Violinist

egafutura April 26, 2011
8:33pm

there are another workaround?

Moderator
George Cassie April 27, 2011
10:44am

There's not at the moment, but I've create a project for robots.txt control - tracking internally as #AN-25307.

What about keeping the content unpublished isn't working for your site?

George Cassie
Gardens Advisory Team

egafutura April 27, 2011
10:54am

Hi George! This is not an option for us because we want to create pages for our facebook fan page (iframe). Please let us know about this solution! :)

Moderator
George Cassie April 27, 2011
2:47pm

Are you looking to exclude the content of the iframe from search engines? I belive that happens already - framed content is difficult or inaccessible to most spiders.

George Cassie
Gardens Advisory Team

Moderator
Chris Brookins February 2, 2012
8:20pm

Robots.txt can now be manipulated via the SEO tools available for sites using  the professional plan and higher


Chris Brookins
VP Engineering and Product Management, Acquia - blog - twitter -

egafutura February 3, 2012
7:15am

Thank you very much!