Question about Robots.txt file & "link no follow"

[casinorecommender]

I am currently using Robot.txt file with (User-agent: *
Allow: /) and also for the outgoing links i use "link nofollow".

The question is : Is using Robots.txt file with this type of code disturbs the functionality of "link no follow" codes for outgoing links ?

Thnx

 

[michael26a]

I think your robots.txt file is wrong my friend.

The default for a robots.txt file is as follows:

User-agent: *
Disallow:

This basically tells robots that they can crawl every part of your website. If you want to disallow anything, then you have to include the directory in the disallow part. For example:

User-agent: *
Disallow: /images/

As for your question, the robots.txt file does not disturb nofollow links

 

[craig182]

Nofollow tells Google not to count a link on a page as a vote from yourself, noindex tag through a robots.txt file tells Google not to crawl that page. However I have seen times when Google still will index that page and I am unsure if Google still crawls the page with the disallow to find new links/pages on that page.

It is best to nofollow links that you do not trust, regardless of what page they are on, on your site.

 

[casinorecommender]

I agree with you. Thanks for the contribution. I prefer inserting no follow link into the code. Thnx