?

Log in

No account? Create an account
Feb. 28th, 2006 @ 08:42 pm What?
Hmm - it would appear that around the 19th of January, either the Google Blog search started ignoring the robots.txt file, NOINDEX or NOFOLLOW tags or LiveJournal messed them up somehow.

I've always selected not to have my blog crawled if possible, and until recently it never showed up in Google.
Who does she think she is?
catspit
Leave a comment
Permanent Link

Share
[User Picture Icon]
From:miss_kat_1968
Date:March 1st, 2006 01:58 am (UTC)
(Permanent Link)
Hmmm...mine showed up, too. However when I searched for a friend's journal, which is locked, it didn't show up.
(Reply) (Thread)
[User Picture Icon]
From:neeroc
Date:March 1st, 2006 02:15 am (UTC)
(Permanent Link)
If it's locked they have to authenticate to LJ and have rights I think, otherwise they can just grab the RSS feed.

Now I have to figure out how much I care... I mean it's one thing to subject you guys to me raving about my crock pot... *g*
(Reply) (Parent) (Thread)
[User Picture Icon]
From:radiostace
Date:March 1st, 2006 02:29 am (UTC)
(Permanent Link)
Maybe it doesn't matter now, but what was the option to block it from Google anyway? Where would I find that?
(Reply) (Parent) (Thread)
[User Picture Icon]
From:neeroc
Date:March 1st, 2006 02:45 am (UTC)
(Permanent Link)
If you go to Manage Accounts, Edit Personal Information, down towards the bottom of the page you will find a checkbox for: 'Minimize your journal's inclusion in search engine results'
(Reply) (Parent) (Thread)
[User Picture Icon]
From:dbaxdevilsfan
Date:March 1st, 2006 02:48 am (UTC)
(Permanent Link)
thats part of why I locked down my journal. I had that option marked, but Google was still posting info from public entries, even if the option was marked. If you post publicly in a community, or reply to something within a community that was posted publicly, and the person/comm doesn't have that option marked, your reply/post is fair game, and probably will show up in a Google search
(Reply) (Thread)
[User Picture Icon]
From:miss_kat_1968
Date:March 1st, 2006 05:11 am (UTC)
(Permanent Link)
Crap. I'll have to talk to Mr. Ed about this tomorrow. Some of my stuff definitely shouldn't be public info. If I lock my journal now, will that pertain to earlier posts? If so, I might have to do that.
(Reply) (Parent) (Thread)
[User Picture Icon]
From:dbaxdevilsfan
Date:March 1st, 2006 02:47 pm (UTC)
(Permanent Link)
If you lock it down now, and mark not to allow your journal to be found, it should be made unavailable to them (Google, and whatever other search engines). But anything in a community that doesn't have that option marked, or replies in a community are still fair game. :)

If you need to lock down your journal quickly, I recommend hidejournal. It's quick & easy. It does the work for you. I suggest changing your password before you run it and after it's finished though.
(Reply) (Parent) (Thread)
[User Picture Icon]
From:spydielives
Date:March 1st, 2006 10:24 pm (UTC)
(Permanent Link)
Me too. So many sites now read the master feed from LJ, there is no control over who has a link to your public entries.

I searched once and found references to my entries on several toy sites (because I mentioned a particular trademarked game), clothing sites (uh, because I talk about clothing?), politics (ditto, oh and because I trackback)...

I locked it all down. It isn't that robots are necessarily crawling your site looking for things to archive; anyone can easily write an rss feed for any LJ site (see http://jakarta.apache.org/commons/sandbox/feedparser/apidocs/org/apache/commons/feedparser/locate/blogservice/LiveJournal.html) for more information.
(Reply) (Parent) (Thread)