Zelaron Gaming Forum  
Stats Arcade Portal Forum FAQ Members List Social Groups Calendar Search Today's Posts Mark Forums Read
Go Back   Zelaron Gaming Forum > The Zelaron Nexus > Science and Art > Tech Help

 
 
Thread Tools Display Modes

 
Want a browser that tells sites it's a bot
Reply
Posted 2008-10-14, 10:19 AM
After getting lots of search hits into documents that the sites want me to pay to view, I had an idea: Why not tell the site that I'm a Google bot? That's how Google got the full text of the document in the first place, no? Because the site saw it was a Google bot and gave it full access?

Does anyone know of a browser that lets you set the user-agent header to make sites think it's a bot/different browser?
Old
Profile PM WWW Search
WetWired read his obituary with confusionWetWired read his obituary with confusionWetWired read his obituary with confusionWetWired read his obituary with confusion
 
 
WetWired
 



 
Reply
Posted 2008-10-14, 12:56 PM in reply to WetWired's post "Want a browser that tells sites it's a..."
Well, I know you can view it with almost any browser (IE/Mozilla). No clue though as to how you could set it, you'd probably have to write your own hack.














Quote:
!King_Amazon!: I talked to him while he was getting raped
[quote][16:04] jamer123: GRRR firefox just like quit on me now on internet exploder[quote]
...
[quote=!King_Amazon!]notices he's 3 inches shorter than her son and he's circumcised [quote]
Old
Profile PM WWW Search
D3V is convinced there are no coincidences, only the illusion of coincidencesD3V is convinced there are no coincidences, only the illusion of coincidencesD3V is convinced there are no coincidences, only the illusion of coincidencesD3V is convinced there are no coincidences, only the illusion of coincidencesD3V is convinced there are no coincidences, only the illusion of coincidencesD3V is convinced there are no coincidences, only the illusion of coincidences
 
 
D3V
 



 
Reply
Posted 2008-10-14, 01:07 PM in reply to WetWired's post "Want a browser that tells sites it's a..."
WetWired said: [Goto]
After getting lots of search hits into documents that the sites want me to pay to view, I had an idea: Why not tell the site that I'm a Google bot? That's how Google got the full text of the document in the first place, no? Because the site saw it was a Google bot and gave it full access?

Does anyone know of a browser that lets you set the user-agent header to make sites think it's a bot/different browser?
Not that I know much about it, but is it possible that your IP address has something to do with it? I think google bots all have similar IP addresses. Maybe websites allow certain ranges to view everything because they're used by bots.

Dunno, just a thought. I really don't know anything about it.
Old
Profile PM WWW Search
!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics
 
 
!King_Amazon!
 



 
Reply
Posted 2008-10-14, 01:23 PM in reply to !King_Amazon!'s post starting "Not that I know much about it, but is..."
about:config contains some interesting information in FireFox, e.g. general.useragent.extra.firefox.
"Stephen Wolfram is the creator of Mathematica and is widely regarded as the most important innovator in scientific and technical computing today." - Stephen Wolfram
Old
Profile PM WWW Search
Chruser shouldn't have fed itChruser shouldn't have fed itChruser shouldn't have fed itChruser shouldn't have fed itChruser shouldn't have fed it
 
 
Chruser
 



 
Reply
Posted 2008-10-14, 02:18 PM in reply to Chruser's post starting "about:config contains some interesting..."
But that's not the entire useragent string. KA, most things I've heard of that behave differently for search engine bots do so by useragent string. It's more reliable than IP address.
Old
Profile PM WWW Search
WetWired read his obituary with confusionWetWired read his obituary with confusionWetWired read his obituary with confusionWetWired read his obituary with confusion
 
 
WetWired
 



 
Reply
Posted 2008-10-14, 02:24 PM in reply to WetWired's post starting "But that's not the entire useragent..."
Well looking through "about:config" like Chruser suggested, I found this. Maybe it would be of use to you. See attachment.

You can change those, so if you knew what you wanted/needed to change them to, you're in the money.
Attached Images
File Type: jpg config.JPG (73.3 KB, 13 views)
Old
Profile PM WWW Search
!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics!King_Amazon! simplifies with no grasp of the basics
 
 
!King_Amazon!
 



 
Reply
Posted 2008-10-14, 03:54 PM in reply to !King_Amazon!'s post starting "Well looking through "about:config"..."
What I'm looking for will include the word "Mozilla"
Old
Profile PM WWW Search
WetWired read his obituary with confusionWetWired read his obituary with confusionWetWired read his obituary with confusionWetWired read his obituary with confusion
 
 
WetWired
 



 
Reply
Posted 2008-10-14, 10:12 PM in reply to WetWired's post starting "What I'm looking for will include the..."
http://www.walkernews.net/2007/07/05...-agent-string/

Quote:

How to change User Agent String of Mozilla Firefox?

1. Type about:config in the Mozilla Firefox address bar and press ENTER,

2. Type general.useragent.extra.firefox in the Filter bar,

3. Double-click on the returned Firefox setting, where you can change or spoof a user agent string to overwrite the default “Firefox/2.0.0.4″!
Old
Profile PM WWW Search
Hayduke is neither ape nor machine; has so far settled for the in-betweenHayduke is neither ape nor machine; has so far settled for the in-between
 
 
Hayduke
 



 
Reply
Posted 2008-10-14, 11:19 PM in reply to WetWired's post starting "What I'm looking for will include the..."
I dunno if this helps any, but here's this...
R.I.P
Pontiac
Jan. 1926 - Dec. 2010 est.

Check the Gallery and Scrapbook often!
[deviantArt Account!]

Spy Hard
Agent WD-40:
Quote:
Well, you carry a UB-21 Schnauzer with an OPS Silencer, that's KGB, You prefer an 18-K over an AK, Your surveillance technique is NSA, Your ID is CIA, you recieved your PHD at NYU, traded in your GTO for a BMW, you listen to CD's by REM and STP, and you'd like to see JFK in his BVDs getting down with OPP and you probably put the toilet paper back on the roll with the paper on the inside...
Old
Profile PM WWW Search
Draco2003 has an imagination enthroned in its own recess, incomprehensible as from darknessDraco2003 has an imagination enthroned in its own recess, incomprehensible as from darknessDraco2003 has an imagination enthroned in its own recess, incomprehensible as from darkness
 
 
Draco2003
 



 
Reply
Posted 2008-10-15, 08:06 PM in reply to WetWired's post starting "What I'm looking for will include the..."
Here are instructions for IE

http://classictutorials.blogspot.com...free-pass.html

Here are instructions for FireFox

https://addons.mozilla.org/en-US/firefox/addon/4420

All you have to do for the FireFox one is install, restart, and open and click on the Googlebot 2.1 for your user-agent.

Here is a way to test it. If you don't have an account and aren't logged in, this page should have an error if you aren't a googlebot. If you are like me, you will be able to view the page.

http://governmentsecurity.org/forum/...howtopic=30321
 
Work List
疲れていますから 寝むってありますね。 むずかしいです。 また、ケーキ屋で ケーキを食べていました。

I've considered being a translator, but I dunno. It feels like a lot of work. If someone gets angry then I have to deal with it, you know? I'd rather just relax.

 
Speed Test
 
Favorite Anime/Manga
#01 Clannad ~After Story~
#02 Trigun {Maximum}
#03 Koi Kaze
#04 Berserk
#05 Outlaw Star
#06 Slayers
#07 Desert Punk
#08 Spirited Away
#09 Fullmetal Alchemist
#10 Shakugan no Shana
#11 Death Note
#12 FLCL
#13 Tokyo Magnitude 8.0
#14 Toradora
#15 Gunslinger Girl

 
Anime List

Last edited by Goodlookinguy; 2008-11-03 at 01:05 AM.
Old
Profile PM WWW Search
Goodlookinguy seldom sees opportunities until they cease to beGoodlookinguy seldom sees opportunities until they cease to beGoodlookinguy seldom sees opportunities until they cease to beGoodlookinguy seldom sees opportunities until they cease to be
 
 
Goodlookinguy
 
 

Bookmarks

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules [Forum Rules]
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
THE MESSAGE TELLS THe TRUTH! EX-Mania The Lounge 41 2002-07-04 06:06 PM


All times are GMT -6. The time now is 12:40 AM.
'Synthesis 2' vBulletin 3.x styles and 'x79' derivative
by WetWired the Unbound and Chruser
Copyright ©2002-2008 zelaron.com
Powered by vBulletin® Version 3.8.2
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
This site is best seen with your eyes open.