lynx-dev
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Lynx-dev] about user agent headers is sudden site access failure: realc


From: Karen Lewellen
Subject: [Lynx-dev] about user agent headers is sudden site access failure: realclearpolitics.com
Date: Fri, 12 Nov 2021 19:31:59 -0500 (EST)

Hi Rudy, everyone.
Is the user agent header field saved when changed, if one chooses the write options to disc selection? I want to test Rudy's user agent on my office shell, and as that does not seem to be a cut / paste box, wanted to ask before I try and work on this.
Thanks,
Karen



On Fri, 12 Nov 2021, Rudy Vener wrote:

Hi Ian,

Okay, so I modified my lynx.cfg to use HTTP_PROTOCOL:1.1 and
to enable its setting in the lynxrc file.
Set my user agent to:
Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; XH; rv:8.578.498) fr, 
Gecko/20121021 Camino/8.723+ (Firefox compatible)

and tried to access http://www.realclearpolitics.com once more.

and get a landing page with this:

  Please enable JS and disable any ad blocker

It looks like they just aren't going to allow any browsers that don't support 
javascript.

Or am I missing something else?

On Thu, 11 Nov 2021, Ian Collier wrote:



I find it interesting that Lynx cannot verify the certificate of
'realclearpolitics.com' (without the www) because the server is
not returning the certificate chain.  But with the www is a completely
different server which does have a valid certificate.

Anyway I have found that links (the chain) will display the web site
correctly by default, but gets denied if I supply any one (or more)
of the following options:

 -http-bugs.no-compression 1
 -http-bugs.http10 1
 -http.fake-user-agent Lynx

So as far as Lynx (the cat) is concerned, what we need to do in order
to visit this site is (a) change the user agent, and (b) enable HTTP 1.1.

Enable HTTP 1.1 can be done either in the Options screen or in lynx.cfg.
User agent can be done either in Options or on the command line.  My
experimentation shows that they want at least your OS in the user agent,
so "Lynx (Linux 5)" works, while Lynx's default user agent does not
because it doesn't contain the OS name.

imc



--
ent-

--
Rudy Vener
Website: http://www.rudyvener.com
Twitter: https://twitter.com/RudySalt





reply via email to

[Prev in Thread] Current Thread [Next in Thread]