When I visit this site http://ifconfig.me/ip using the web browser I get the expected text output. However if I try to do it from Pharo 6.1 (Windows 8.1) I get a 403 forbidden response using this code: ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; get. 2018-09-16 03:06:18 011 Retrying ConnectionTimedOut: Cannot connect to 153.121.72.212:80 2018-09-16 03:06:19 012 Connection Established ifconfig.me:80 153.121.72.212 288ms 2018-09-16 03:06:19 013 Request Written a ZnRequest(GET /all.xml) 1ms 2018-09-16 03:06:19 014 Response Read a ZnResponse(403 Forbidden text/html;charset=iso-8859-1 209B) 318ms 2018-09-16 03:06:19 015 GET /all.xml 403 209B 319ms 2018-09-16 03:06:19 016 Connection Closed 153.121.72.212:80 In Firefox this is the output Request Headers Firefox: Host: ifconfig.me User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-US Accept-Encoding: gzip, deflate DNT: 1 Connection: keep-alive Upgrade-Insecure-Requests: 1 Response Headers Firefox: HTTP/1.1 200 OK Date: Sun, 16 Sep 2018 16:47:02 GMT Server: Apache Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 32 Connection: close Content-Type: text/plain Any idea? Cheers, Hernán
Because they don't like Pharo or Zinc ;-) ZnClient new systemPolicy; beOneShot; url: 'http://ifconfig.me/ip'; accept: ZnMimeType textPlain; headerAt: 'User-Agent' put: 'curl/7.54.0'; get. Changing the User-Agent (effectively lying) works.
On 10 Oct 2018, at 22:02, Hernán Morales Durand <hernan.morales@gmail.com> wrote:
When I visit this site http://ifconfig.me/ip using the web browser I get the expected text output. However if I try to do it from Pharo 6.1 (Windows 8.1) I get a 403 forbidden response using this code:
ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; get.
2018-09-16 03:06:18 011 Retrying ConnectionTimedOut: Cannot connect to 153.121.72.212:80 2018-09-16 03:06:19 012 Connection Established ifconfig.me:80 153.121.72.212 288ms 2018-09-16 03:06:19 013 Request Written a ZnRequest(GET /all.xml) 1ms 2018-09-16 03:06:19 014 Response Read a ZnResponse(403 Forbidden text/html;charset=iso-8859-1 209B) 318ms 2018-09-16 03:06:19 015 GET /all.xml 403 209B 319ms 2018-09-16 03:06:19 016 Connection Closed 153.121.72.212:80
In Firefox this is the output
Request Headers Firefox:
Host: ifconfig.me User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-US Accept-Encoding: gzip, deflate DNT: 1 Connection: keep-alive Upgrade-Insecure-Requests: 1
Response Headers Firefox:
HTTP/1.1 200 OK Date: Sun, 16 Sep 2018 16:47:02 GMT Server: Apache Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 32 Connection: close Content-Type: text/plain
Any idea?
Cheers,
Hernán
Wow, didn't knew that someone actually could reject/allow specific UAs. Thank you Sven, Cheers, Hernán El mié., 10 oct. 2018 a las 17:33, Sven Van Caekenberghe (<sven@stfx.eu>) escribió:
Because they don't like Pharo or Zinc ;-)
ZnClient new systemPolicy; beOneShot; url: 'http://ifconfig.me/ip'; accept: ZnMimeType textPlain; headerAt: 'User-Agent' put: 'curl/7.54.0'; get.
Changing the User-Agent (effectively lying) works.
On 10 Oct 2018, at 22:02, Hernán Morales Durand <hernan.morales@gmail.com> wrote:
When I visit this site http://ifconfig.me/ip using the web browser I get the expected text output. However if I try to do it from Pharo 6.1 (Windows 8.1) I get a 403 forbidden response using this code:
ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; get.
2018-09-16 03:06:18 011 Retrying ConnectionTimedOut: Cannot connect to 153.121.72.212:80 2018-09-16 03:06:19 012 Connection Established ifconfig.me:80 153.121.72.212 288ms 2018-09-16 03:06:19 013 Request Written a ZnRequest(GET /all.xml) 1ms 2018-09-16 03:06:19 014 Response Read a ZnResponse(403 Forbidden text/html;charset=iso-8859-1 209B) 318ms 2018-09-16 03:06:19 015 GET /all.xml 403 209B 319ms 2018-09-16 03:06:19 016 Connection Closed 153.121.72.212:80
In Firefox this is the output
Request Headers Firefox:
Host: ifconfig.me User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-US Accept-Encoding: gzip, deflate DNT: 1 Connection: keep-alive Upgrade-Insecure-Requests: 1
Response Headers Firefox:
HTTP/1.1 200 OK Date: Sun, 16 Sep 2018 16:47:02 GMT Server: Apache Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 32 Connection: close Content-Type: text/plain
Any idea?
Cheers,
Hernán
A lot of thse types of services do that. Not sure why because itâs so easy to spoof anything in an HTTP(s) request... Jerry Kott This message has been digitally signed. PGP Fingerprint: A9181736DD2F1B6CC7CF9E51AC8514F48C0979A5
On 10-10-2018, at 3:32 PM, Hernán Morales Durand <hernan.morales@gmail.com> wrote:
Wow, didn't knew that someone actually could reject/allow specific UAs.
Thank you Sven,
Cheers,
Hernán El mié., 10 oct. 2018 a las 17:33, Sven Van Caekenberghe (<sven@stfx.eu>) escribió:
Because they don't like Pharo or Zinc ;-)
ZnClient new systemPolicy; beOneShot; url: 'http://ifconfig.me/ip'; accept: ZnMimeType textPlain; headerAt: 'User-Agent' put: 'curl/7.54.0'; get.
Changing the User-Agent (effectively lying) works.
On 10 Oct 2018, at 22:02, Hernán Morales Durand <hernan.morales@gmail.com> wrote:
When I visit this site http://ifconfig.me/ip using the web browser I get the expected text output. However if I try to do it from Pharo 6.1 (Windows 8.1) I get a 403 forbidden response using this code:
ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; get.
2018-09-16 03:06:18 011 Retrying ConnectionTimedOut: Cannot connect to 153.121.72.212:80 2018-09-16 03:06:19 012 Connection Established ifconfig.me:80 153.121.72.212 288ms 2018-09-16 03:06:19 013 Request Written a ZnRequest(GET /all.xml) 1ms 2018-09-16 03:06:19 014 Response Read a ZnResponse(403 Forbidden text/html;charset=iso-8859-1 209B) 318ms 2018-09-16 03:06:19 015 GET /all.xml 403 209B 319ms 2018-09-16 03:06:19 016 Connection Closed 153.121.72.212:80
In Firefox this is the output
Request Headers Firefox:
Host: ifconfig.me User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-US Accept-Encoding: gzip, deflate DNT: 1 Connection: keep-alive Upgrade-Insecure-Requests: 1
Response Headers Firefox:
HTTP/1.1 200 OK Date: Sun, 16 Sep 2018 16:47:02 GMT Server: Apache Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 32 Connection: close Content-Type: text/plain
Any idea?
Cheers,
Hernán
Am 11.10.2018 um 02:02 schrieb Jerry Kott <jkott@image-ware.com>:
A lot of thse types of services do that. Not sure why because itâs so easy to spoof anything in an HTTP(s) request...
Technically this is right. Practically you still have to know which content to provide. I use it to get rid of requests to my service. I donât have a problem with those that take the effort to figure out. These are way below 1% of all requests. Norbert
Jerry Kott This message has been digitally signed. PGP Fingerprint: A9181736DD2F1B6CC7CF9E51AC8514F48C0979A5
On 10-10-2018, at 3:32 PM, Hernán Morales Durand <hernan.morales@gmail.com> wrote:
Wow, didn't knew that someone actually could reject/allow specific UAs.
Thank you Sven,
Cheers,
Hernán El mié., 10 oct. 2018 a las 17:33, Sven Van Caekenberghe (<sven@stfx.eu>) escribió:
Because they don't like Pharo or Zinc ;-)
ZnClient new systemPolicy; beOneShot; url: 'http://ifconfig.me/ip'; accept: ZnMimeType textPlain; headerAt: 'User-Agent' put: 'curl/7.54.0'; get.
Changing the User-Agent (effectively lying) works.
On 10 Oct 2018, at 22:02, Hernán Morales Durand <hernan.morales@gmail.com> wrote:
When I visit this site http://ifconfig.me/ip using the web browser I get the expected text output. However if I try to do it from Pharo 6.1 (Windows 8.1) I get a 403 forbidden response using this code:
ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; get.
2018-09-16 03:06:18 011 Retrying ConnectionTimedOut: Cannot connect to 153.121.72.212:80 2018-09-16 03:06:19 012 Connection Established ifconfig.me:80 153.121.72.212 288ms 2018-09-16 03:06:19 013 Request Written a ZnRequest(GET /all.xml) 1ms 2018-09-16 03:06:19 014 Response Read a ZnResponse(403 Forbidden text/html;charset=iso-8859-1 209B) 318ms 2018-09-16 03:06:19 015 GET /all.xml 403 209B 319ms 2018-09-16 03:06:19 016 Connection Closed 153.121.72.212:80
In Firefox this is the output
Request Headers Firefox:
Host: ifconfig.me User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-US Accept-Encoding: gzip, deflate DNT: 1 Connection: keep-alive Upgrade-Insecure-Requests: 1
Response Headers Firefox:
HTTP/1.1 200 OK Date: Sun, 16 Sep 2018 16:47:02 GMT Server: Apache Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 32 Connection: close Content-Type: text/plain
Any idea?
Cheers,
Hernán
It is done very often. In the past you could solve glitches between browser engines. Nowadays it is done e.g. to discover mobile clients. In one of my services the easiest to keep foreigners out was rejecting all requests which are not zinc ð Norbert
Am 11.10.2018 um 00:32 schrieb Hernán Morales Durand <hernan.morales@gmail.com>:
Wow, didn't knew that someone actually could reject/allow specific UAs.
Thank you Sven,
Cheers,
Hernán El mié., 10 oct. 2018 a las 17:33, Sven Van Caekenberghe (<sven@stfx.eu>) escribió:
Because they don't like Pharo or Zinc ;-)
ZnClient new systemPolicy; beOneShot; url: 'http://ifconfig.me/ip'; accept: ZnMimeType textPlain; headerAt: 'User-Agent' put: 'curl/7.54.0'; get.
Changing the User-Agent (effectively lying) works.
On 10 Oct 2018, at 22:02, Hernán Morales Durand <hernan.morales@gmail.com> wrote:
When I visit this site http://ifconfig.me/ip using the web browser I get the expected text output. However if I try to do it from Pharo 6.1 (Windows 8.1) I get a 403 forbidden response using this code:
ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; get.
2018-09-16 03:06:18 011 Retrying ConnectionTimedOut: Cannot connect to 153.121.72.212:80 2018-09-16 03:06:19 012 Connection Established ifconfig.me:80 153.121.72.212 288ms 2018-09-16 03:06:19 013 Request Written a ZnRequest(GET /all.xml) 1ms 2018-09-16 03:06:19 014 Response Read a ZnResponse(403 Forbidden text/html;charset=iso-8859-1 209B) 318ms 2018-09-16 03:06:19 015 GET /all.xml 403 209B 319ms 2018-09-16 03:06:19 016 Connection Closed 153.121.72.212:80
In Firefox this is the output
Request Headers Firefox:
Host: ifconfig.me User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-US Accept-Encoding: gzip, deflate DNT: 1 Connection: keep-alive Upgrade-Insecure-Requests: 1
Response Headers Firefox:
HTTP/1.1 200 OK Date: Sun, 16 Sep 2018 16:47:02 GMT Server: Apache Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 32 Connection: close Content-Type: text/plain
Any idea?
Cheers,
Hernán
Works for me in a 5.0 Did this c :=ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; yourself. c request headers at: 'User-Agent' put: 'Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0'. c get. Response: 95.182.154.13 Phil On Wed, Oct 10, 2018 at 10:02 PM Hernán Morales Durand < hernan.morales@gmail.com> wrote:
When I visit this site http://ifconfig.me/ip using the web browser I get the expected text output. However if I try to do it from Pharo 6.1 (Windows 8.1) I get a 403 forbidden response using this code:
ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; get.
2018-09-16 03:06:18 011 Retrying ConnectionTimedOut: Cannot connect to 153.121.72.212:80 2018-09-16 03:06:19 012 Connection Established ifconfig.me:80 153.121.72.212 288ms 2018-09-16 03:06:19 013 Request Written a ZnRequest(GET /all.xml) 1ms 2018-09-16 03:06:19 014 Response Read a ZnResponse(403 Forbidden text/html;charset=iso-8859-1 209B) 318ms 2018-09-16 03:06:19 015 GET /all.xml 403 209B 319ms 2018-09-16 03:06:19 016 Connection Closed 153.121.72.212:80
In Firefox this is the output
Request Headers Firefox:
Host: ifconfig.me User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-US Accept-Encoding: gzip, deflate DNT: 1 Connection: keep-alive Upgrade-Insecure-Requests: 1
Response Headers Firefox:
HTTP/1.1 200 OK Date: Sun, 16 Sep 2018 16:47:02 GMT Server: Apache Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 32 Connection: close Content-Type: text/plain
Any idea?
Cheers,
Hernán
Hi Hernan, quite interesting. I have tried with curl and it works, but with wget it doesn't work. Both using the brew versions in my OSX machine. To me, it is a problem of the headers. Cheers. On Wed, Oct 10, 2018 at 10:07 PM Hernán Morales Durand < hernan.morales@gmail.com> wrote:
When I visit this site http://ifconfig.me/ip using the web browser I get the expected text output. However if I try to do it from Pharo 6.1 (Windows 8.1) I get a 403 forbidden response using this code:
ZnClient new systemPolicy; beOneShot; accept: ZnMimeType textPlain; timeout: 6000; url: 'http://ifconfig.me/ip'; get.
2018-09-16 03:06:18 011 Retrying ConnectionTimedOut: Cannot connect to 153.121.72.212:80 2018-09-16 03:06:19 012 Connection Established ifconfig.me:80 153.121.72.212 288ms 2018-09-16 03:06:19 013 Request Written a ZnRequest(GET /all.xml) 1ms 2018-09-16 03:06:19 014 Response Read a ZnResponse(403 Forbidden text/html;charset=iso-8859-1 209B) 318ms 2018-09-16 03:06:19 015 GET /all.xml 403 209B 319ms 2018-09-16 03:06:19 016 Connection Closed 153.121.72.212:80
In Firefox this is the output
Request Headers Firefox:
Host: ifconfig.me User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:62.0) Gecko/20100101 Firefox/62.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-US Accept-Encoding: gzip, deflate DNT: 1 Connection: keep-alive Upgrade-Insecure-Requests: 1
Response Headers Firefox:
HTTP/1.1 200 OK Date: Sun, 16 Sep 2018 16:47:02 GMT Server: Apache Vary: Accept-Encoding Content-Encoding: gzip Content-Length: 32 Connection: close Content-Type: text/plain
Any idea?
Cheers,
Hernán
-- Pablo Tesone. tesonep@gmail.com
participants (6)
-
Hernán Morales Durand -
Jerry Kott -
Norbert Hartl -
phil＠highoctane.be -
Sven Van Caekenberghe -
tesonep＠gmail.com