I'm building a program that every 5 minutes query a NO-BREAK battery status, 
to see time left and take some actions.

NO-BREAK offers information via HTTP, with basic authentication.

It seems to me that LoadFromURL works fine at the very first call but, later, 
it gets hooked.

Have you ever experienced such a problem ?

Here's my little test program :

# INCLUDE "ASINET.CH"

PROC MAIN

LOCAL LCHTML

WHILE .T.
   ? "BEFORE LOADFROMURL..."
   LCHTML:=LOADFROMURL("http://admin:nobreak@10.2.0.4/Status.htm",,,,,"GET")
   //LCHTML:=LOADFROMURL("http://anonymous:minieme@www.alaska-software.com")
   ? "@ " + TIME() + " " + LEFT(LCHTML,30) + "..."
   ? "AFTER LOADFROMURL..."
   INKEY(0)
END WHILE

RETURN

And this is how I've compiled it :

CALL SETXPP
XPP XTEST294 /A /ES /M /N /Q /V /W /ERR:20 /DLL:DYNAMIC /WN /LINK
IF  ERRORLEVEL 1 GOTO EOJ
XTEST294.EXE
:EOJ

I'm almost opening a PDR.

Should you have some clue, however...

About the same problem, if that is worth, LoadFromURL from Phil Ide also fails 
on the same situation...

Jose Adriano Baltieri wrote:
> I'm building a program that every 5 minutes query a NO-BREAK battery 
> status, to see time left and take some actions.
> 
> NO-BREAK offers information via HTTP, with basic authentication.
> 
> It seems to me that LoadFromURL works fine at the very first call but, 
> later, it gets hooked.
> 
> Have you ever experienced such a problem ?
> 
> Here's my little test program :
> 
> # INCLUDE "ASINET.CH"
> 
> PROC MAIN
> 
> LOCAL LCHTML
> 
> WHILE .T.
>   ? "BEFORE LOADFROMURL..."
>   LCHTML:=LOADFROMURL("http://admin:nobreak@10.2.0.4/Status.htm",,,,,"GET")
>   //LCHTML:=LOADFROMURL("http://anonymous:minieme@www.alaska-software.com")
>   ? "@ " + TIME() + " " + LEFT(LCHTML,30) + "..."
>   ? "AFTER LOADFROMURL..."
>   INKEY(0)
> END WHILE
> 
> RETURN
> 
> And this is how I've compiled it :
> 
> CALL SETXPP
> XPP XTEST294 /A /ES /M /N /Q /V /W /ERR:20 /DLL:DYNAMIC /WN /LINK
> IF  ERRORLEVEL 1 GOTO EOJ
> XTEST294.EXE
> :EOJ
> 
> I'm almost opening a PDR.
> 
> Should you have some clue, however...

Jose Adriano Baltieri wrote:

> About the same problem, if that is worth, LoadFromURL from Phil Ide also fails 
> on the same situation...

Did you try repeatedly with a real browser or with a program like WebBug
(http://www.cyberspyder.com/webbug.html)?

Thomas Braun

Thomas Braun wrote:
> Jose Adriano Baltieri wrote:
> 
> 
>>About the same problem, if that is worth, LoadFromURL from Phil Ide also fails 
>>on the same situation...
> 
> 
> Did you try repeatedly with a real browser or with a program like WebBug
> (http://www.cyberspyder.com/webbug.html)?
> 
At least with a browser like Mozilla or Internet Explorer, it works fine. 
Authentication is required at the very first call. Then reload is OK....


> Thomas Braun

Thomas Braun wrote:
> Jose Adriano Baltieri wrote:
> 
> 
>>About the same problem, if that is worth, LoadFromURL from Phil Ide also fails 
>>on the same situation...
> 
> 
> Did you try repeatedly with a real browser or with a program like WebBug
> (http://www.cyberspyder.com/webbug.html)?
> 

I have tried the same process upon another Web Server and, it works.

So, there must be some particularity on this specific site that makes 
LoadFromURL get hanged when called twice.

Got to see now what is it...

Thanks for your support !

Jose Adriano Baltieri wrote:
 
> I have tried the same process upon another Web Server and, it works.
> 
> So, there must be some particularity on this specific site that makes 
> LoadFromURL get hanged when called twice.
> 
> Got to see now what is it...

One more idea... use a tool like Ethereal to actually see what requests
LoadFromURL is submitting to the server and what replies the server sends.

Thomas

Thomas Braun wrote:

> Jose Adriano Baltieri wrote:
>  
> 
>>I have tried the same process upon another Web Server and, it works.
>>
>>So, there must be some particularity on this specific site that makes 
>>LoadFromURL get hanged when called twice.
>>
>>Got to see now what is it...
> 
> 
> One more idea... use a tool like Ethereal to actually see what requests
> LoadFromURL is submitting to the server and what replies the server sends.
> 
> Thomas

Thank you Thomas !

I always wanted to learn to use Ethereal but I find it too complex.

I have another tool, maybe you already know, called CURL - Command Line URL.

I like it a lot cause it's command line based (I'm a console world guy) and, 
it has *a*lot* of parameters.

One of them exposes the http headers.

On another posting of this thread I offered Phil Ide some captures of data.

If you dont know CURL yet, it's worth getting it.

Also because you can automate your URL captures on your batch files.

At the end of this story of mine , if I cant find a solution for LoadFromURL, 
I can use RUNSHELL to run CURL and capture data because CURL works with 
authentication. I just dont want to do it now cause I think it is too heavy 
(and cumbersome). But it would work anyway.

Thank you again.

Jose Adriano Baltieri wrote:

> I always wanted to learn to use Ethereal but I find it too complex.

Ethereal can't be called *complex*, but the mere number of possible
protcols that Ethereal can display is complex 

The problem in your case seems to be that there is a difference in the
communication between LoadFromURL() and the other methods. 

I think only a protocol sniffer can show you what goes wrong (or Alaska has
to check this)
 
> 
> If you dont know CURL yet, it's worth getting it.

I will take a look, thanks for that hint!

Thomas Braun

Adriano,

> I'm building a program that every 5 minutes query a NO-BREAK battery status, 
> to see time left and take some actions.
> 
> NO-BREAK offers information via HTTP, with basic authentication.

I have a solution for you, but it requires either ASINET or Xb2.NET.
Interested?  I've tested this against a protected realm on one of my local
webs, and it has no prblems at all.

Regards,

Phil Ide

***************************************
* Xbase++ FAQ, Libraries and Sources: *
* goto: http://www.idep.org.uk/xbase  *
***************************************

A*C, who said A*C?

Adriano,

>> I'm building a program that every 5 minutes query a NO-BREAK battery status, 
>> to see time left and take some actions.
>> 
>> NO-BREAK offers information via HTTP, with basic authentication.
> 
> I have a solution for you, but it requires either ASINET or Xb2.NET.
> Interested?  I've tested this against a protected realm on one of my local
> webs, and it has no prblems at all.

Even better, it now no longer needs ASINET or Xb2.NET.  There is an
additional parameter you can pass to it which is an array containing the
authentication credentials.

LoadFromUrl(cUrl,,,,,,,,,,,{"myName","myPassword"})

I've uploaded it (now at v1.4) - so download and play and tell me whether
it works for you or not.

Regards,

Phil Ide

***************************************
* Xbase++ FAQ, Libraries and Sources: *
* goto: http://www.idep.org.uk/xbase  *
***************************************

Spam Spam Spam Spam, Spammity Spammmm, Spam, Spam, Spam

Phil Ide wrote:
> Adriano,
> 
> 
>>>I'm building a program that every 5 minutes query a NO-BREAK battery status, 
>>>to see time left and take some actions.
>>>
>>>NO-BREAK offers information via HTTP, with basic authentication.
>>
>>I have a solution for you, but it requires either ASINET or Xb2.NET.
>>Interested?  I've tested this against a protected realm on one of my local
>>webs, and it has no prblems at all.
> 
> 
> Even better, it now no longer needs ASINET or Xb2.NET.  There is an
> additional parameter you can pass to it which is an array containing the
> authentication credentials.
> 
> LoadFromUrl(cUrl,,,,,,,,,,,{"myName","myPassword"})
> 
> I've uploaded it (now at v1.4) - so download and play and tell me whether
> it works for you or not.

First of all, thank you again.

Unfortunatelly, it didnt work. It gets hooked at the very first call.

The problem, again, is regarded to this specific site of mine (a http server 
that runs inside the NO-BREAK machine).

When I run your LoadFromUrl using authentication, upon another site, it works. 
But on this NO-BREAK site, there's NO-SIGNAL result.

I've managed to capture the http headers from both of them using CURL (Command 
Line URL), a very useful tool on these contexts.

Here they are :

Http headers for the URL below, where the function works fine

http://tuser:tpassword@www.DES.online.unimep.br/fm/teste.htm

HTTP/1.1 200 OK
Date: Thu, 03 Feb 2005 22:33:05 GMT
Server: WebSite/3.5.17
Accept-ranges: bytes
Connection: Keep-Alive
Content-type: text/html
Last-modified: Thu, 03 Feb 2005 10:26:20 GMT
Content-length: 127

Now, the NO-BREAK headers :

HTTP/1.1 200 OK
Date: Thu, 03 Feb 2005 20:33:41 GMT
Server: NetAgent
Connection: close
Content-Length: 2569
Content-Type: text/html


Hope it can bring you some light.


> 
> Regards,

Adriano,

> Now, the NO-BREAK headers :
> 
> HTTP/1.1 200 OK
> Date: Thu, 03 Feb 2005 20:33:41 GMT
> Server: NetAgent
> Connection: close
> Content-Length: 2569
> Content-Type: text/html
> 
> 
> Hope it can bring you some light.

Well, this looks ok actually.  It returned a page of 2569 bytes, and the
server reported 200 OK, which means no errors (and also means no Access
Denied).

I'll take a closer look when I get your email.

Regards,

Phil Ide

***************************************
* Xbase++ FAQ, Libraries and Sources: *
* goto: http://www.idep.org.uk/xbase  *
***************************************

To clone a felon, do I use the COPY CON command?

Phil Ide wrote:

> Adriano,
> 
> 
>>>I'm building a program that every 5 minutes query a NO-BREAK battery status, 
>>>to see time left and take some actions.
>>>
>>>NO-BREAK offers information via HTTP, with basic authentication.
>>
>>I have a solution for you, but it requires either ASINET or Xb2.NET.
>>Interested?  I've tested this against a protected realm on one of my local
>>webs, and it has no prblems at all.
> 
> 
> Even better, it now no longer needs ASINET or Xb2.NET.  There is an
> additional parameter you can pass to it which is an array containing the
> authentication credentials.
> 
> LoadFromUrl(cUrl,,,,,,,,,,,{"myName","myPassword"})
> 
> I've uploaded it (now at v1.4) - so download and play and tell me whether
> it works for you or not.
> 
One more thing : if I run it with lHeadersOnly turned on, it works.

> Regards,

Phil Ide wrote:
> Adriano,
> 
> 
>>>I'm building a program that every 5 minutes query a NO-BREAK battery status, 
>>>to see time left and take some actions.
>>>
>>>NO-BREAK offers information via HTTP, with basic authentication.
>>
>>I have a solution for you, but it requires either ASINET or Xb2.NET.
>>Interested?  I've tested this against a protected realm on one of my local
>>webs, and it has no prblems at all.
> 
> 
> Even better, it now no longer needs ASINET or Xb2.NET.  There is an
> additional parameter you can pass to it which is an array containing the
> authentication credentials.
> 
> LoadFromUrl(cUrl,,,,,,,,,,,{"myName","myPassword"})
> 
> I've uploaded it (now at v1.4) - so download and play and tell me whether
> it works for you or not.
> 

And, yet, another thing :

I have a modified version of your LoadFromURL where I added a cHTTPHeaders 
parameter that is supposed to be called by reference.

I dont like your lHTTPHeaders only version because I have to hit the server twice.

I prefer to hit the server once and retrieve the header and content on a 
single operation.

Should you want to have a look at this version of mine, it's attached.

Also miss in LoadFromURL a Timeout parameter...
> Regards,

Adriano,

> I have a modified version of your LoadFromURL where I added a cHTTPHeaders 
> parameter that is supposed to be called by reference.
> 
> I dont like your lHTTPHeaders only version because I have to hit the server twice.

No you don't.

If you ONLY want the headers, set lHttpHeaders TRUE.

If you want both the headers AND the content, pass an empty array as the
11th parameter, and set lHeadersOnly (10th parameter) to FALSE.

LoadFromUrl(  cURL       , ;
                        nPortNumber , ;
                        nProtocol   , ;
                        cProxyUrl   , ;
                        acByPass    , ;
                        cMethod     , ;
                        cPostString , ;
                        cHttpHeaders, ;
                        bPreCall    , ;
                        lHeadersOnly, ;
                        aHeaders    , ;
                        aAuthInfo  )

aHeaders is returned looking something like this:

{
  'HTTP/1.1 200 OK',
  'Date: Thu, 03 Feb 2005 22:33:05 GMT',
  'Server: WebSite/3.5.17',
  'Accept-ranges: bytes',
  'Connection: Keep-Alive',
  'Content-type: text/html',
  'Last-modified: Thu, 03 Feb 2005 10:26:20 GMT',
  'Content-length: 127'
}

Regards,

Phil Ide

***************************************
* Xbase++ FAQ, Libraries and Sources: *
* goto: http://www.idep.org.uk/xbase  *
***************************************

This operating system wasn't released... it escaped!

Phil Ide wrote:

> Adriano,
> 
> 
>>I have a modified version of your LoadFromURL where I added a cHTTPHeaders 
>>parameter that is supposed to be called by reference.
>>
>>I dont like your lHTTPHeaders only version because I have to hit the server twice.
> 
> 
> No you don't.
> 
> If you ONLY want the headers, set lHttpHeaders TRUE.
> 
> If you want both the headers AND the content, pass an empty array as the
> 11th parameter, and set lHeadersOnly (10th parameter) to FALSE.

Great. I've done like this and it worked. Also, it is nice to have the headers 
returned as an array. Easy to work with. With my former approach, I had to 
parse the string on my own. Now it comes ready , already.

Thanks again !
> 
> LoadFromUrl(  cURL       , ;
>                         nPortNumber , ;
>                         nProtocol   , ;
>                         cProxyUrl   , ;
>                         acByPass    , ;
>                         cMethod     , ;
>                         cPostString , ;
>                         cHttpHeaders, ;
>                         bPreCall    , ;
>                         lHeadersOnly, ;
>                         aHeaders    , ;
>                         aAuthInfo  )
> 
> aHeaders is returned looking something like this:
> 
> {
>   'HTTP/1.1 200 OK',
>   'Date: Thu, 03 Feb 2005 22:33:05 GMT',
>   'Server: WebSite/3.5.17',
>   'Accept-ranges: bytes',
>   'Connection: Keep-Alive',
>   'Content-type: text/html',
>   'Last-modified: Thu, 03 Feb 2005 10:26:20 GMT',
>   'Content-length: 127'
> }
> 
> Regards,

Adriano,

>> If you want both the headers AND the content, pass an empty array as the
>> 11th parameter, and set lHeadersOnly (10th parameter) to FALSE.
> 
> Great. I've done like this and it worked. Also, it is nice to have the headers 
> returned as an array. Easy to work with. With my former approach, I had to 
> parse the string on my own. Now it comes ready , already.

See, it pays to pay attention to the docs .  I think that feature went
in at v1.3 or possibly 1.2.

Regards,

Phil Ide

***************************************
* Xbase++ FAQ, Libraries and Sources: *
* goto: http://www.idep.org.uk/xbase  *
***************************************

I Wonder What The Big Red Button Does....?

Phil Ide wrote:
> Adriano,
> 
> 
>>>I'm building a program that every 5 minutes query a NO-BREAK battery status, 
>>>to see time left and take some actions.
>>>
>>>NO-BREAK offers information via HTTP, with basic authentication.
>>
>>I have a solution for you, but it requires either ASINET or Xb2.NET.
>>Interested?  I've tested this against a protected realm on one of my local
>>webs, and it has no prblems at all.
> 
> 
> Even better, it now no longer needs ASINET or Xb2.NET.  There is an
> additional parameter you can pass to it which is an array containing the
> authentication credentials.
> 
> LoadFromUrl(cUrl,,,,,,,,,,,{"myName","myPassword"})
> 
> I've uploaded it (now at v1.4) - so download and play and tell me whether
> it works for you or not.

It looks like I took the day to post to you !

Well, I thought it would be nice if you could have access to this ip of our 
NO-BREAK an have your tests working upon it.

Then, I changed its IP to a valid one.

I'll send you a private email with information, so that you can make your tests.

Thanks again !

> 
> Regards,

Adriano,

> Well, I thought it would be nice if you could have access to this ip of our 
> NO-BREAK an have your tests working upon it.
> 
> Then, I changed its IP to a valid one.
> 
> I'll send you a private email with information, so that you can make your tests.

I've tried the IP address you sent me, and it cannot be found.  I've tried
with LoadFromUrl(), Internet Explorer and PING, and I just can't see the
server at all.

Regards,

Phil Ide

***************************************
* Xbase++ FAQ, Libraries and Sources: *
* goto: http://www.idep.org.uk/xbase  *
***************************************

You mean, we have ANOTHER modem to feed?

Phil Ide wrote:
> Adriano,
> 
> 
>>Well, I thought it would be nice if you could have access to this ip of our 
>>NO-BREAK an have your tests working upon it.
>>
>>Then, I changed its IP to a valid one.
>>
>>I'll send you a private email with information, so that you can make your tests.
> 
> 
> I've tried the IP address you sent me, and it cannot be found.  I've tried
> with LoadFromUrl(), Internet Explorer and PING, and I just can't see the
> server at all.

Sorry ! It's that I had asked to the Net guy to free our firewall to you and 
he hadn't done it yet.

Now it's done, I hope.

Try once more, will you ?


> 
> Regards,

Adriano,

>> I've tried the IP address you sent me, and it cannot be found.  I've tried
>> with LoadFromUrl(), Internet Explorer and PING, and I just can't see the
>> server at all.
> 
> Sorry ! It's that I had asked to the Net guy to free our firewall to you and 
> he hadn't done it yet.
> 
> Now it's done, I hope.
> 
> Try once more, will you ?

Ok, done and found the problem and fixed it.  It was a bug in a buffer test
when HTTP_QUERY_CONTENT_LENGTH failed.

I've uploaded v1.5.

Regards,

Phil Ide

***************************************
* Xbase++ FAQ, Libraries and Sources: *
* goto: http://www.idep.org.uk/xbase  *
***************************************

Please excuse me while I ROFL.

Phil Ide wrote:
> Adriano,
> 
> 
>>>I've tried the IP address you sent me, and it cannot be found.  I've tried
>>>with LoadFromUrl(), Internet Explorer and PING, and I just can't see the
>>>server at all.
>>
>>Sorry ! It's that I had asked to the Net guy to free our firewall to you and 
>>he hadn't done it yet.
>>
>>Now it's done, I hope.
>>
>>Try once more, will you ?
> 
> 
> Ok, done and found the problem and fixed it.  It was a bug in a buffer test
> when HTTP_QUERY_CONTENT_LENGTH failed.
> 
> I've uploaded v1.5.
> 
I've tested it and it worked fine. Thank you again !
> Regards,

Adriano,

>> I've uploaded v1.5.
>> 
> I've tested it and it worked fine. Thank you again !

No problem - this function is going to come in very handy later this
year.

Regards,

Phil Ide

***************************************
* Xbase++ FAQ, Libraries and Sources: *
* goto: http://www.idep.org.uk/xbase  *
***************************************

Have time to waste? Get Microsoft Windows 3.0!

Phil Ide wrote:
> Adriano,
> 
> 
>>>I've uploaded v1.5.
>>>
>>
>>I've tested it and it worked fine. Thank you again !
> 
> 
> No problem - this function is going to come in very handy later this
> year.

Now I'm curious...

> 
> Regards,

<snip>
> > No problem - this function is going to come in very handy later this
> > year.
>
> Now I'm curious...
We can expect anything and everything from the xbMagic'ian Phil 

Anand

NB: Since the bug was found in ASINET LoadFromUrl() too, will someone from
A/S/T aka Alaska issue a PDR for the same ?