[plug] [OT] http: different results from browser and telnet

[Anthony J. Breeds-Taurima]

On Thu, 25 Oct 2001, Carl Gherardi wrote:

> Ok bit more of a description is in order, i'm writing a program in c which
> get the results of a web search by directly querying a search engine then
> iteratively fetching and stripping links out of resulting pages. (see
> gherardi.cs.curtin.edu.au for more details - it doesn't do anything
> atm...)
> 
> Basically my program gets the name www.badlinks.com from a query to
> dmoz.org (Open Directory "redhat linux") and then tries to fetch / from
> that hostname.
> 
> My program returns the pr0n result(which i was emulating using telnet),
> netscape, lynx get one page and dmoz has indexed another(probably out
> of date) page.
> 
> How can I get my page to return the same as netscape?

open socket
fprintf(socket, "GET / HTTP/1.0\n");
fprintf(socket, "Host: %s\n\n", server_name);

/* standback and wiat for the nice page not p0rn */

Yours Tony.

/*
 * "The significant problems we face cannot be solved at the 
 * same level of thinking we were at when we created them."
 * --Albert Einstein
 */