M
martijn
H!
I'm busy with testing python and now i'm trying to check if a url makes
a forward to a other location with the same content.
So it will be possible to scan unique website's.
I already made these checks:
the html forward:
<meta http-equiv="refresh" content="0;URL=othersite.com">
the header:
Content-Location: othersite.com
the url - check:
if '-':
check if 'sitename.com' has not the same content as site-name.com
the problem:
There are still website's forwarding to a other location with the same
content but they overrule the 3 checks above.
Thanks very Much,
GC-Martijn
I'm busy with testing python and now i'm trying to check if a url makes
a forward to a other location with the same content.
So it will be possible to scan unique website's.
I already made these checks:
the html forward:
<meta http-equiv="refresh" content="0;URL=othersite.com">
the header:
Content-Location: othersite.com
the url - check:
if '-':
check if 'sitename.com' has not the same content as site-name.com
the problem:
There are still website's forwarding to a other location with the same
content but they overrule the 3 checks above.
Thanks very Much,
GC-Martijn