How to limit the number of web pages downloaded from a site?

N

Nad

Roedy Green said:
What does session mean if they don't logon? Perhaps the last hour?

If they have a static IP.
Basically, the idea is to watch the number of pages accessed
during a period of time. This way, you can estimate if they
are doing the automated download, in which case you can do
certain things.

You can also look at it as a number of downloads per minute
or whatever you can come up with.

There are some limitations though.
It depends on how are you going to implement it.
Which language, tool, etc.
Some servers do not allow the cgi, php, ssi or even javascripts
to run. I'd like to see it running on ANY server.
That's the trick.
 
N

Nad

Roedy Green said:
That's right. The Internet was not designed to efficiently deliver
large files. They should be encrypted and stored all over the place.
When you ask for one, you get the nearest copy. The rights to open
and look inside is separate from the right to get or cache a copy.

It is not just one large file, but tens of thousands of web pages.
You find out what file you need, then get a copy, then open it.
Conceptually every change to a file distributed is a new file with a
new ID. The original author's job is only to tell people the id of
the file they want, not to serve it. The master distribution site
will also respond to queries about a given ID to know if it has been
replaced, and by what.

People are free to keep old copies around if they like.
So for example if you wanted to download the JDK from Sun, you would
go to the sun website. It would give your browser the ID of the JDK
1.6.0_7 bundle. Your browser would hand that number to your IAP which
would look for the closest copy, and arrange a download, possibly a
simultaneous download of parts of it from different sites for speed
and to share the load.

Instead of coming all the way from California, it would likely come
off one of the IAP's computers, or a server within 10 km. This cuts
down hugely on Internet bandwidth chewed up.

Multiply the effect when you consider all the videos people download.
If they came from nearby server, response could be much faster.
Automatic use of multiple servers could pretty well guarantee you
would not have to deal with dropouts.

Thanks for feedback.
 
D

Daniele Futtorovic

You're an idiot.
Everyone agrees.

I don't agree. He's not an idiot.

He's a fucking asshole.


Though I'll admit he's got quite some pluck to show up here "in person"
-- begging for advice in the very newsgroup he's disrupted all this
time. He even managed to hide the fact his only purpose was trolling...
two whole posts long!


@OP: Get lost, prick.
 
K

Knute Johnson

Nad said:
Knute Johnson said:
And how exactly do you do that?
With what tools, languages or scripts?

Write a program that sits in front of your web server and passes the
requests of IPs that have bytes left in their bucket. Java would work
fine for this but you could probably write it in a dozen different
languages. If you have a busy site this could consume a lot of memory
though. Another option might be to scan the logs and limit access of
sites that have downloaded a lot of files.
 
N

Nad

I don't agree. He's not an idiot.

He's a fucking asshole.


Though I'll admit he's got quite some pluck to show up here "in person"
-- begging for advice in the very newsgroup he's disrupted all this
time. He even managed to hide the fact his only purpose was trolling...
two whole posts long!


@OP: Get lost, prick.

:--}

What hole did you crawl from?
 
D

Daniele Futtorovic

:--}

What hole did you crawl from?

By the way: that common-word-replacement engine you used to make all
those scrambled posts, is it built into NewsMaestro directly or did you
use an external program?
 
N

Nad

Knute Johnson said:
Write a program that sits in front of your web server and passes the
requests of IPs that have bytes left in their bucket. Java would work
fine for this but you could probably write it in a dozen different
languages. If you have a busy site this could consume a lot of memory
though. Another option might be to scan the logs and limit access of
sites that have downloaded a lot of files.

Sure, I know that much. But the issue is what exactly you need
to do considering the fact that your provider does not allow
ssi executable statements, cgi scripts, php, could be even
javascript?

What are your options then?

To get a premier provider where you can have your own virtual
domain and shell out some serious bux on the top of spending
years building tools that automatically build sites?
And what if you have 10 sites of 150+ megs in size?

How do you like THAT fer breakfast?
 
J

Jeff Higgins

Nad said:
Sure it does.
Da Diamond Sword...

"The Diamond Sword is with you now.
But you have to be pure enough to use it.
Otherwise, the law of it is this:


If you use it inappropriately,
you are going to hurt yourself.


Nothing less.
Nothing more."
 
J

Jeff Higgins

Nad said:
Are you having fun yet?
Otherwise it is kinda boring with all these priests,
flying up there in the clouds, thinking they are here
to fix everyone and put them "right".
Sickos.

LOOK! --> PRIESTS! Hah ha, got ya.

<-- LOOK! FREEMASONS! Hah ha, got ya again.

LOOK! --> THOSE THAT WOULD STEAL YOUR VALUABLE INFORMATION! Hah ha!
http://tarkus01.by.ru/Convert/Chapters.html> ROTFLMAO!

Hope that pain in your neck goes away.
Maybe if you stop looking over your shoulder so much.

Hope to hear from you soon, pup.
 
J

Jeff Higgins

Jeff said:

Every year billions of rotting bits are maintained
in a state of high readiness on magnetic media.

The energy density of the static magnetic field of a
permanent magnet comprised of atoms with dipole moment
M_dipole and number density N_dipole producing a
flux density B at 100% saturation is given by:

E_storage ~ M_dipoleN_dipoleB

For iron atoms with bulk density 7860 kg/m3,
then N_dipole = 8.5 x 10^28 atoms/m3 and
M_dipole = 1.8 x 10^-23 ampere-m2,
giving E_storage = 2.1 x 10^6 joules/m3.
 
N

Nad

"Jeff Higgins" said:
"The Diamond Sword is with you now.
But you have to be pure enough to use it.
Otherwise, the law of it is this:


If you use it inappropriately,
you are going to hurt yourself.


Nothing less.
Nothing more."

:--}

I like like that.
I see you've been digging up all sorts of shit, weren't you?
Picking up some shit from other people's arses with a
toothpick and analyzing it with the microscope.
And what did you find?

You see, even if you look at the shit thru the microscope,
all of a sudden, you realize it is a complete Univese,
a living Universe, and what you think is simply a dead shit,
turns out to be something of the same grandior as YOUR lil
puppet world of zombies, digging up someone elses shit,
because they are too miserable and to mistrusting towards
their own life. That is why they spend all their miserable
lives, trying to find some shit in others, in order to justify
their own "superiority". You see, if you can see shit in others,
that, in perverted mind like yours, means that you are somehow
"superior"!

Superior?
What do you need THAT shit for?
You are still a miserable scum, totally uncreative entity.
That is why you are looking up the asses of others, trying
to see their shit. Otherwise, you would simply had no time
for that. Because you are busy with all the fun and
creativity in YOUR life.

How's that for an outline of your entire life?

Good enough fer breakfast for a royal entity of your kind
and grade?
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
473,744
Messages
2,569,482
Members
44,901
Latest member
Noble71S45

Latest Threads

Top