J
justme
hi
I have a remote machine running some application that generates very
large
log files in terms of Mb...say average 60Mb.
Normally, we need to connect to this remote machine by keying in a URL
in a browser such as http://remote:123/logs. Then the browser will
display tab delimited columns of data.
What i wanted to do use the perl LWP module to get this log as i do
not want to go to the physical machine to use the browser to get the
logs. Then according to some filtering parameters, display the logs
according to the filters. For example, if filter by a certain date,
then it will display the contents based on that date.
Questions:
1) this log file is very big ,60Mb at least. So , is LWP the one to
use..or is there a better module to deal with large files..
2) While getting the log file, is it better in terms of memory usage
to parse the data "on the fly" or get the whole file and do the
parsing afterwards..
3) becos i am not at the physical machine, i can't really do something
lika a "tail" feature which displays the data "realtime"... any ways
to do a "tail" on the log file remotely?
thanks..
I have a remote machine running some application that generates very
large
log files in terms of Mb...say average 60Mb.
Normally, we need to connect to this remote machine by keying in a URL
in a browser such as http://remote:123/logs. Then the browser will
display tab delimited columns of data.
What i wanted to do use the perl LWP module to get this log as i do
not want to go to the physical machine to use the browser to get the
logs. Then according to some filtering parameters, display the logs
according to the filters. For example, if filter by a certain date,
then it will display the contents based on that date.
Questions:
1) this log file is very big ,60Mb at least. So , is LWP the one to
use..or is there a better module to deal with large files..
2) While getting the log file, is it better in terms of memory usage
to parse the data "on the fly" or get the whole file and do the
parsing afterwards..
3) becos i am not at the physical machine, i can't really do something
lika a "tail" feature which displays the data "realtime"... any ways
to do a "tail" on the log file remotely?
thanks..