Best unofficial Apache Server developers community

Answers

Grepping through .gz log files

⇧

⇩

29 views

Does there exist a magical shell piping which would allow easily to grep through bunch of .gz log files without needing to extract them somewhere?

.gz files are Apache logs, result of log rotation. I'd like to quickly check how often certain URIs are accessed in the past.

apache gzip grep logrotate

asked May 11, 2011 7:10 am CDT

Mikko Ohtamaa

posted via ServerFault

3 Answers

Newest Most Voted

⇧

⇩

The zgrep program is available for Linux (and perhaps some Unix too). This will decompress the files and then grep through them.

answered May 11, 2011 7:24 am CDT

Iain

⇧

⇩

How about zgrep? Seems to be installed on Mac OS and Ubuntu 11.04.

answered May 11, 2011 7:24 am CDT

dkam

⇧

⇩

You can just use zgrep to grep through compressed files.

If you need to use a specific grep, you can set the GREP environment variable:

export GREP=/bin/egrep

answered May 11, 2011 7:24 am CDT

Cakemox

Your answer

Similar discussion threads

Loading CSV Files & LOAD large files behavior in local mode
August 19, 2010 02:49:46 AM
What loader should I use on csv files with quoted strings that contain embedded commas? (i.e. Embedded commas should not be a separator.) And when LOADing large files in local mode, does Pig just store it all in memory? Or does it have memory…

Reaching ulimit values for open files can generate huge log files
February 21, 2011 09:22:29 AM
The ASF Sonar installation managed to generate 46GB of identical log messages [1] today in the 8 hours it took to notice it was down. While better monitoring would/should have identified the problem sooner, it does demonstrate a problem with the…

Created: (MRM-1429) Proxying of xml files from one archiva server to another fails, when jar files s
November 18, 2010 07:05:36 PM
Proxying of xml files from one archiva server to another fails, when jar files succeed

Commented: (CAMEL-2583) index.html files in download directories are hiding files
September 26, 2010 11:38:27 AM
[ https://issues.apache.org/activemq/browse/CAMEL-2583?page=com.atlassia n.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommen tId=62133#action_62133 ] Claus Ibsen commented on CAMEL-2583:

Loading resource or property files embedded in jar file that distributes shared build files?
April 8, 2011 09:10:32 AM
I've created a reusable set of build files using the technique I outlined at http://stackoverflow.com/questions/5124726/what-are-some-good-ways-to- distribute-a-common-ant-file-to-be-included-in-builds/5168745#5168745. This technique relies heavily…

Commented: (CAMEL-2583) index.html files in download directories are hiding files
January 11, 2011 01:28:10 AM
[ https://issues.apache.org/jira/browse/CAMEL-2583?page=com.atlassian.ji ra.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId= 12979973#action_12979973 ] Claus Ibsen commented on CAMEL-2583:

Commented: (CAMEL-2583) index.html files in download directories are hiding files
January 17, 2011 08:54:12 AM
[ https://issues.apache.org/jira/browse/CAMEL-2583?page=com.atlassian.ji ra.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId= 12982660#action_12982660 ] Hadrian Zbarcea commented on CAMEL-2583:

Updated: (CAMEL-2583) index.html files in download directories are hiding files
January 11, 2011 01:28:35 AM
[ https://issues.apache.org/jira/browse/CAMEL-2583?page=com.atlassian.ji ra.plugin.system.issuetabpanels:all-tabpanel ] Claus Ibsen updated CAMEL-2583:

Commented: (CAMEL-2583) index.html files in download directories are hiding files
January 17, 2011 08:40:29 AM
[ https://issues.apache.org/jira/browse/CAMEL-2583?page=com.atlassian.ji ra.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId= 12982656#action_12982656 ] Sebb commented on CAMEL-2583:

Resolved: (CAMEL-2583) index.html files in download directories are hiding files
January 16, 2011 09:39:08 AM
[ https://issues.apache.org/jira/browse/CAMEL-2583?page=com.atlassian.ji ra.plugin.system.issuetabpanels:all-tabpanel ] Claus Ibsen resolved CAMEL-2583.

Devcount = 1 when files don't exist even after fsck && rebalance has replicated files too mu
April 27, 2011 04:53:23 AM
Hi all, I have zoning setup between 2 datacentre locations and mindevcount of 1 (to get 1 file in each location). Here are my settings: ~# mogadm settings list network_zones = zone1,zone2 schema_version = 13 …

On compressed storage : why are sequence files bigger than text files?
January 18, 2011 08:13:55 AM
Hello, My questions in short are: - why are sequencefiles bigger than textfiles (considering that they are binary)? - It looks like compression does not make for a smaller sequence file than the original text file. -- here is a sample data that…

deleting files via gridfs php driver doesn't actually remove the files?
January 20, 2011 02:26:30 PM
I just removed 110G of files from fs.files/fs.chunks using the php driver... $grid = new MongoGridFS($db); $grid->remove(array('length' => array('$gt' => 10000000))); db.fs.chunks.stats() size value shows that it's now 110G less... but…

Created: (VFS-322) Tar files to contain files over 2GB in size
September 24, 2010 10:31:58 AM
Tar files to contain files over 2GB in size

Multiple input files, no reducer, output is "stomped" by the just one of the files
January 6, 2011 02:52:22 PM
Hello, I'm running a very simple job that returns the input with a null key and uses no reducer (see below). I'm using MultipleSequenceFileOutputFormat to "split" the input into different files, but for simplicity's sake right now I'm just…

hadoop fs -put vs writing text files to hadoop as sequence files
February 16, 2011 06:37:06 PM
Hi, I have to upload some terabytes of data that is text files. What would be good option to do so: i) using hadoop fs -put to copy text files directly on hdfs. ii) copying text files as sequence files on hdfs ? What would be extra time in this…

hadoop fs -put vs writing text files to hadoop as sequence files
February 16, 2011 06:24:58 PM
Hi, I have to upload some terabytes of data that is text files. What would be good option to do so: i) using hadoop fs -put to copy text files directly on hdfs. ii) copying text files as sequence files on hdfs ? What would be extra time in this…

ESP files
August 4, 2010 02:25:02 PM
I see that I can put a reference to an object, inside the <%= %> tag. I can do something like: <%= currentNode.orderNumber %> But I want to be able to print a field only if it's defined. For example, Address, an address…

jni files
July 8, 2010 03:08:26 AM
Hi, I developed a project which is using some native jni files (liblemur_jni.so), earlier i use to run application jar by using -Djava.library.path=/PATH_TO_JNI_FILES, but am not able to the same with ./hadoop jar command. I followed …

wal and shm files
February 11, 2011 10:47:10 PM
Just wondering, are the wal and shm files suppose to stick around after the process exits? Sam

Questions and Answers are licensed under cc-wiki license.

Grepping through .gz log files

3 Answers

Your answer

Join with account you already have