topic Re: Search all text files for a string in Operating System - HP-UX

Search all text files for a string

Darrell Allen — Mon, 17 Dec 2001 20:17:50 GMT

Hi all,

I'm trying to search all text files on the system for a specific string. My results haven't been very good so far. I'm having a problem selecting only text files, I'm missing some files I shouldn't, and some lines are too long for vi (when I try to edit the results file).

Anyone got something to help?

Thanks,
Darrell

Re: Search all text files for a string

Jeff Machols — Mon, 17 Dec 2001 20:21:17 GMT

try this

find / -type f | xargs grep string

Re: Search all text files for a string

A. Clay Stephenson — Mon, 17 Dec 2001 20:41:52 GMT

Hi Darrell:

You might try something close to this:

find . -type f | while read X
do
file ${X} | grep -q -i "ascii text"
STAT=$?
if [ ${STAT} -eq 0 ]
then
grep -q -i "Your target string" ${X}
STAT=$?
if [ ${STAT} -eq 0 ]
then
echo "File: ${X}"
grep -i "Your target string" ${X}
fi
fi
done

You could, of course also pass in "Your target string" as $1

Re: Search all text files for a string

Wodisch — Mon, 17 Dec 2001 20:43:44 GMT

Hello Darrell,

this is not so simple, really!
Usually something like this is working, but "file" tests only for the first 128 bytes of a file...

find / -type f -print |
while read name; do case $(file $name) in
*text*) grep -i "PATTERN" $name /dev/null ;;
esac;done

First, you get only the files (no devices, pipes, directories, links), then you select the *text files* (ascii, C, awk, english...), and then you use "grep" on those. The additional parameter "/dev/null" forces "grep" to show the name of file and the line containing the match...

HTH,
Wodisc

Re: Search all text files for a string

Roger Baptiste — Mon, 17 Dec 2001 22:27:45 GMT

Hi Darell,

find $DIR | xargs file |grep "ascii text" | awk '{ print $1}' | sed 's/://g' >file_list

for i in `cat file_list``
do
grep ""yourstuff"" $i
if [ $? -eq 0 ]
then
echo "$i" >>Caught
done

HTH
raj

Re: Search all text files for a string

Thom Cornwell — Tue, 18 Dec 2001 16:13:02 GMT

find ./ -name "*" -exec grep -il 'Pattern_to_match' {} \;|xargs file|grep asci>log might work

Re: Search all text files for a string

Paula J Frazer-Campbell — Tue, 18 Dec 2001 16:16:17 GMT

Hi

find . -type f -print -exec grep {} \;

search for a string inside files.

HTH

Paula

Re: Search all text files for a string

Steven Gillard_2 — Tue, 18 Dec 2001 16:50:06 GMT

I recently had to do this for an Oracle upgrade - searching for all scripts etc that referred to the old ORACLE_HOME.

In the end I simply resorted to using "grep -l" to print the file name rather than the matching lines. ie:

# find / -type f | xargs grep -l "string" > /tmp/log 2>&1

That way you just get a list of files that contain the match and you can decide which ones are binary and which ones arent.

Regards,
Steve

Re: Search all text files for a string

Darrell Allen — Tue, 18 Dec 2001 21:59:31 GMT

Hi all,

Thanks for the replies. They are appreciated! Just wanted you to know I'm still testing these suggestions and haven't forgotten to assign points.

Darrell

Re: Search all text files for a string

Magdi KAMAL — Wed, 19 Dec 2001 09:06:15 GMT

Hi Darrell,

Consider the script lookForString.sh with two arguments : arg1 is the directory under which you are looking for string and arg2 is the string you are looking for.

find $1 -type f | while read File
do
file ${File} | grep -q -i "ascii text"
rFile=$?
if [ ${rFile} -eq 0 ]
then
grep -q -i "Your target string" ${File}
rString=$?
if [ ${rString} -eq 0 ]
then
echo "### File '${File}' contains string '$2'"
fi
fi
done

Magdi

Re: Search all text files for a string

Darrell Allen — Wed, 19 Dec 2001 18:33:27 GMT

Hi again,

Thanks for everyone's help. Wodisch sums up my testing rather well: "this is not so simple, really!"

My problem was also due to a database upgrade (Progress 83b to 83d). Why do people hard-code something like a version number in scripts? Haven't they ever heard of symlinks? I just finished going thru the resulting list of 415 files that contained 83b and changing them so that they don't reference a version number any more! Thankfully I won't have this problem again!

I tried each of the suggestions above (with some minor, I think, changes). See the attachment for what I ran, timex output, and problems noted with each. Note that each of the 4 scripts in the attachment found the same number of files if I limited my find to /etc. When finding from "/" is where the miscellaneous problems arose.

Steven's suggestion to use "grep -l" to list the filenames without the line that matched was a big help. Filenames were what I really wanted anyway and solves the problem with some lines of my output being too long for vi, awk, etc.

I think another problem is using xargs with the large number of files returned by find. Perhaps this can be avoided by coding a loop on all mounted filesystems and using the -xdev arg of find. I didn't try that. In any event, that problem didn't seem to happen in the following (which is what worked best for me):

find / -type f -exec grep -l 83b {} \; | xargs file | grep text | awk -F: '{print $1}'

Thanks again,
Darrell