topic Re: Script challenged: print lines with \ and spaces in Operating System - HP-UX

Script challenged: print lines with \ and spaces

John J Read — Tue, 25 Jan 2005 20:19:08 GMT

I'm just not getting it. I'd appreciate any help. I'm attempting to write a posix script that will convert a file with a few lines into one, comma delimited line so I can load it to a database. The issue is the tricky \ and space characters ending in unwanted escaping, etc.

example:
includes file contains:

D:\AUL Scripts
D:\OVOW_patches
D:\HP OpenView\Data\Databases\backup

I'd like write something in posix that will
cat these and convert to:

D:\AUL Scripts,D:\OVOW_patches,D:\HP OpenView\Data\Databases\backup

thanks! points to everyone!

Re: Script challenged: print lines with \ and spaces

Biswajit Tripathy — Tue, 25 Jan 2005 21:03:57 GMT

I'm sure some one else would give you a
better one, but how about this:

-----------
while read -r line
do
newline="'$line'"
echo $newline,
done < EXAMPLE_FILE | xargs echo | sed 's/, /,/g' | sed 's/,$//g'
--------------

Replace EXAMPLE_FILE by your input file name.

- Biswajit

Re: Script challenged: print lines with \ and spaces

A. Clay Stephenson — Tue, 25 Jan 2005 21:10:55 GMT

Well, if you insist upon an all shell solution (awk or Perl would be easier):

#!/usr/bin/sh

PREV=""
typeset -i KNT=0
while read X
do
if [[ ${KNT} -ne 0 ]]
then
echo "${PREV},\c"
fi
((KNT += 1))
PREV="${X}"
done
echo "${PREV}"

Invoke it like this:

myscript.sh < infile > outfile

Re: Script challenged: print lines with \ and spaces

John J Read — Tue, 25 Jan 2005 22:47:15 GMT

I greatly appreciate your responses but both solutions above miss by a little bit. Also, I'd be happy to try Perl or Awk.

In the first solution, note the /b in the last line ...\backup is being interpreted by the shell as "backup one space". If the file were to begin with \n " interpreted as new-line" then the whole thing fails.

while read -r line
do
newline="'$line'"
echo $newline,
done < ./includes | xargs echo | sed 's/, /,/g' | sed 's/,$//g'

D:\AUL Scripts,D:\OVOW_patches,D:\HP OpenView\Data\Databaseackup <- note the missing "b".

In the second solution the backslashes are lost.

./jj < ./includes
D:AUL Scripts,D:OVOW_patches,D:HP OpenViewDataDatabasesbackup

Feel free to write in alternate languages. It's time I buckle down and get better at Perl. Shell has usually gotten the job done but I always know it would have been easier if I was better at Perl.

Re: Script challenged: print lines with \ and spaces

Peter Godron — Wed, 26 Jan 2005 04:50:45 GMT

John,
a oneliner which should work:

paste -s $filename | sed "1,$ s/ D:/,D:/g" > $newfilename

Please make sure the command is on one line!

The paste -s merges the lines, seperated I believe by tabs, and the sed replaces the tabs with commas.

Please let us know how you get on.
Regards

Re: Script challenged: print lines with \ and spaces

Peter Godron — Wed, 26 Jan 2005 04:55:20 GMT

John,
sorry, but perhaps even better ;-)

paste -s -d"," $filename

Regards

Re: Script challenged: print lines with \ and spaces

John J Read — Wed, 26 Jan 2005 09:23:31 GMT

Very cool! Both of the "paste" commands above do the trick! Thanks! This gets me what I need. Shell comes through again!Still going to dedicate some time to Perl.

thanks everyone..

Re: Script challenged: print lines with \ and spaces

Hein van den Heuvel — Wed, 26 Jan 2005 09:51:30 GMT

Here are (two of many) perl solution:

perl -e 'while (<>){ chop; $line.=$_."," } chop $line; print "$line\n"' x

D:\AUL Scripts,D:\OVOW_patches,D:\HP OpenView\Data\Databases\backup

- Simple loop over input into default $_
- append each $_ to lien being build, adding a comma.
- chop of final comma and print.

perl -e 'local $/; $_=<>; s/\n/,/g;print' x

This clears a special variable to make perl go into 'slurp' mode reading the whoel file into a string. Now replace every newline with a comma and print.

fwiw,
Hein.