topic Re: file manipulation scripting in Operating System - HP-UX

file manipulation scripting

Gregory F. Wright — Thu, 24 Apr 2003 11:08:27 GMT

Hi,
I am new to unix so be kind. I have a text file that I need to modify. Each line in the file consists of groups of data to be read by another program. What I need to do is to add a new group at the beginning of each line in the form:
IIP## , where ## is a sequence number that is incremented for each line. I also need to append an "=" character to the last group of each line. The number of lines in each file is variable.
Can this be easily done with scripting or do I need to write a program to do this?

Greg Wright

Re: file manipulation scripting

Christopher Caldwell — Thu, 24 Apr 2003 11:12:57 GMT

Let me count the ways ...

This can be shell scripted, perl'd, C'd, etc'd.

Use what you're comfortable with; use what you know. If you don't know any of the aforementioned, use shell or perl.

Re: file manipulation scripting

Robin Wakefield — Thu, 24 Apr 2003 11:15:44 GMT

Hi Greg,

As mentioned, loads of ways, but here's an awk method:

awk '{printf("IIP%02d %s=\n",NR,$0)}' filename

rgds, Robin

Re: file manipulation scripting

Paddy_1 — Thu, 24 Apr 2003 11:40:56 GMT

in perl you can do something like

while (<>) {
chomp; # strip record separator
printf "IIP%02d %s=\n", $., $_;
print $_ if $filename;
}

Re: file manipulation scripting

john korterman — Thu, 24 Apr 2003 11:43:07 GMT

Hi Greg,
a simple standard script can probably also do it, e.g.:

#!/usr/bin/sh
typeset -i NUMBER=0
while read line
do
let NUMBER="$NUMBER + 1"
echo "IIP${NUMBER} ${line}="
done <$1

Run it like this:
# simple_script.sh inputfile >new_out

to redirect the result to new_out

regards,
John K.

Re: file manipulation scripting

David_246 — Thu, 24 Apr 2003 12:05:01 GMT

He guys,

He asked us to be nice !

Looking at just one file you want to look at :

#!/opt/perl/bin/perl

$file="/etc/hosts";
$file2="/tmp/file2";

# Open source file for read only mode
open(FH, "< $file");

# Open destination file in write mode
open(FD, "> $file2");

$num = 0;
while() {

# Set $num to value + 1
$num++;

# Add the number to the beginning of the line
$_ = "IIP $num" . $_ ;
# Add a = to the end of the line
s/\n//;
$_ = $_ . "\= \n";

# Now store the current line into file2
print FH "$_" ;
# An print it on screen
print $_;

} # end of the while loop (so end of file)

# Dont forget to close both Files
close(FH);
close(FD);

print "Alright, done checking $file. \n";
print "File had $num lines \n"

----------------------

If you need any more info, please let us know.

Best Regs David

Re: file manipulation scripting

Gregory F. Wright — Thu, 24 Apr 2003 12:28:15 GMT

I want to thank everyone who replied. All of your suggestions were helpful. I see that I need to get some good learning sources on PERL and shell scripting if I am going to be working in UNIX.

Greg

Re: file manipulation scripting

Gregory F. Wright — Thu, 24 Apr 2003 13:37:40 GMT

Hi again,

Since I do not have PERL on my system I tried the AWK and shell script methods. Both worked, or would have if I had included the following information. Each line ends with an CR character. This causes the AWK method to place the '=' character at the beginning of each line (overwriting the first I in IIP) and the shell scripting method to place the '=' after the CR character.

In the AWK method I tried \b between the %s and = characters but it didn't work.

Any further solutions? I need method of stripping out the CR at the end of each line.

Greg

Re: file manipulation scripting

H.Merijn Brand (procura — Thu, 24 Apr 2003 13:46:32 GMT

You don't have perl? Uhh, look again, you *do* have perl (/usr/contrib/bin/perl), but that is an old version (version 4).

Perl is free, and IMHO indispensable for an SA.

Get it (perl 5.8.0) from your latest Application CD's, from http://hpux.connect.org.uk/hppd/hpux/Languages/perl-5.8.0/ or from https://www.beepz.com/personal/merijn/ or http://www.cmve.net/~merijn/
and enjoy it's rich set of features.

Enjoy, have FUN! H.Merijn

Re: file manipulation scripting

James R. Ferguson — Thu, 24 Apr 2003 13:48:31 GMT

Hi Greg:

If you have carriage return characters in your file then you undoubtedly transferred it from Windows using FTP but in binary mode. Text file transfers from Unix to/from Windows should be done in ASCII mode. This converts the Windows linefeed/carriage-return to a Unix newline character and vice versa.

You can also correct your file on the Unix server with:

# dos2ux < filename > filename.new

Regards!

...JRF...

Re: file manipulation scripting

Steve Steel — Thu, 24 Apr 2003 13:50:36 GMT

Hi

A stupid one

mv file /tmp/file
nl -ba -nln /tmp/file|while read line
do
echo "IIP"$line"="
done > file
/bin/rm /tmp/file

Steve Steel

Do not make our input pointless. Give points to the ones you like.

Re: file manipulation scripting

Robin Wakefield — Thu, 24 Apr 2003 14:29:48 GMT

Hi Greg,

You could also remove the CRs within awk:

awk '{sub("\r","");printf("IIP%02d %s=\n",NR,$0)}' filename

rgds, Robin