topic Re: delete duplicates .. in Operating System - HP-UX

delete duplicates ..

someone_4 — Tue, 26 Feb 2002 15:43:07 GMT

Hey everyone ..
quick on here ..
I have a list of numbers like

1
1
1
2
2
3
3
3
4
4
4
4

I need to delete the duplicates and just endup with one of each

1
2
3
4

Thanks
Richard

Re: delete duplicates ..

Eric Ladner — Tue, 26 Feb 2002 15:44:13 GMT

If it's in a file, say unsorted_file:

sort -u unsorted_file > sorted_file

Or, in a vi session, you can do this:

:1,$!sort -u

Re: delete duplicates ..

Joseph C. Denman — Tue, 26 Feb 2002 15:51:39 GMT

Hi Richard.

man uniq

Hope this helps.

...jcd...

Re: delete duplicates ..

harry d brown jr — Tue, 26 Feb 2002 15:52:03 GMT

Eric,

that vi sort is great! I learned something new, thing my boss will let me go home for the day?

live free or die
harry

Re: delete duplicates ..

someone_4 — Tue, 26 Feb 2002 15:53:14 GMT

I agree that was good.

Richard

Re: delete duplicates ..

Eric Ladner — Tue, 26 Feb 2002 15:58:17 GMT

Heh..

You can run ANY command like that, too..

Want to put a directory listing in the file you are editing? Here's how:

:.!ls -l

(make sure you are on a clean line, or it get's whacked).

In general, you send a range to the command after the bang, then any ouput get's inserted back into your current buffer.

Re: delete duplicates ..

someone_4 — Tue, 26 Feb 2002 16:03:49 GMT

I like that ! Good Stuff !!

Richard

Re: delete duplicates ..

Anthony khan — Tue, 26 Feb 2002 17:11:35 GMT

Eric,

that's sweet

Re: delete duplicates ..

H.Merijn Brand (procura — Tue, 26 Feb 2002 18:56:20 GMT

Are you addicted to the command mode of vi?

in window mode (editing, not input)

replace the current line with the uname output

!!uname -a

Sort the contents of a file immediately after opening

!Gsort -u

No problem to put pipes in there too.
Take out the dups (including symlinks) and nonexisting directories in a directory listing:

!Gperl -ne '-d&&$P{$_}++==0&&push@P,$_;}END{print join":",@P;'

If the command is to be pasted from a nice mail someone sent you, open a new line and paste that text into that line, then delete the complete line into a named buffer (say m) and execute the command using "@m"

So if the current display has a line containing

:r /tmp/swagent.log

and you delete the line using

"mdd

you can now go to the line after wich you want the contents of /tmp/swagent.log inserted and type

@m

More tips like these can be found on a well written place like http://www.networkcomputing.com/unixworld/tutorial/009/009.html

Re: delete duplicates ..

Bill Hassell — Wed, 27 Feb 2002 03:03:32 GMT

While we're at it, one of the best places to find vi (actually, ed command lines) is the "Ultimate Guide to vi", a virtual requirement for any Unix sysadmin. One of the examples is a spell-checker for vi:

G
:r! spell

In fact, you can assing this to an unused vi command in your .exrc file. The example uses S since this isn't defined in vi:

map S G:w!^M:r!spell %^M

The ^M are literal carriage returns and must be added using the CTRL-V option flag in vi.

For word processing, you can use the adjust command to format paragraphs using word wrap:

!)exec adjust -m60

This command starts on the current line and works to the end of the paragraph (next blank line), adjusting the righthand margin to no more than 60 characters but breaking the lines on a word boundary. adjust is fairly coll in that it pays attention to indents.

Re: delete duplicates ..

steven Burgess_2 — Wed, 27 Feb 2002 03:33:00 GMT

To spell-check without leaving a vi session:

:w !spell -b

Re: delete duplicates ..

someone_4 — Wed, 27 Feb 2002 04:04:16 GMT

Thanks Mr. Bill for the extra info .. you always come up with some great additional stuff. Ohhh and I do have the vi book !!

Richard