topic Re: ftp scripts in Operating System - Linux

ftp scripts

aakhan — Sat, 17 Apr 2010 22:34:33 GMT

I'm doing data extraction running ftp scripts. While extracting the data it extract couple of platters (slots) in a sequence and then skip some of platters and then start extracting the next platters. There is nothing wrong with my scripts
but it just skips some platters while im doing it. Does anyone know what could be the reason. Please let me know. Thanks in advance.

Re: ftp scripts

Steven Schweda — Sun, 18 Apr 2010 01:48:59 GMT

> [...] There is nothing wrong with my
> scripts but it just skips some platters
> while im doing it. Does anyone know what
> could be the reason. [...]

I don't understand what's happening on line
23 of your script.

Re: ftp scripts

aakhan — Sun, 18 Apr 2010 05:13:23 GMT

These are my ftp scripts...
ftp -s:gg01_11.txt 0.0.0.0
cd ..
cd gg0004_gg0014
ftp -s:gg04_14.txt 0.0.0.0
cd..
cd gg0005_gg0015
ftp -s:gg05_15.txt 0.0.0.0
Here I'm calling gg01_11.txt file. It does the extraction for the first file then skip the 2nd one and moved to the 3rd one. I looked at all my scripts but didnt found any errors because when i try to extract the images for the file which was skipped for the 2nd time it does extract the data for that file. I'm wondering is it because of the buffer overflow? if yes then how could i fix this issue?

Re: ftp scripts

Dennis Handly — Sun, 18 Apr 2010 06:34:14 GMT

>couple of platters (slots)

You appear to be using domain terminology, unrelated to computer science. It appears you want to skip files somehow?

>Here I'm calling gg01_11.txt file.

What's in that file?

>Steven: I don't understand what's happening ...

Steven is asking to see your whole script and a better idea what you are trying to do and what doesn't work.

Re: ftp scripts

aakhan — Sun, 18 Apr 2010 16:19:31 GMT

Thanks Dennis and Steven for your replies.
gg01_11.txt file is a text file which has directories and subdirectories of the specific platter in it. Here is the example of the text file.
xyz
xyz
bin
prompt
cd f:\
cd f:\OAB019\OABA0021\SUBDIREC.002
mget *
cd f:\OAB019\OABA0021\SUBDIREC.003
mget *
cd f:\OAB019\OABA0021\SUBDIREC.004
mget *
cd f:\OAB019\OABA0021\SUBDIREC.005
mget *
cd f:\OAB019\OABA0021\SUBDIREC.006
mget *
cd f:\OAB019\OABA0021\SUBDIREC.007
mget *
quit

When i came to the office today it repeated the same thing. i.e. extracted images from 2 platters and then skip couple of them and then started extracting the next platters. I dont know how to resolve this issue.
I've searched so many sites but couldn't found anything.

Re: ftp scripts

Steven Schweda — Sun, 18 Apr 2010 21:20:00 GMT

Your confidence in the psychic powers of your
readers is flattering, but probably
unjustified. I'd guess that no one here
knows:

What the client or server systems are
(although the "f:\" suggests that the server
is some (unspecified) kind of Windows system,
running some (unspecified) kind of FTP
server).

What, exactly, fails, how, exactly.

What "platters (slots)" might be.

> I dont know how to resolve this issue.

So far, you haven't even _described_ it well.

I can't see any error messages from anything.

I can't see which files or directories might
exist on the FTP server system.

If the FTP server program maintains a log
file of some kind, then it might be (or be
able to be) recording some useful information
there.

Re: ftp scripts

Dennis Handly — Sun, 18 Apr 2010 22:56:44 GMT

>extracted images from 2 platters and then skip couple of them and then started extracting the next platters.

Are you talking about files here? By images, do you again mean files?
Are you getting any files with mget? You appear to be using mget from several Windows folders and putting them into the same Linux directory. Any overlap in filenames?

Re: ftp scripts

aakhan — Mon, 19 Apr 2010 00:19:06 GMT

Hi Steven, Let me explain it again.
I'm extracting files using ftp scripts. F:\ is OS 2 windows system which im using it here. The files on the ftp server are in the dir/sub dir structure. I have the same structure on my local machine where im saving these files. Lets call the platters some sort of disk here. When i run ftp scripts it extract the files from 2 or 3 platters(disks) and then skip the next platters and then start extracting files from the last platters which I have in my batch file. The name of the dir/directories on the ftp server and the scripts that im using is similar. So, Dennis there is no overlap and by images i mean files sorry for any confusion. I would like to say thank you to both of you guys for your time and help. I really need to resolve this issue. Please let me know if i need to explain it again.

Re: ftp scripts

Steven Schweda — Mon, 19 Apr 2010 03:44:39 GMT

> [...] F:\ is OS 2 windows system [...]

What, exactly, does that mean? OS/2?
Windows? Something else? Some version of
something?

I still don't know which FTP server is used
there. I still don't know if it's logging
any errors.

> [...] Lets call the platters some sort of
> disk here. [...]

I have a better idea. Let's call them what
they actually are.

> [...] and then skip the next platters [...]

How are these "platters", whatever they are,
related to the directories in your FTP client
input files? What, exactly, gets skipped?

> [...] Please let me know if i need to
> explain it again.

If you do it better, then doing it again
might help. If you keep doing it the same,
then repeating it may not help. Answering
some questions might help.

Re: ftp scripts

aakhan — Mon, 19 Apr 2010 04:46:29 GMT

We operate jukeboxes by using pc's with OS 2 windows.The data resides in IBM jukeboxes and in each jukebox there are more then 200 platters. Now each platter contains thousands of images (files) and I'm running the above ftp scripts to extract the images (files) from the jukeboxes and then saving it to the local machine but when i run the ftp scripts to extract the data from the platters in the sequence based on my scripts it extract data from first few platters and then keeps skipping the next few after and goes to the last few platters or some times it crashes the whole system.

Re: ftp scripts

aakhan — Mon, 19 Apr 2010 04:51:26 GMT

Steven, it is not logging any error. It just display the end of scripts message.
In each platters there is a directory structure.
I hope this might clear your confusion about my question. Thanks for your help.

Re: ftp scripts

Dennis Handly — Mon, 19 Apr 2010 10:19:47 GMT

>We operate jukeboxes by using PCs with OS/2 windows. The data resides in IBM jukeboxes and in each jukebox there are more then 200 platters. Now each platter contains thousands of files

So a platter is just a directory?

>but when I run the ftp scripts to extract the data from the platters in the sequence based on my scripts ... or some times it crashes the whole system.

Perhaps you should be asking IBM if they support ftp access to their device. Especially the crash.

>In each platter there is a directory structure.

Which of the above f: paths is it?

Re: ftp scripts

aakhan — Mon, 19 Apr 2010 16:25:20 GMT

Hi Dennis,Platter is like a volume which as two sides i.e. side A and side B. Each side has contain files in the directory structure.
This is my ftp script which i have created:
ftp -s:gg01_11.txt 0.0.0.0

This is the directory and sub dirtory structure in the jukeboxes:
cd f:\GG0001\OFDG0001\SUBDIREC.001
mget *

If i ask IBM they might tell me that there should be someone baby sitting the PC's incase it crashes so we can reboot the Jukebox and start extracted again.

Re: ftp scripts

Dennis Handly — Fri, 23 Apr 2010 22:35:09 GMT

>cd f:\GG0001\OFDG0001\SUBDIREC.001
>mget *

In your script you may want to replace your "mget*" by ls to see if you can access all the files you want without that "skipping".

Re: ftp scripts

PatrickMc — Wed, 05 May 2010 15:01:25 GMT

You may want to consider an automated way of generating an FTP batch script based on platters/tracks (directories/files). This script that I use does that.

http://www.biterscripting.com/helppages/SS_FTPUpload.html

I did not write this script, but take a look at its code, and try to implement it in pure batch.

Re: ftp scripts

PatrickMc — Wed, 05 May 2010 15:03:02 GMT