- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - HP-UX
- >
- Re: Poor performance
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Forums
Discussions
Discussions
Discussions
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2004 07:55 AM
08-05-2004 07:55 AM
I know that there has been a lot of discussion on this. But I was unable to find the perfect solution to my problem.
I've looked and tried a lot of solution that i've found. Maybe I've found the wrong posts or... i don't know... But anyway! Here's my info :
Filesystem Statistics:
Directories ........ 21791
Regular files ...... 571147
Symbolic links ..... 425
SYSV FIFOs ......... 0
BSD sockets ........ 0
Block Devices ...... 0
Character Devices .. 0
Unknown Objects .... 0
----------------------------
Objects Total ...... 593363
Kbytes Total ...... 71519261
Run Time ........... 4:41:15
Backup Speed ....... 4238,18 (KB/s)
4 hours for 70 gigs ? Normally its suppose to be like 60/70 gigs for 1 hour using a single drive ?
We have a HP LTO-2 using SCSI-2
I've seen post about Disk agents, buffers and stuff like that... nothing worked.
I know that the more files that we have that might impact on the backup performance.
But anyway, if anyone might have a little advice that would be great!
Thanks!
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2004 08:02 AM
08-05-2004 08:02 AM
Re: Poor performance
http://www6.itrc.hp.com/service/cki/search.do?category=c0&docType=Security&docType=Patch&docType=EngineerNotes&docType=BugReports&docType=Hardware&docType=ReferenceMaterials&docType=ThirdParty&searchString=UPERFKBAN00000726&search.y=8&search.x=28&mode=id&admit=1552802428+1091736050969+28353475&searchCrit=allwords
Attaching a script to help gather data for the doc.
SEP
Owner of ISN Corporation
http://isnamerica.com
http://hpuxconsulting.com
Sponsor: http://hpux.ws
Twitter: http://twitter.com/hpuxlinux
Founder http://newdatacloud.com
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2004 08:05 AM
08-05-2004 08:05 AM
Re: Poor performance
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2004 08:30 AM
08-05-2004 08:30 AM
Re: Poor performance
I'm going to read that right now!
To do the backups, i'm using Data Protector 5.1
on Windows.
The example of filesystem was from a drive for a Oracle instance.
But I get the same performance with other machines running on Unix or Windows.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2004 08:34 AM
08-05-2004 08:34 AM
Re: Poor performance
I suspect that the fundamental bottleneck is that there not enough disk agents to keep the drive busy. Observe the tape drive while the backup is running. If the drive does not stream almost continuously then you are taking a huge (10-100X) performance hit compared with the throughput of a streaming device. OB2/DP really performs best with fast tape drives when multiple filesystems (in OB2 speak, objects) are feeding a common media agent. I suspect you could actually back 3 filesystems as fast as you back up the one. You might try the divide and conquer approach by using includes and excludes of different directories so that the same filesystem becomes different objects. You then make sure that the device concurrency is >= the number of objects.
The downside to the divide and conquer approach is that it is now rather eash to miss something when directories are added.
It also helps greatly if the disk agent and media agent are on the same host so that the network is not a bottleneck. Finally, you are backing up a fairly large number of files; each of these requires a database hit. A few large files will be much faster than many small files for the same total volume of data. The database under DP is improved considerably over that of OB2.
You might try reducing the logging level to "Log Directories" if you suspect that the database is a bottleneck.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2004 08:34 AM
08-05-2004 08:34 AM
Re: Poor performance
And the script seems to be for a Unix machine.
I'm installed on a Windows machine.
Don't know if that makes a good difference on speed.
I know that when I was running with my AIT device on Unix with Networker the performance was okay. When we switched the AIT device to Data Protector under windows, the performance was decreased.
Don't know if that's still the case now.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2004 08:42 AM
08-05-2004 08:42 AM
Re: Poor performance
Hardware compression
Concurrency 4
Block Size (Default)
Segment size 2000
Disk Agent 8
I have a MSL6030 with 2 LTO2 Drives.
The backup machine use the network at 100%.
The CPU Performance is okay, most of the time the machine is in idle at 90% (during backups).
How can I determine that the issue is with the database of DP ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 02:01 AM
08-06-2004 02:01 AM
Re: Poor performance
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 02:22 AM
08-06-2004 02:22 AM
Re: Poor performance
We are on 100Mbps.
When backing up 1 client, 1 big file, or even a disk i always get a network usage of about 30Mbps.
Since the drives are 30MBps, the network should be used at 100Mbps no ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 03:29 AM
08-06-2004 03:29 AM
Re: Poor performance
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 03:46 AM
08-06-2004 03:46 AM
Re: Poor performance
> Backup Speed ....... 4238,18 (KB/s)
is right on for a 100Mbit link. You could try changing all the NICs and switches to 1000BaseT but now CPU/driver time may limit the maximum speed so don't expect 50Mbytes/sec, more like 30 or so. With 10000BaseT you may want to use jumbo frames but this may be incompatible with Windows.
Bill Hassell, sysadmin
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 04:17 AM
08-06-2004 04:17 AM
Re: Poor performance
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 05:14 AM
08-06-2004 05:14 AM
Re: Poor performance
Damn it! I hate that speaking about Mbps and MBps there's always a mix up somewhere...
anyway, I know the implications of file access, open/close, TCP overhead etc...
But still its normal to get 4MB/s on a 100Mbps ?
Because okay let's put the network at 90% capacity. So 90Mbps.
90 / 8 = 11.25 MB/s
If I do a backup of a single filesystem, I never get that speed, always get 4MB/s.
That's only 32 Mbps. 32% of the network.
If I do a transfert between the 2 machines I get the 100% of the Network usage.
I know that Network are usually slow for backups, but that's the best option that my company have so far. So I need to maximize the network usage.
Anyway I'll try to get another solution in place. Because if 4MB/s is really the max I can get, I won't go anywhere. I guess that's it i'm at the maximum speed we can do.
Thanks for all your help!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 06:24 AM
08-06-2004 06:24 AM
SolutionSecondly, you'll never get 90% throughput on your 100Mbit link. After you browse Rick Jones' NetPerf web pages, you'll understand more about real network performance. http://www.netperf.org/ is the place to go for LAN performance. With some TCP?IP tuning, you might improve on the 50% number but not by much.
Finally, as mentioned before, you'll probably get shoe-shine performance out of your tape drive and that will seriously affect throughput as well as prematurely wear out your tape drive. You pay a very stiff penalty for not keeping the drive busy. In the old days of reel-to-reel tapes, the drive actually started, recorded and stopped for every record (really old stuff). These drives would literally buzz as the capstan rollers and brakes did their work. Later, the drives started buffering a few Kbytes and allowed the tape to avoid the mechanical start/stop cycles and performance soared.
Then in the 80's, the concept of a streaming tape drive became a reality. No more start/stop. Instead, a small motor would slowly spin the tape up to full speed. Once at speed, data would be recorded continuously. The idea is that the computer would keep sending data fast enough to keep the tape moving. But if the computer could not keep the data coming fast enough, the tape drive would run out of data (an underrun condition) and it would have to stop, backup, take a running start again, figure out where it was on the tape, find the end of the last record and then start recording again at just the right spot.
Streamers were inexpensive nad performed well but were terrible if the data stream wasn't fast enough, and for an entire tape, you could resposition several thousand times thus causing recording head wear equivalent to several hundred tape passes without repositioning.
Now, virtually all tape drives are streamers. The difference is that they have a ENORMOUS appetite for data. The LTO-2 drive is no exception. True, these drives have bigger data buffers (many megs) but unless the data stream is slightly faster than the tape drive (measured over many seconds), the tape will still be repositioned once the buffers are exhausted. This is a case where a slower tape drive is actually a better choice. You match the average data rate of the tape drive with the data rate of your backup stream.
So the bottom line is that you need a very fast link between computers. GigE is a possibility, just computer-to-computer if necessary, or aggregate multiple LAN cards if both ends support it. Otherwise, you may need to look at a local tape drive to keep the expected backup speeds and not destroy your drive in 6 months.
Bill Hassell, sysadmin
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 07:06 AM
08-06-2004 07:06 AM
Re: Poor performance
mmm, I think we will start working on getting
something running on GigE for the moment. That will be better.
Well, thanks to all who have provided some answers to help me stop mixing Mbps and MBps! ;)
And understanding how the drives works in streaming!
Thanks again!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-06-2004 05:38 PM
08-06-2004 05:38 PM
Re: Poor performance
Hein.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-08-2004 12:08 PM
08-08-2004 12:08 PM
Re: Poor performance
Bill Hassell, sysadmin
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-09-2004 01:34 AM
08-09-2004 01:34 AM
Re: Poor performance
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-09-2004 01:41 AM
08-09-2004 01:41 AM
Re: Poor performance
Anyway, so far I've been able to reduce the backup time of about 1 hour for my 6 backup groups.
I've attached the backup server in GigE to his switch, and the switch is connected to the main switch via GigE.
All the other servers are connected to their switch in 100MBps to their switch and then the switch to the main one.
(Yeah that's not the optimal setup, but that's what we have now)
At least now the backup server can receive a lot of stuff from other servers on the network.
So for now that's not so bad, but could be wayyyyy better! I'll have to deal with this, and I'll try to push to create a better infrastructure for the backups.
Thanks Everyone!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-09-2004 01:44 AM
08-09-2004 01:44 AM
Re: Poor performance
Bill Hassell, sysadmin