- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - HP-UX
- >
- Test read IO of filesystem using dd
Operating System - HP-UX
1752780
Members
6329
Online
108789
Solutions
Forums
Categories
Company
Local Language
юдл
back
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
юдл
back
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Blogs
Information
Community
Resources
Community Language
Language
Forums
Blogs
Topic Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-15-2009 10:02 PM
тАО04-15-2009 10:02 PM
Test read IO of filesystem using dd
Hi,
We are planning to upgrade our VXFS from disk layout 4 to 6 and prior to the upgrade in production we simulate the upgrade in development server. After the upgrade we compared the batch job that we ran before the upgrade and found the performance degrade by 4-8%. I took the following approach to test the FS performance.
I test the read performance of VXFS (different disk layout, 4/5/6) using dd. I use a 2GB file as the input file and ran the following CMD. The start & end time are the same for the 3 disk layout.
dd if=/xxx/yyy/filename.log of=/dev/null
I need some feedback if this test was sufficient to justify that the issue was not with the upgrade (FS) since the read performance is the same.
We are planning to upgrade our VXFS from disk layout 4 to 6 and prior to the upgrade in production we simulate the upgrade in development server. After the upgrade we compared the batch job that we ran before the upgrade and found the performance degrade by 4-8%. I took the following approach to test the FS performance.
I test the read performance of VXFS (different disk layout, 4/5/6) using dd. I use a 2GB file as the input file and ran the following CMD. The start & end time are the same for the 3 disk layout.
dd if=/xxx/yyy/filename.log of=/dev/null
I need some feedback if this test was sufficient to justify that the issue was not with the upgrade (FS) since the read performance is the same.
3 REPLIES 3
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-15-2009 11:29 PM
тАО04-15-2009 11:29 PM
Re: Test read IO of filesystem using dd
> [...] we compared the batch job [...]
> I test the read performance [...]
Does your batch job do nothing except read a
2GB file? (And throw the data away?)
Your test seems unlikely to be much like any
actual job, so I don't see that you have
proved very much. If the real job is much
different from the test job, then what does
the test tell you?
I'd want to know where the batch job was
spending its time (before and after the
changes), how much I/O it was doing, and so
on.
> I test the read performance [...]
Does your batch job do nothing except read a
2GB file? (And throw the data away?)
Your test seems unlikely to be much like any
actual job, so I don't see that you have
proved very much. If the real job is much
different from the test job, then what does
the test tell you?
I'd want to know where the batch job was
spending its time (before and after the
changes), how much I/O it was doing, and so
on.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-16-2009 12:46 AM
тАО04-16-2009 12:46 AM
Re: Test read IO of filesystem using dd
The batch job reads multiple records from oracle database server does some formatting and writes to application server. The JFS upgrade was performed on the DB server only.
The IO during the job durations are as follow.
Before upgrade
Average IO Rate = 774.46
Average Logical IO Rate = 2572.55
After upgrade
Average IO Rate = 922.97
Average Logical IO Rate = 2528.14
The IO during the job durations are as follow.
Before upgrade
Average IO Rate = 774.46
Average Logical IO Rate = 2572.55
After upgrade
Average IO Rate = 922.97
Average Logical IO Rate = 2528.14
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-16-2009 05:24 AM
тАО04-16-2009 05:24 AM
Re: Test read IO of filesystem using dd
> dd if=/xxx/yyy/filename.log of=/dev/null
This is about the worst use of dd there is. The default for dd is to read one 512-byte record and write that same 512-byte record. ALWAYS specify the bs= parameter to a reasonable size, for instance: bs=512k. You will see a huge improvement in performance.
Aside from reading very small records (which really emphasizes system overhead), it won't test the filesystem layout/version. VxFS code spends most all of it's activity with open,close, add/delete/move but once a file is open, there is no significant interaction with the VxFS code -- the file is open and reads just continue. The layout version has a lot to do with internal record keeping and sizes of fields.
A better test would be to create dozens of files simultaneously, write a few records, then lseek a long way from the start, write a few more, close and then remove the files. This will likely show more of the VxFS performance differences than a simple read.
Bill Hassell, sysadmin
This is about the worst use of dd there is. The default for dd is to read one 512-byte record and write that same 512-byte record. ALWAYS specify the bs= parameter to a reasonable size, for instance: bs=512k. You will see a huge improvement in performance.
Aside from reading very small records (which really emphasizes system overhead), it won't test the filesystem layout/version. VxFS code spends most all of it's activity with open,close, add/delete/move but once a file is open, there is no significant interaction with the VxFS code -- the file is open and reads just continue. The layout version has a lot to do with internal record keeping and sizes of fields.
A better test would be to create dozens of files simultaneously, write a few records, then lseek a long way from the start, write a few more, close and then remove the files. This will likely show more of the VxFS performance differences than a simple read.
Bill Hassell, sysadmin
The opinions expressed above are the personal opinions of the authors, not of Hewlett Packard Enterprise. By using this site, you accept the Terms of Use and Rules of Participation.
News and Events
Support
© Copyright 2024 Hewlett Packard Enterprise Development LP