- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - Linux
- >
- Re: How can I gather performance history for redha...
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-20-2009 04:32 AM
тАО03-20-2009 04:32 AM
Re: How can I gather performance history for redhat linux
For my systems, I have a script that runs just before midnight that gets the sar data for that day and keeps appending it to another text file that I was importing into ksar. Worked okay until the file gets too large.
The same script also generates another text file with daily averages for cpu and i/o. This gets imported into Excel and works well. All systems write their sar data to an nfs share which is also a samba share.
The goal here is to be able to generate reports that show performance over a long period of time, say a year or more. The daily average provides a nice summary of things and if one needs to drill into it further then the sar -A text file can be viewed.
ksar is nice for generating reports but in my opinion there is too much info which will generate a lot of questions. I tried adding specific graphs and also tried only generating pdf's for specific metrics but seems only 2 can be used ??
Ideally, something that can auto generate the graphs would be nice, guess I will have to look at gnuplot or something for that.
I'm also going to further explore collectl.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-21-2009 08:05 AM
тАО03-21-2009 08:05 AM
Re: How can I gather performance history for redhat linux
That said, if you want longer term data my assumption is you don't care about accuracy. After all, if you look at a 10 minute or 1 hour sample (which I think you'd have to do it you want a year's worth of data) and see an average network load of 30%, you'd never realize it might have been pegged at 100% for multiple minutes and that you're bandwidth starved. However if that's what you want, maybe you want to load your data into rrd. That's a db technology which ages/aggregates data so that the more recent data is finer grained while the older data is courser. It also has a nice plotting tool - every see ganglia
Of course, my vote would be to use collectl to gather the data rather than sar, but I'm also admittedly a little biased. ;-)
Hope this helps.
-mark
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-22-2009 05:16 PM
тАО03-22-2009 05:16 PM
Re: How can I gather performance history for redhat linux
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО06-10-2009 09:49 AM
тАО06-10-2009 09:49 AM
Re: How can I gather performance history for redhat linux
-mark
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО06-11-2009 07:54 AM
тАО06-11-2009 07:54 AM
Re: How can I gather performance history for redhat linux
It's a sledgehammer to crack a walnut though if you're only interested in a couple of systems, as it's designed to collate data for hundreds and thousands of systems/devices, and alert/trigger on events.
It's I/O stats collection on Linux sucks a bit, but I've worked round that by adding a small script to take named devices from /dev/mapper and then:
- get the major/minor numbers
- grep the major/minor numbers from /sys/block/*/dev to find the dm device name
- process the associated dm data from /proc/diskstats and graph what I'm interested in.
I find that being able to graph user friendly multipath device names like these:
asm-db, asm-dbp1, asm-fra, asm-frap1, home, ocr1, system-oracle, system-root, system-swap, usr-local, vote1
..is a dam sight more meaningful than
dm-0, dm-1, dm-2, dm-3, dm-4, dm-5, dm-6, dm-7, dm-8, dm-9, dm-10.
Not to mention that dm devices are not guaranteed to be the same, and change more often between reboots than they should with an iSCSI cluster, making them useless for collecting trend data.
That was the only thing that stopped me from using collectl ... hint hint ;-). Coming from a tru64 background I'm a big fan of collect.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО06-11-2009 08:12 AM
тАО06-11-2009 08:12 AM
Re: How can I gather performance history for redhat linux
As for DM naming, I think I follow what you're doing but I'm not sure where you're getting names like "asm-db, asm-dbp1, asm-fra, asm-frap1, etc".
Perhaps I can add what you're looking for to collectl if not too tough and general enough...
-mark
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО06-11-2009 01:29 PM
тАО06-11-2009 01:29 PM
Re: How can I gather performance history for redhat linux
The names "asm-db, asm-dbp1, asm-fra, asm-frap1, etc" come from multipathd. By default it aggregates device names that present different paths to the same device (/dev/sdc, /dev/sdd, etc) into a single device name e.g: /dev/mapper/mpath0. The fancy names come from multipathd's user friendly names feature, where you bind the WWID of a device you know, to a name you want to use and declare it in /etc/multipath.conf.
So for example if I know (from the LUN and from using the command "multipath -ll") that /dev/mapper/mpath0 is a disk I'm using for Oracle ASM data, and that it has a WWID of 16465616462656166353a3500000000000000000000000000 then I can rename mpath0 to something more meaningful by adding this to multipath.conf
multipaths {
multipath {
wwid 16465616462656166353a3500000000000000000000000000
alias asm-db
}
}
Then /dev/mapper/mpath0 becomes /dev/mapper/asm-db. I can treat that device then just like I would a regular disk block device, with the added benefit that the new name appears in a "multipath -ll" listing. Unfortunately it doesn't appear in /proc/diskstats, so I have to find its associated dm device first.
Does that help?
John
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО06-11-2009 01:39 PM
тАО06-11-2009 01:39 PM
Re: How can I gather performance history for redhat linux
#multipaths {
# multipath {
# wwid 3600508b4000156d700012000000b0000
# alias yellow
# path_grouping_policy multibus
# path_checker readsector0
# path_selector "round-robin 0"
# failback manual
# rr_weight priorities
# no_path_retry 5
# }
# multipath {
# wwid 1DEC_____321816758474
# alias red
# }
#}
tell me what it should look like and where the alias will appear and I'll see what I can do, maybe even get it into the next release of collectl!
-mark
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО06-11-2009 02:31 PM
тАО06-11-2009 02:31 PM
Re: How can I gather performance history for redhat linux
Tell you what, forget about multipathd for a minute and look at LVM, because this applies to LVM Logical Volumes just as well as multipath devices, and that's probably going to be more accessible to you without dedicated hardware.
On my systems I like to name what would normally be the default LVM volume group: VolGroup00 to be "system" and the two LVs that sit on that as "root" and "swap". device-mapper creates the following two devices for me:
/dev/mapper/system-root
/dev/mapper/system-swap
I think Ubuntu does this by default anyway, but I mostly use Redhat or CentOS.
But these devices don't appear in /proc/diskstats either. So I treat them just like I would user friendly multipath device names. I pick them out of /dev/mapper, and use the major/minor number pair to find the dm device files and then record the disk stats against system-root instead of dm-0 and system-swap instead of dm-1. If you can solve that, then you'll automatically solve the multipath user friendly names scenario as well :)
John
- « Previous
- Next »