LoadRunner and Performance Center
cancel
Showing results for 
Search instead for 
Did you mean: 

Re: How to select a performance load test solution?

aash mangrulkar

S,

Good information overall, and it sounds like it was a great event for folks looking to educated on performance testing tools and selection criteria. Honestly not much new to add (as usual, Mark covers off most relevant areas), but I would reiterate points that should be emphasized to anyone looking to establish a performance testing process and/or vendor assessments in the space.

  • Not to oversimplify, but KISS is a good rule to keep in mind when establishing and implementing any process. We live in a complex enough world, the processes by which we are governed should streamline this, versus further complicate the maze that we run through to get apps tested and out the door. Establish your success criteria, and build as simple a process around delivering that as possible. Consistency and predictability (of the app and the process) is way more important than a large number of ‘checkpoints’.
  • The ‘devops’ mention was a little underplayed here, but is something that MUST be taken into consideration, especially given the traction Continuous Delivery has across Enterprise IT and the capabilities that WE are bringing to that market.
  • An oldie but a goodie is the need to look at the entire application – infrastructure and network emulation/virtualization really needs to be included to have real confidence in how an app is going to behave in the wild.
  • Most customers are NOT where they want to be, regardless of how mature they feel they are in the QA arena. Even though integrations are usually ‘nice-to-have’, they should be mentioned for two reasons: 1) it paints the ‘desired state’ vision for where things need to go and 2) HP has them! (as opposed to having to cobble things together behind the scenes.
  • Last thing to include (under Shane’s ‘do your homework’ phrase) are reference customers and marketechture. Of course we lead with this, but I am unaware of anywhere else that you’ll find the dominance that a single vendor has like HP in performance testing. This one is worth emphasizing for sure.

-aash

0 Kudos
About the Author

aash mangrulkar

Comments
aash mangrulkar

S,

Good information overall, and it sounds like it was a great event for folks looking to educated on performance testing tools and selection criteria. Honestly not much new to add (as usual, Mark covers off most relevant areas), but I would reiterate points that should be emphasized to anyone looking to establish a performance testing process and/or vendor assessments in the space.

  • Not to oversimplify, but KISS is a good rule to keep in mind when establishing and implementing any process. We live in a complex enough world, the processes by which we are governed should streamline this, versus further complicate the maze that we run through to get apps tested and out the door. Establish your success criteria, and build as simple a process around delivering that as possible. Consistency and predictability (of the app and the process) is way more important than a large number of ‘checkpoints’.
  • The ‘devops’ mention was a little underplayed here, but is something that MUST be taken into consideration, especially given the traction Continuous Delivery has across Enterprise IT and the capabilities that WE are bringing to that market.
  • An oldie but a goodie is the need to look at the entire application – infrastructure and network emulation/virtualization really needs to be included to have real confidence in how an app is going to behave in the wild.
  • Most customers are NOT where they want to be, regardless of how mature they feel they are in the QA arena. Even though integrations are usually ‘nice-to-have’, they should be mentioned for two reasons: 1) it paints the ‘desired state’ vision for where things need to go and 2) HP has them! (as opposed to having to cobble things together behind the scenes.
  • Last thing to include (under Shane’s ‘do your homework’ phrase) are reference customers and marketechture. Of course we lead with this, but I am unaware of anywhere else that you’ll find the dominance that a single vendor has like HP in performance testing. This one is worth emphasizing for sure.

-aash