Oracle and SQL Database Performance Whitepapers

Database performance load testing and analysis whitepapers for Oracle and SQL environments of .
ccppmop144
Database performance load testing and analysis whitepapers for Oracle and SQL environments of 
Clarity Project and Portfolio Management (PPM)
.
2
Disclaimer
: This document is not meant as a sizing guide or as a recommendation guide. Instead, it portrays possible user loads given a particular CA PPM configuration. We understand that customer requirements and environments differ. The CA PPM functionality exercised during these performance load tests may or may not match the functionality that individual companies deploy. CA does not recommend that customers acquire hardware based on this document, but instead seek the sizing expertise of our technical pre‐sales and professional services personnel. The test environments outlined in this document do not consider reporting, process engine, and background service or failover requirements.
This document is for your informational purposes only. CA assumes no responsibility for the accuracy or completeness of the information. To the extent permitted by applicable law, CA provides this document “as is” without warranty of any kind, including, without limitation, any implied warranties of merchantability, fitness for a particular purpose, or non-infringement. In no event will CA be liable for any loss or damage, direct or indirect, from the use of this document, including, without limitation, lost profits, business interruption, goodwill or lost data, even if CA is expressly advised in advance of the possibility of such damages.
MS SQL is a trademark or registered trademark of Microsoft Corporation in the United States and/or other countries.
: PDF editions of the
Clarity Project and Portfolio Management (PPM)
14.4 Oracle and SQL database performance whitepapers are also available. The Oracle PDF contains two additional sections not included on this page. The sections are
Appendix C: Oracle INIT.ORA Parameters
and
Appendix D: 1,000-User Load Test AWR Report
.
 
Executive Summary
To establish and publish performance benchmarks, CA conducted a series of tests for CA PPM Release 14.4 on a clustered LINUX environment. The following high level enhancements were made to the test infrastructure:
  • To simulate real-world activity, user concurrency was increased from 500 users to 1,000 users. Existing customer application logs were analyzed to ensure test throughput (number of actions performed) is on par with peak load for 1,000 concurrent users.
  • In addition to the UI actions performed, a background process was run in volume during the test. The process exported an updated project using the XML Open Gateway (XOG) and ran approximately 600 times per hour.
The test objectives were to:
  • Demonstrate the ability of the product to serve a large‐sized user base (10,000 users) on Intel‐based hardware using an Oracle 12c (12.1.0.2.0) database and Apache Tomcat Version 8.0.26 application servers on a LINUX clustered environment.
  • Establish performance benchmarks under load using a core set of application functionality on Intel‐based hardware and a Linux environment.
Methodology
The load tests use a mixture of inquiry and update actions to simulate end‐user interaction with the product. The tests used 1,000 virtual users to simulate a peak usage period for a total user population of 10,000 registered users. Wait times ranged between 3 and 45 seconds, depending on the type of action. The performance test is measured for 150 minutes, including a ramp‐up time of about 16 minutes. The tests used a single database server with two application servers and one background server, all running on individual physical servers. The actual experience of customers will depend on how hardware is set up, how many modules are deployed, how the user actions are distributed among the population, and the rights granted to the users.
: Testing at a 10% concurrency rate, 1,000 VUs represent 10,000 registered users. 1,000/.10=10,000, therefore 1,000 VUs represent 10,000 registered users. 10% concurrency is typical for CA PPM customers on peak usage times.
Results and Conclusion
After comparing the average response times for the same functionality between 14.4 and the previous release, the following overall performance improvements were identified:
Oracle
CA PPM Release 14.4 (14.4.0.234) performs 5% better than CA PPM Release 14.3 (14.3.0.298) on similar hardware comparing the same counters.
: [(v14.3 avgresp – v14.4 avgresp)/ v14.3 avgresp)] = % improvement
((0.72 - 0.68)/0.72) = 0.05 or 5%
MS SQL
CA PPM Release 14.4 (14.4.0.234) performs 4% better than CA PPM Release 14.3 (14.3.0.298) on similar hardware comparing the same counters.
: [(v14.3 avgresp – v14.4 avgresp)/ v14.3 avgresp)] = % improvement
((1.11 - 1.07)/1.11) = 0.036 or 4%
Release 14.3 and 14.4 Comparison by Functional Area
The following table shows the average response times by the major functional areas:
Functional Area
14.3 SQL
14.4 SQL
14.3 Oracle
14.4 Oracle
PM
1.37
1.35
0.84
0.78
Resource Management
2.05
1.98
1.35
1.26
FM
1.92
1.88
1.49
1.41
General Navigation
0.56
0.54
0.35
0.34
Timesheets
0.46
0.37
0.22
0.21
Portfolios
0.71
0.62
0.38
0.38
All Timers
1.11
1.07
0.72
0.68
: The All Timers row represents the response time averages of all timers and not the average of the individual functional area averages.
The following charts compare the response times for the two releases (shorter bars are better):
Oracle
Image comparing average response time by functional area for CA PPM 14.3 and 14.4.
SQL
image2016-12-1 11:32:5.png
 
 
Each area consists of the following use cases:
Use Case
Proj. Mgmt.
Res. Mgmt.
Fin. Mmgt.
Gen. Navigation
Timesheets
Portfolios
1
X
 
 
 
 
 
2
X
 
 
 
 
 
3
 
 
X
 
 
 
4
X
 
 
 
 
 
5
X
 
 
 
 
 
6
X
 
 
 
 
 
7
X
 
 
 
 
 
8
X
 
 
 
 
 
9
 
 
 
 
 
 
10
 
 
 
X
 
 
11
 
X
 
 
 
 
12
 
 
 
 
X
 
13
 
X
 
 
 
 
14
 
X
 
 
 
 
15
 
 
 
X
 
 
16
 
 
X
 
 
 
17
 
 
 
 
 
 
18
 
 
 
X
 
 
19
 
 
 
 
X
 
20
 
 
 
 
 
 
21 (a and b)
 
 
 
 
 
X
 
Database Size Details
Oracle
Projects
Resources
Teams
Assignments
Tasks
DB Size
6,916
 14,692
187,592
4,499,247
876,033
23 GB
MS SQL
Projects
Resources
Teams
Assignments
Tasks
DB Size
6,988
 14,690
187,979
 4,505,374
879,019
70 GB
 
Test Methodology
Load tests with 1,000 concurrent users were run. All tests were written and executed using HP Load Runner 12.1. Each virtual user simulates one real user actively and repeatedly clicking through a given scenario. Wait times reflect only interaction delays (for example, completing a form before clicking Submit), not idleness and task interruption. The background server ran all jobs, reports, and processes to completion prior to the start of the performance test.
1,000-User Load Test Results
Two Quad core X3430 2.40GHz Xeon servers, each running one v14.4 application instance, can support a simulated load for 10,000 registered users (1,000 simultaneous virtual users) with Oracle.
Results are drawn from the 1,000‐virtual user 2.0 hour load tests. 
Summary of Test Results
Oracle
SQL:
Average Transaction Response Time (in seconds)
0.68
1.07
Average Hits per second
27.11
27.28
Average Database Server CPU Utilization
14.50 %
26.36 %
Average Application Server 1 CPU Utilization
60.01 %
59.89 %
Average Application Server 2 CPU Utilization
54.90 %
61.88 %
Average Background Server CPU Utilization
13.15 %
7.17 %
To view the detailed results, download the following file:
Test Environment
For the Load tests, we used two application servers and one background server, each on their own hardware server.
CA PPM Database Performance Test Environment
CA PPM Database Performance Test Environment
Application & Background server software:
• OS: RHEL 6u6
• Java: 64 Bit JDK8u60
• App: Tomcat - 8.0.26
Application server JVM memory parameters:
• -Xms1024m
• -Xmx4096m
Oracle database server software:
• OS: RHEL 6.5
• DB: Oracle 12.1.0.2.0
MS SQL Server software:
• OS: Windows Server 2012 Standard
• DB: SQL Server 2012 EE 64 Bit
Application & Background server hardware:
• CPU: Quad core X3430 2.40GHz Xeon
• RAM: 8 GB
Oracle database server hardware:
• CPU: 32 core E5-2640 2.0 GHz Xeon
• RAM: 126 GB /16G for Oracle
SQL database server hardware:
• CPU: Octa core E5-2640 v2 2.0 GHz Intel Xeon (2 Processors)
• RAM: 128 GB /32 GB for SQL Server
Data Warehouse
The new data warehouse feature (introduced in CA PPM Release 14.2) is optimized specifically for reporting and analytics. The Data Warehouse is installed on a separate schema from the CA PPM database schema. The Data Warehouse is populated at scheduled intervals by a CA PPM job. For customers upgrading to CA PPM 14.4, the following section provides examples of expected growth rates and loading times based on existing database sizes.
Expected Growth Rates
We sampled 10 customer data sets from various industries to get an idea of expected growth rates.
image2016-6-6 14:31:6.png
Expected Load Times
We sampled ten customer data sets from various industries to get an idea of expected initial load times.
image2016-6-6 14:31:37.png
Functional Areas That Influence Growth
The following data points outline areas that influenced the size/load of the DWH in the preceeding tables.
image2016-6-6 14:32:4.png
Performance Graphs (1,000 User Load Test)
App and Background Server CPU Utilization (Oracle)
image2016-6-6 14:33:2.png
App and Background Server CPU Utilization (Oracle)
image2016-12-1 11:56:39.png
DB Server CPU Utilization (SQL)
The following graph displays the sum of CPU utilization over all CPUs (not the average).
image2016-12-1 11:58:20.png
Heap Usage
The following graph shows the JVM heap usage during and after the load test for the application servers as well as the BG server.
Oracle
image2016-6-6 14:33:42.png
SQL
image2016-12-1 12:0:4.png
Database Performance Use Cases
The same use cases apply to both SQL and Oracle environments.
Use Case 1: Create Projects
  1. Go to Homepage. Wait 10 seconds.
  2. Log in to the application. Wait 5 seconds.
  3. Click Projects link. Wait 10 seconds.
  4. Click New button on project list. Wait 20 seconds.
  5. Click Save. Wait 10 seconds.
  6. Click Team tab. Wait 10 seconds.
  7. Click Add button. Wait 15 seconds.
  8. Filter for desired resources. Wait 15 seconds.
  9. Select and add resources to project. Wait 10 seconds.
  10. Filter for desired resources. Wait 15 seconds.
  11. Select and add resources to project. Wait 10 seconds.
  12. Filter for desired resources. Wait 15 seconds.
  13. Select and add resources to project. Wait 10 seconds.
  14. Click Task tab. Wait 5 seconds.
  15. Open the Gantt Editing Session. Wait 5 seconds.
  16. Insert a subproject. Wait 50 seconds over 4 requests.
  17. Drill into the subproject (Note: In v13, this opens a new Gantt editing window). Wait 10 seconds.
  18. Insert a subproject. Wait 35 seconds over 3 requests.
  19. Drill into the subproject (In v13, this opens a new Gantt editing window). Wait 15 seconds.
  20. Make a change to one of the tasks by editing the start and finish dates; save. Wait 55 seconds over 4 requests.
  21. Close the Gantt window.
  22. Refresh the parent Gantt window. Wait 10 seconds.
  23. Close this Gantt window.
  24. Refresh the master project Gantt window. Wait 10 seconds.
  25. Expand All - verify that the changed task dates are displayed correctly. Wait 9 seconds.
  26. Close the Gantt editing window.
  27. Log out.
Use Case 2: PM Projects
  1. Go to Homepage. Wait 10 seconds.
  2. Log in to the application. Wait 5 seconds.
  3. View Project List. Wait 5 seconds.
  4. Open an existing Project. Wait 5 seconds.
  5. Access Project Dashboard tab with OOTB portlets. Wait 5 seconds.
  6. Access Project Properties and Project Team tabs Wait 15 seconds over 2 requests
  7. Use "Set Allocation" object action to update 15 selected team members to have 50% allocation. Wait 20 seconds over 2 requests.
  8. Use object action for "Commit Planned Allocation" to hard book selected team members. Wait 10 seconds over 2 requests.
  9. Log out.
Use Case 3: PM Financial Planning (View and Edit Cost Plan)
  1. View Cost Plan list page with 500 rows of cost plans. Wait 60 seconds divided over 6 requests.
  2. Open the detail of an existing Cost Plan. Wait 10 seconds.
  3. Update cost plan by repopulating and adding 4 additional detail rows. Wait 60 seconds divided over 6 requests.
  4. (Auto-addition of 3 rows by re-populate and manual addition of 1 row. Repeat for both re-populate types). Wait 120 seconds divided over 12 requests.
  5. View Benefit Plan list page (15 Benefit plans). Wait 50 seconds over 5 requests.
Use Case 3a: PM Financial Planning (Cost Plan 2)
  1. Create Cost Plan (Two grouping attributes) and add a cost plan detail row. Wait 235 seconds over 24 requests.
Use Case 3b: PM Financial Planning (Cost Plan 3)
  1. Create Cost Plan from Investment Team (Project duration 1 year, # of team members – 15, FTP type - Monthly). Wait 27 seconds over 20 requests
Use case 3c: PM Financial Planning (Cost Plan 4)
  1. Create Cost Plan from Task Assignments (Project duration 1 year, # of task assignments – 15, FTP type - Monthly) and open Benefit Plans page. Wait 90 seconds over 14 requests.
Use case 3d: PM Financial Planning (Cost Plan 5)
  1. Log in. Wait 5 seconds.
  2. Click on Projects link. Wait 5 seconds
  3. Expand the Projects filter. Wait 5 seconds
  4. Filter for Project. Wait 5 seconds
  5. Open Project. Wait 5 seconds
  6. Click on Financial Plans tab. Wait 5 seconds
  7. Click on New Cost Plan from Investment Team. Wait 5 seconds
  8. Select Grouping Attributes. Wait 5 seconds
  9. Click Save for new Cost Plan from Investment Team. Wait 5 seconds
  10. Go to Cost Plan Detail 1. Wait 5 seconds
  11. Click Return for Cost Plan Detail 1. Wait 5 seconds
  12. Click New Cost Plan from Task Assignments. Wait 5 seconds
  13. Select Grouping Attributes 2. Wait 5 seconds
  14. Click Save for New Cost Plan from Task Assignments. Wait 5 seconds
  15. Go to Cost Plan Detail 2. Wait 5 seconds
  16. Click Return for Cost Plan Detail 2. Wait 5 seconds
  17. Filter for New Cost Plan 1. Wait 5 seconds
  18. Open New Cost Plan 1. Wait 5 seconds
  19. Select Populate from Task Assignments. Wait 5 seconds
  20. Click Return for Cost Plan 3. Wait 5 seconds
  21. Filter for New Cost Plan 2. Wait 5 seconds
  22. Open New Cost Plan 2. Wait 5 seconds
  23. Click Populate From Investment Team. Wait 5 seconds
  24. Click Return for Cost Plan 4. Wait 5 seconds
  25. Click Project Properties. Wait 5 seconds
  26. Click Return for Projects. Wait 5 seconds
  27. Logout of the application.
Use case 4: Create Project from Template
  1. Click Projects link. Wait 35 seconds over 4 requests.
  2. Click Create New from Template. Wait 10 seconds.
  3. Filter for desired template. Wait 10 seconds.
  4. Select template. Wait 10 seconds.
  5. Click Save. Wait 5 seconds.
  6. Logout
Use case 5: Gantt Toolbar
  1. Open the “2000 Task” project’s Gantt editing window. After each action in the list below, save the changes. Wait 55 seconds over 8 requests.
  2. Using toolbar, create 10 new tasks. Wait 100 seconds over 10 requests.
  3. Using toolbar, copy a set of tasks from another project. Wait 35 seconds over 7 requests.
  4. Using toolbar, insert a subproject. Wait 25 seconds over 4 requests.
  5. Using toolbar, create a new project and insert it. Wait 15 seconds over 2 requests.
  6. Using toolbar, assign a resources to a selected task. Wait 30 seconds over 4 requests.
  7. Using toolbar, select 3 tasks and indent them. Then select 2 of those tasks and indent them one more level, then select the bottom task and indent it one more level. Wait 40 seconds over 6 requests.
  8. Using toolbar, select 3 top-level tasks and indent them. Then select them again and outdent. Wait 25 seconds over 3 requests.
  9. Using toolbar, select a top-level task and use the Move action to move it to another place in the WBS hierarchy. Wait 20 seconds over 2 requests.
  10. Using the toolbar, link 3 tasks. Wait 10 seconds.
  11. Using the toolbar, unlink the 3 tasks. Wait 10 seconds.
  12. Change the dates on 5 tasks. Save. Using the toolbar, create a new project baseline.
  13. Select the 5 tasks and using the toolbar, update the baseline on the selected tasks. Wait 90 seconds over 11 requests.
  14. Select 10 tasks and using the toolbar, delete the tasks. Wait 10 seconds over 2 requests.
  15. Using the toolbar, view the Gantt Legend.
  16. Using the “2000 task project”, expand all tasks. Wait 5 seconds.
  17. Using the “2000 task project”, collapse all tasks. Wait 5 seconds.
 
Use case 6: Gantt WBS List
  1. Use inline edit to edit 1 row and save. Wait 55 seconds over 11 requests.
  2. Use inline edit to edit 20 rows and save. Wait 105 seconds over 21 requests.
  3. Expand a single branch that has at least 4 levels of nested tasks. Wait 25 seconds over 5 requests.
  4. Inline edit: Assign three resources to a task using auto-suggest on the MVL “Assigned Resources” field in the grid. Wait 35 seconds over 6 requests.
  5. Insert one new blank row; edit; save. Wait 15 seconds over 3 requests.
  6. Drag and drop a task into a new position (from top to bottom of the page). Wait 5 seconds.
  7. Drag and drop a task into a new position (causing the list to scroll). Wait 5 seconds.
  8. Scroll down through the 2000 task project and record how long it takes when each new set of ‘100’ records is fetched. Wait 100 seconds over 20 requests.
  9. Expand Filter section.
  10. Filter using the OOTB fields:
    1. Task name.
    2. List view.
    3. Assigned Resources. Wait 15 seconds over 3 requests.
  11. Drill into a subproject from master project - this opens a separate Gantt editing session.
  12. Change start and finish dates for a task; save. Wait 25 seconds over 5 requests.
  13. Close the subproject Gantt.
  14. Refresh the master project. Wait 5 seconds.
  15. Expand the subproject and confirm updated task dates are seen in the WBS list. Wait 5 seconds.
Use Case 7: Interactive Gantt Chart
  1. Use Gantt task bar (drag) to change finish date; save. Wait 50 seconds over 8 requests.
  2. Use Gantt task bar (drag) to change start date, save. Wait 20 seconds over 2 requests.
  3. Use Gantt task bar (drag) to move entire task to later dates; save. Wait 20 seconds over 2 requests.
  4. Change timescale on the Gantt chart using the toolbar widget. Wait 10 seconds.
  5. Move Gantt time periods forward one column. Wait 10 seconds.
  6. Move Gantt timescale forward one set of time periods. Wait 10 seconds.
  7. Link two tasks using drag and drop for F-S dependency. Wait 10 seconds.
  8. Link two tasks using drag and drop for S-S dependency. Wait 20 seconds over 2 requests.
Use case 8: Auto-Schedule
  1. Create a tentative schedule without running auto-schedule. Wait 40 seconds over 8 requests.
  2. Change task start and finish dates. Wait 15 seconds.
  3. Publish the tentative schedule. Wait 5 seconds.
  4. Use toolbar to run auto-schedule to create a tentative schedule. Wait 15 seconds.
  5. Delete the tentative schedule. Wait 5 seconds.
Use case 10: General UI Behavior
  1. Page refresh on Project List page that configured to list 50 projects per page. Wait 70 seconds over 6 requests.
  2. Drill-down on a project, and click on the “Team” tab and “Detail” subtab. Wait 28 seconds over 3 requests.
  3. Add a new TSV column in Detail page Wait 83 seconds over 7 requests.
  4. Replace Assignment Roles. Wait 20 seconds over 2 requests.
  5. Select a Capacity Planning scenario from the “Team” tab Wait 40 seconds over 2 requests.
  6. Edit team member start date, team member finish date and allocation for at least 5 team members in this scenario and then click Save. Wait 42 seconds over 6 requests.
  7. Switch back to Plan of Record. Wait 10 seconds.
Use case 11: PM Resource Management: Working with Resources
  1. View the Resource List. Wait 25 seconds over 2 requests.
  2. Open a Resource that is allocated to at least 25 investments (Projects and NPIOs). Wait 10 seconds.
  3. Go to Resource Allocations tab and view data on the Summary page; go to Page 2 and then back to Page 1 (assumes rows per page is set to 20). Wait 5 seconds.
  4. Go to the Allocations - Detail page (this one has a TSV on it); advance time periods forward one set of periods. Wait 30 seconds over 4 requests.
  5. Click on Resource Planning menu. Wait 10 seconds.
  6. Open each Resource Planning tab and view data in each portlet. Wait 15 seconds over 3 requests.
Use case 12: Timesheets
  1. Log in. Wait 3 seconds.
  2. Navigate to Timesheets page. Wait 10 seconds.
  3. Filter Timesheet for desired user & time period. Wait 3 seconds.
  4. Click on Timesheet icon to display/edit timesheet. Wait 3 seconds.
  5. Click on ‘Populate’ button to populate timesheet. Wait 3 seconds.
  6. Confirm repopulate, click on ‘Yes’ button. Wait 5 seconds.
  7. Select and delete time entries from timesheet. Wait 3 seconds.
  8. Confirm Delete. Wait 3 seconds.
  9. Click on ‘Add Task’ button. Wait 5 seconds.
  10. Select task & Add task to timesheet. Wait 15 seconds.
  11. Submit timesheet. Wait 3 seconds.
  12. Open/Edit timesheet. Wait 3 seconds.
  13. Return timesheet. Wait 3 seconds.
  14. Log out.
Use case 13 - PM Financial Transactions
  1. View Transaction Vouchers List Page (20 records on first page). Wait 25 seconds over 5 requests.
  2. View Transactions (Detail) List Page - Should Include 20 Transactions. Wait 5 seconds.
  3. Create a new transaction, retain values then click Submit and Create new. Wait 40 seconds over 7 requests.
Use case 14 - Departments
  1. Navigator. Wait 15 seconds over 2 requests.
  2. Departments (show 50 departments with 9 columns). Wait 5 seconds.
  3. Select department. Wait 5 seconds.
  4. Select resources. Wait 5 seconds.
  5. Select investments. Wait 5 seconds.
Use case 15 - Navigator – All Page Script
  1. Overview Wait 20 seconds over 3 requests
  2. General Wait 5 seconds
  3. Organizer Wait 5 seconds
    1. Tasks Wait 5 seconds
    2. Calendar Wait 5 seconds
    3. Process Wait 5 seconds
    4. Notifications Wait 5 seconds
  4. Dashboards Wait 5 seconds
    1. New Wait 5 seconds
    2. Cancel Wait 5 seconds
  5. Portlets Wait 5 seconds
  6. Chart Wait 5 seconds
    1. Select one
      1. Select Graph and Next Wait 5 seconds
      2. Back Wait 5 seconds
  7. Grid Wait 5 seconds
    1. Select one Wait 5 seconds
    2. Cancel Wait 5 seconds
  8. Filter Wait 5 seconds
    1. Cancel Wait 5 seconds
  9. Interactive Wait 5 seconds
    1. Cancel Wait 5 seconds
  10. Timesheets Wait 5 seconds
  11. Reports and jobs Wait 5 seconds
    1. Jobs Wait 5 seconds
    2. Reports Wait 5 seconds
  12. Account settings Wait 5 seconds
    1. Proxy Wait 5 seconds
    2. Notifications Wait 5 seconds
    3. Software downloads Wait 5 seconds
    4. Personal information Wait 5 seconds
  13. Organization
  14. Departments Wait 5 seconds
    1. New Wait 5 seconds
    2. Cancel Wait 5 seconds
  15. Knowledge Store Wait 5 seconds
  16. IT Service Management Wait 5 seconds
  17. Services – Wait 5 seconds
    1. New Wait 5 seconds
    2. Cancel Wait 5 seconds
  18. Requirements Planning
  19. Release Planning Wait 5 seconds
    1. New Wait 5 seconds
    2. Cancel Wait 5 seconds
  20. Releases Wait 5 seconds
    1. New Wait 5 seconds
      1. Cancel Wait 5 seconds
  21. Requirements Wait 5 seconds
    1. New Wait 5 seconds
      1. Cancel Wait 5 seconds
  22. Portfolios Wait 5 seconds
    1. New Wait 5 seconds
      1. Cancel Wait 5 seconds
  23. Projects Wait 5 seconds
    1. New Wait 5 seconds
      1. Cancel Wait 5 seconds
  24. New from template Wait 5 seconds
    1. Cancel
  25. Select project Wait 5 seconds
    1. Dashboard Wait 5 seconds
    2. Team Wait 5 seconds
      1. Detail Wait 5 seconds
      2. Role Capacity Wait 5 seconds
      3. Participants Wait 5 seconds
      4. Participant Groups Wait 5 seconds
      5. Requisitions Wait 5 seconds
      6. Staff Wait 5 seconds
    3. Task Wait 5 seconds
      1. Task List Wait 5 seconds
      2. Assignments Wait 5 seconds
    4. Chargebacks Wait 5 seconds
      1. Options Wait 5 seconds
      2. Transactions Wait 5 seconds
      3. Debit Rules Wait 5 seconds
        1. New Wait 5 seconds
          1. Cancel Wait 5 seconds
    5. Processes Wait 5 seconds
    6. Properties Wait 5 seconds
      1. Cancel Wait 5 seconds
  26. Programs Wait 5 seconds
    1. New Wait 5 seconds
      1. Cancel Wait 5 seconds
  27. Products Wait 5 seconds
    1. New Wait 5 seconds
      1. Cancel Wait 5 seconds
  28. Other Work Wait 5 seconds
    1. New Wait 5 seconds
      1. Cancel Wait 5 seconds
  29. Demand Management Wait 5 seconds
    1. Ideas Wait 5 seconds
    2. New Wait 5 seconds
      1. Cancel Wait 5 seconds
    3. Incidents Wait 5 seconds
  30. Resource Management Wait 5 seconds
  31. Resources Wait 5 seconds
    1. New Wait 5 seconds
      1. Cancel Wait 5 seconds
    2. Select one. Wait 5 seconds
    3. Skills Wait 5 seconds
      1. Add Wait 5 seconds
      2. Back Wait 5 seconds
    4. Allocations Wait 5 seconds
      1. Add Wait 5 seconds
      2. Back Wait 5 seconds
    5. Document Manager Wait 5 seconds
  32. Resource planning Wait 5 seconds
    1. Allocations Wait 5 seconds
    2. Capacity Wait 5 seconds
    3. Investments Wait 5 seconds
    4. Workloads Wait 5 seconds
  33. Resource Finder Wait 5 seconds
    1. Filter Wait 5 seconds
  34. Enter Resource ID Wait 5 seconds
    1. Search
      Wait 5 seconds
      1. Select one. Wait 5 seconds
  35. Skills Wait 5 seconds
    1. Add Wait 5 seconds
    2. Back Wait 5 seconds
  36. Allocations Wait 5 seconds
    1. Add Wait 5 seconds
      1. Back Wait 5 seconds
  37. Document Manager Allocations Wait 5 seconds
  38. Calendar Wait 5 seconds
  39. Properties Wait 5 seconds
    1. Cancel Wait 5 seconds
  40. Resource Requisitions Wait 5 seconds
  41. Transaction Entry Wait 5 seconds
    1. New Wait 5 seconds
    2. Transaction Entry Wait 5 seconds
  42. Post to WIP. Wait 5 seconds
  43. Create WIP Adjustment. Wait 5 seconds
  44. Approve WIP Adjustment. Wait 5 seconds
  45. Transactions Wait 5 seconds
  46. Invoices Wait 5 seconds
Use case 16: PM Rate Matrix
  1. Open Rate/Cost Matrix. Wait 10 seconds.
  2. Create a new Matrix row properties page (5 assigned columns). Wait 45 Seconds over 5 requests
Use Case 18: Administration – All Page Script
  1. Organization and Access Wait 2 seconds
    1. Resources
      1. Select resource Wait 2 seconds
      2. OBS and Partitions Wait 2 seconds
      3. Groups Wait 2 seconds
        1. Add Wait 2 seconds
        2. Back Wait 2 seconds
      4. Resource’s Access Rights – global Wait 2 seconds
        1. Add Wait 2 seconds
        2. Back Wait 2 seconds
      5. Access to this resource – Full view, Wait 2 seconds
        1. Continue Wait 2 seconds
        2. Add Wait 2 seconds
        3. Exit Wait 2 seconds
      6. Access to this resource –group Wait 2 seconds
        1. Add Wait 2 seconds
        2. Exit Wait 2 seconds
      7. Access to this resource – OBS unit Wait 2 seconds
        1. Add Wait 2 seconds
        2. Exit
      8. Groups Wait 2 seconds
      9. Select group Wait 2 seconds
        1. Resources Wait 2 seconds
          1. Add Wait 2 seconds
          2. Back Wait 2 seconds
        2. Group Access Rights – Instance Wait 2 seconds
          1. Add Wait 2 seconds
          2. Back Wait 2 seconds
          3. Group Access Rights – OBS Unit Wait 2 seconds
            1. Add Wait 2 seconds
            2. Exit Wait 2 seconds
          4. Group Access Rights – Global Wait 2 seconds
            1. Add Wait 2 seconds
            2. Back Wait 2 seconds
      10. OBS Wait 2 seconds
        1. New Wait 2 seconds
        2. Back Wait 2 seconds
  2. Studio
    1. Objects Wait 2 seconds
      1. Select Project: Wait 2 seconds
        1. Attributes Wait 2 seconds
          1. Select one Wait 2 seconds
          2. Back Wait 2 seconds
          3. New attribute Wait 2 seconds
          4. Back Wait 2 seconds
        2. Linking Wait 2 seconds
          1. Select one Wait 2 seconds
          2. Back Wait 2 seconds
          3. New Wait 2 seconds
          4. Back Wait 2 seconds
        3. Actions Wait 2 seconds
          1. Select one Wait 2 seconds
          2. Close Wait 2 seconds
          3. New Wait 2 seconds
          4. Close Wait 2 seconds
        4. Views Wait 2 seconds
        5. Audit Trail Wait 2 seconds
          1. Access To This Object Wait 2 seconds
          2. Full View Wait 2 seconds
          3. Resource Wait 2 seconds
          4. Group Wait 2 seconds
          5. OBS Unit Wait 2 seconds
      2. Queries Wait 2 seconds
        1. New Wait 2 seconds
        2. Back Wait 2 seconds
      3. Portlets Wait 2 seconds
        1. Select One
          1. Access To This Portlet
            1. Full View Wait 2 seconds
            2. Resource Wait 2 seconds
            3. Group Wait 2 seconds
            4. OBS Unit Wait 2 seconds
          2. Properties Wait 2 seconds
          3. Back Wait 2 seconds
        2. New Wait 2 seconds
          1. Chart Portlet Wait 4 seconds over 2 requests
          2. Grid Portlet Wait 4 seconds over 2 requests
          3. Filter Portlet Wait 4 seconds over 2 requests
          4. HTML Portlet Wait 4 seconds over 2 requests
          5. Interactive Portlet Wait 4 seconds over 2 requests
      4. Portlet Pages Wait 2 seconds
        1. Select one Wait 2 seconds
          1. Link Parameters Wait 2 seconds
            1. New Wait 2 seconds
            2. Back Wait 2 seconds
          2. Tabs Wait 2 seconds
            1. New Wait 2 seconds
            2. Back Wait 2 seconds
          3. Access To This Object Wait 2 seconds
            1. Back Wait 2 seconds
        2. New
          1. Back
      5. Add-Ins Wait 2 seconds
      6. UI Themes Wait 2 seconds
      7. Views Wait 2 seconds
        1. Select one Wait 2 seconds
          1. Exit Wait 2 seconds
  3. Data Administration
    1. Time Slices Wait 2 seconds
      1. Select one Wait 2 seconds
        1. Back Wait 2 seconds
      2. New Wait 2 seconds
        1. Back Wait 2 seconds
    2. Lookups Wait 2 seconds
      1. Select one Wait 2 seconds
        1. Parent Window Wait 2 seconds
        2. Values Wait 2 seconds
          1. Select one Wait 2 seconds
            1. Back Wait 2 seconds
        3. Auto Suggest Wait 2 seconds
          1. Back
        4. General Wait 2 seconds
          1. Back Wait 2 seconds
      2. New Wait 2 seconds
      3. Back Wait 2 seconds
    3. Reports and Jobs Wait 2 seconds
      1. Select one:
        1. Parameters Wait 2 seconds
          1. Access one Wait 2 seconds
            1. Back Wait 2 seconds
        2. Parameter order Wait 2 seconds
        3. Incompatible Jobs Wait 2 seconds
          1. Add Wait 2 seconds
            1. Back Wait 2 seconds
        4. Associated Categories Wait 2 seconds
          1. Add Wait 2 seconds
            1. Back Wait 2 seconds
        5. Access to this Job Wait 2 seconds
          1. Full View Wait 2 seconds
          2. Resource Wait 2 seconds
          3. Group Wait 2 seconds
          4. OBS Unit Wait 2 seconds
    4. Skills Hierarchy Wait 2 seconds
      1. New Wait 2 seconds
        1. Back Wait 2 seconds
    5. Notifications Wait 2 seconds
      1. Select one. Wait 2 seconds
        1. Cancel Wait 2 seconds
  4. Project Management
    1. Timesheet Options Wait 2 seconds
    2. Time Reporting Periods Wait 2 seconds
      1. New Wait 2 seconds
        1. Back Wait 2 seconds
    3. Charge Codes Wait 2 seconds
      1. New Wait 2 seconds
        1. Back Wait 2 seconds
    4. Input Type Codes Wait 2 seconds
      1. New Wait 2 seconds
        1. Back Wait 2 seconds
    5. Settings Wait 2 seconds
    6. Base Calendars Wait 2 seconds
      1. New Wait 2 seconds
        1. Close Wait 2 seconds
    7. Migrate Methods Wait 2 seconds
    8. Risk Settings Wait 2 seconds
  5. General Settings
    1. System Options Wait 2 seconds
    2. Site Links Wait 2 seconds
      1. New Wait 2 seconds
        1. Back Wait 2 seconds
    3. Client Downloads Wait 2 seconds
Use case 19: Approve Timesheet
  1. Open a Timesheet. Wait 40 seconds over 5 requests.
  2. Approve Timesheet. Wait 5 seconds.
Use case 21a: New Portfolio
  1. Log in. Wait 10 seconds over 2 requests.
  2. Click on Portfolios Link. Wait 5 seconds.
  3. Click on New portfolio button. Wait 20 seconds.
  4. Enter details and click Save. Wait 5 seconds.
  5. Click on Manual link. Wait 20 seconds.
  6. Click on Contents Editor tab. Wait 10 seconds.
  7. Select Projects, Assets and Applications and click on Include button. Wait 5 seconds.
  8. Click on Build Power Filter link for Projects. Wait 5 seconds.
  9. Select Description as power filter. Wait 10 seconds.
  10. Add Description as to power filter. Wait 5 seconds.
  11. Click on Evaluate button to validate the filter. Wait 5 seconds.
  12. Click Save and Return for Projects power filter. Wait 5 seconds.
  13. Click on Build Power Filter link for Assets. Wait 5 seconds.
  14. Select Description as power filter. Wait 10 seconds.
  15. Add Description as to power filter. Wait 5 seconds.
  16. Click on Evaluate button to validate the filter. Wait 5 seconds.
  17. Click Save and Return for Assets power filter. Wait 5 seconds.
  18. Click on Build Power Filter link for Applications. Wait 5 seconds.
  19. Select Description as power filter. Wait 10 seconds.
  20. Add Description as to power filter. Wait 5 seconds.
  21. Click on Evaluate button to validate the filter. Wait 5 seconds.
  22. Click Save and Return for Applications power filter. Wait 5 seconds.
  23. Click on Properties tab. Wait 5 seconds.
  24. Click on Synchronization Schedule link. Wait 10 seconds.
  25. Click on Sync Now button. Wait 10 seconds over two requests.
  26. Log out of the application.
Use case 21b: New Portfolio
  1. Log in. Wait 10 seconds over two requests.
  2. Click on Portfolios link. Wait 5 seconds.
  3. Expand the filter. Wait 3 seconds.
  4. Filter for portfolio. Wait 3 seconds.
  5. Open portfolio. Wait 3 seconds.
  6. Click on Plans tab. Wait 5 seconds.
  7. Click on New button for new plan. Wait 10 seconds.
  8. Enter details and save plan 1. Wait 10 seconds.
  9. Select the created plan and click on Copy button. Wait 10 seconds.
  10. Enter details and save plan 2. Wait 5 seconds.
  11. Click on Investments tab. Wait 5 seconds.
  12. Click on Plans tab. Wait 5 seconds.
  13. Select plan 1 to edit. Wait 10 seconds.
  14. Edit and save plan 1. Wait 5 seconds.
  15. Click on Targets tab. Wait 10 seconds.
  16. Select plan 2 to edit. Wait 20 seconds.
  17. Edit and save plan 2. Wait 5 seconds.
  18. Return to plans list. Wait 5 seconds.
  19. Select plans 1 and 2 to delete. Wait 5 seconds.
  20. Delete selected plans. Wait 5 seconds.
  21. Log out of the application.