Oracle Corporation · NYSE:ORCL
Oracle — Investor Presentation (2007)
35 slides from Oracle's investor presentation, 2007
Slide 1: Does Your Business Need Oracle 11g's Real Application Testing: Findings from Ovum research
Does Your Business Need Oracle 11g's Real Application Testing: Findings from Ovum research David Mitchell Senior Vice President, IT Research, Ovum david.mitchell@ovum.com +44 20 7551 9194 © Copyright Ovum 2007 www.ovum.com
Slide 2: Who is Ovum
Who is Ovum An independent research analyst and advisory firm, headquartered in London but operating globally Founded over 20 years ago Operating across all aspects of software, IT services, and telecoms Providing advice to enterprises, vendors and the investment community Part of the Info
Slide 3: Agenda
Agenda • Business • Current context practices and trends in testing 1 2 4 3 • Conclusions • Oracle Real and benefits Application Testing study 3 © Copyright Ovum 2007
Slide 4: Agenda: Business context
• Business • Current context practices and trends in testing 1 2 4 3 • Conclusions • Oracle Real and benefits Application Testing study 4 © Copyright Ovum 2007
Slide 5: Stimulus of the macro environment
Stimulus of the macro environment Globalization Volatility Technology New Market Web 2.0 competitors fluctuation enterprises Shorter IP New Rapid M&A uniqueness partners moves timescales 5 © Copyright Ovum 2007
Slide 6: Response to the macro environment
Response to the macro environment Customer Intimacy Customer Intimacy Business Agility Product Innovation Operational Efficiency Operational Excellence Product Innovation After Treacy and Weirsema , 1997, “The Discipline of Market Leaders” 6 © Copyright Ovum 2007
Slide 7: Stimulus of the meso environment
Stimulus of the meso environment Rapid response needed Security alerts Rapid response Software defects needed Rapid response Compliance needed Business Growth Rapid response needed Support Rapid response needed 7 © Copyright Ovum 2007
Slide 8: Agenda: Current practices and trends in testing
• Business • Current context practices and trends in testing 1 2 4 3 • Conclusions • Oracle Real and benefits Application Testing study 8 © Copyright Ovum 2007
Slide 9: Current practices
Current practices Testing takes a long time and is risky Examples Major international bank – 18-24 month change control cycle Publishing firm – without critical system for 2-3 months, testing forgot major sub-system and no regression planning Utility – spent nearly $30m on testing but stil
Slide 10: Current practices – always squeezed
Current practices – always squeezed 10 © Copyright Ovum 2007
Slide 11: Current practices – V-model
Current practices – V-model The V-shape model: stage and layers Requirement Acceptance Design System Test Specification Integration Code Unit Test 11 © Copyright Ovum 2007
Slide 12: Current practices – V-model, modified for two new threads
Current practices – V-model, modified for two new threads The V-shape model: for Agile development methods Prepare acceptance Acceptance User stories tests test Prepare unit tests Integrate Code and unit test 12 © Copyright Ovum 2007
Slide 13: Current practices – V-model, modified for two new threads
Current practices – V-model, modified for two new threads The V-shape model: requirements driven testing Prepare Requirement Acceptance tests Prepare Design System Test tests Prepare Integration Specification tests For requirements –driven Code Unit Test testing 13 © Copyright Ovum 2007
Slide 14: Current practices – moving to ALM
Current practices – moving to ALM Project Requirements Change Architecture Planning & Portfolio capture and Sourcing management management estimating management management IT Business Release Quality Monitoring & management management Reporting Management Application Delivery Architecture & Design C
Slide 15: Current practices – moving to ALM
Current practices – moving to ALM The implications Project Requirements Change Architecture Portfolio capture and Sourcing management management management management IT Business Planning & Release Quality Monitoring & estimating management management Reporting Management Testing integrated More foc
Slide 16: Current practices
Current practices Proportion of IT spend on different phases of the ALM lifecycle 100% 90% 22 22 23 24 25 26 80% 70% 26 28 29 Management 60% 30 30 30 QA 50% Develop 40% Design 37 33 29 27 24 23 30% Definition 20% 10 11 11 12 12 10% 9 6 7 8 8 9 9 0% 2006 2007 2008 2009 2010 2011 16 © Copyright Ovum 2
Slide 17: Current practices – system testing tasks
Current practices – system testing tasks Backup and Installation recovery testing Requirement Acceptance testing Stress and Operational Design volume process System Test testing testing Specification Integration Other system testing Code Unit Test 17 © Copyright Ovum 2007
Slide 18: Current practices – load testing
Current practices– load testing Execute Capture workload in Create larger samples of changed Compare simulated observed environment performance workload workload with load testing tool 18 © Copyright Ovum 2007
Slide 19: Current practices – load testing critical flaws
Current practices– load testing critical flaws Workload based on small samples, 1-3% is common Workload doesn’t represent monthly transactions Scaling doesn’t produce representative concurrency Creation and maintenance of ad hoc tools 19 © Copyright Ovum 2007
Slide 20: Addressed by the capabilities in Oracle Real Application Testing
Current practices– load testing critical flaws Workload based Addressed by the capabilities in Oracle Real Application Testing on small samples, 1-3% is common Workload doesn’t represent monthly transactions Scaling doesn’t produce representative concurrency Creation and maintenance of ad hoc tools
Slide 21: Agenda: Oracle Real Application Testing study
• Business • Current context practices and trends in testing 1 2 4 3 • Conclusions • Oracle Real and benefits Application Testing study 21 © Copyright Ovum 2007
Slide 22: Oracle Real Application Testing – Database Replay use cases
Oracle Real Application Testing Database Replay Use cases • Database upgrades, patches, schema changes, etc.. • Configuration changes - e.g. RAC or ASM moves • Environment changes e.g. OS, hardware, network 22 © Copyright Ovum 2007
Slide 23: Oracle Real Application Testing – Database Replay functionality
Oracle Real Application Testing Database Replay Functionality •Workload capture – all database calls, configurable start/end time •Workload processing – transforms capture files and generates metadata to enable reply •Workload replay – via replay client, identical timing and concurrency •Analysis
Slide 24: Database Replay comparisons with traditional methods
Oracle Real Application Testing Database Replay Comparisons with traditional methods • All database calls not sample • True timing and concurrency • Replay is client agnostic and more flexible e.g. to use multiple host machines 24 © Copyright Ovum 2007
Slide 25: Oracle Real Application Testing – SQL Performance Analyser use cases
Oracle Real Application Testing SQL Performance Analyser Use cases • Database upgrades and patches • Platform configuration changes e.g. OS or hardware • Schema – indexing, partition, materialized views • SQL tuning e.g. SQL Profile creation 25 © Copyright Ovum 2007
Slide 26: Oracle Real Application Testing – SQL Performance Analyser functionality
Oracle Real Application Testing SQL Performance Analyser Functionality •Capture SQL workload – into SQL Tuning Set with SQL text, parsing schema, execution plans, statistics, etc. •Reporting and analysis of workload and individual SQL statements, with reporting drill-down. •Recommendations on fixi
Slide 27: SQL Performance Analyser comparisons with traditional methods
Oracle Real Application Testing • SQL Performance Analyser Comparisons with traditional methods • Complete SQL workload with production context, e.g., bind variables, session settings, etc • Much reduced application setup stages • Improved flexibility for detailed SQL analysis without manual overhea
Slide 28: Analysis of Oracle Real Application Testing
Analysis of Oracle Real Application Testing Case study based Interviews with key technical staff Details of technical deployments through beta phase Description of benefits and issues 28 © Copyright Ovum 2007
Slide 29: Analysis of Oracle Real Application Testing
Analysis of Oracle Real Application Testing Three beta customers International hospitality and leisure organisation Technical consultancy – including major international clients International telecom equipment manufacturer Common characteristics Deployment in multi-terabyte production an
Slide 30: Agenda: Conclusions and benefits
• Business • Current context practices and trends in testing 1 2 4 3 • Conclusions • Oracle Real and benefits Application Testing study 30 © Copyright Ovum 2007
Slide 31: Conclusion and benefits
Conclusion and benefits Greater agility Enhanced service quality Enhanced efficiency Lower costs 31 © Copyright Ovum 2007
Slide 32: Benefit quotes…
Benefit quotes… “[without Real Application Testing, we don’t have a tool in place to tell our customers that a database change we plan to make will work,” • Reduced risk “Database Replay could cut testing costs by one or two orders of magnitude” • Cost reduction “you can gauge the impact of a specif
Slide 33: Benefit Examples
Benefit Examples Reduction in test cycle length by 80-90% Reduces need to learn applications to build representative synthetic workload Reduces effort in test planning and design Reduces effort in maintaining custom test scripts and tools Reduce preparation for scenario testing Removes t
Slide 34: Benefit Examples
Benefit Examples • TCO enabler – move to lower cost platforms more quickly e.g. Linux/RAC combination • Reputation and risk mitigation – harder to quantify but think of the major problems and their impact….. • Cost savings – reduction in testing budget by 50-95% in case studies – up to 70% more gene
Slide 35: Agenda
• Business • Current context practices and trends in testing 1 2 4 3 • Conclusions • Oracle Real and benefits Application Testing study 35 © Copyright Ovum 2007