WO2007070414A3 - Automated software testing framework - Google Patents

Automated software testing framework Download PDF

Info

Publication number
WO2007070414A3
WO2007070414A3 PCT/US2006/046993 US2006046993W WO2007070414A3 WO 2007070414 A3 WO2007070414 A3 WO 2007070414A3 US 2006046993 W US2006046993 W US 2006046993W WO 2007070414 A3 WO2007070414 A3 WO 2007070414A3
Authority
WO
WIPO (PCT)
Prior art keywords
test
tests
framework
testing framework
developer
Prior art date
Application number
PCT/US2006/046993
Other languages
French (fr)
Other versions
WO2007070414A2 (en
Inventor
Jesse A Noller
Robert S Mason Jr
Original Assignee
Archivas Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Archivas Inc filed Critical Archivas Inc
Priority to EP06845087A priority Critical patent/EP1963964A4/en
Priority to JP2008545688A priority patent/JP5535484B2/en
Publication of WO2007070414A2 publication Critical patent/WO2007070414A2/en
Publication of WO2007070414A3 publication Critical patent/WO2007070414A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites

Abstract

A generic testing framework to automatically allocate, install and verify a givn version of a system under test, to exercise the system against a series of tests in a hands-off objective manner, and then to export information about the tests to one or more developer repositories (such as a query-able database, an email list, a developer web server, a source code version control system, a defect tracking system, or the like). The framework does not care or concern itself with the particular implementation language of the test as long as the test can issue directives via a command line or configuration file.
PCT/US2006/046993 2005-12-12 2006-12-11 Automated software testing framework WO2007070414A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP06845087A EP1963964A4 (en) 2005-12-12 2006-12-11 Automated software testing framework
JP2008545688A JP5535484B2 (en) 2005-12-12 2006-12-11 Automated software testing framework

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/299,572 2005-12-12
US11/299,572 US7694181B2 (en) 2005-12-12 2005-12-12 Automated software testing framework

Publications (2)

Publication Number Publication Date
WO2007070414A2 WO2007070414A2 (en) 2007-06-21
WO2007070414A3 true WO2007070414A3 (en) 2008-06-26

Family

ID=38163439

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/046993 WO2007070414A2 (en) 2005-12-12 2006-12-11 Automated software testing framework

Country Status (4)

Country Link
US (2) US7694181B2 (en)
EP (1) EP1963964A4 (en)
JP (1) JP5535484B2 (en)
WO (1) WO2007070414A2 (en)

Families Citing this family (192)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7506311B2 (en) * 2004-02-19 2009-03-17 Oracle International Corporation Test tool for application programming interfaces
US8117591B1 (en) 2005-01-07 2012-02-14 Interactive TKO, Inc. Graphical model for test case viewing, editing, and reporting
US8146057B1 (en) * 2005-01-07 2012-03-27 Interactive TKO, Inc. Instrumentation system and method for testing software
US8141043B2 (en) 2005-01-11 2012-03-20 Worksoft, Inc. Automated business process testing that spans multiple platforms or applications
US7600220B2 (en) 2005-01-11 2009-10-06 Worksoft, Inc. Extensible execution language
US7996255B1 (en) * 2005-09-29 2011-08-09 The Mathworks, Inc. System and method for providing sales leads based on-demand software trial usage
US8352916B2 (en) * 2006-02-17 2013-01-08 International Business Machines Corporation Facilitating the automated testing of daily builds of software
US9166809B2 (en) * 2006-04-03 2015-10-20 Verizon Patent And Licensing Inc. Automated network testing
US8375013B2 (en) * 2006-05-17 2013-02-12 Oracle International Corporation Server-controlled testing of handheld devices
WO2008007160A2 (en) * 2006-07-11 2008-01-17 Abb Research Ltd. A life cycle management system for intelligent electronic devices
US8131644B2 (en) 2006-08-29 2012-03-06 Sap Ag Formular update
US8065661B2 (en) * 2006-08-29 2011-11-22 Sap Ag Test engine
US8037360B2 (en) * 2006-10-03 2011-10-11 Symantec Corporation Software testing framework for multiple operating system, hardware, and software configurations
US8074204B2 (en) * 2006-11-21 2011-12-06 Microsoft Corporation Test automation for business applications
US8140897B2 (en) * 2007-03-29 2012-03-20 International Business Machines Corporation Testing method for complex systems
US7979846B2 (en) * 2007-04-05 2011-07-12 Accenture Global Services Limited Automatic test generation for reference testing
US8239835B2 (en) * 2007-05-07 2012-08-07 Infosys Limited Automated software testing framework using independent test scripts
US8621434B2 (en) * 2007-06-26 2013-12-31 Topcoder, Inc. System and method for distributed software testing
US8326805B1 (en) * 2007-09-28 2012-12-04 Emc Corporation High-availability file archiving
US8266592B2 (en) * 2008-04-21 2012-09-11 Microsoft Corporation Ranking and optimizing automated test scripts
FR2931269A1 (en) * 2008-05-16 2009-11-20 Ateji Soc Par Actions Simplifi METHOD AND SYSTEM FOR DEVELOPING PARALLEL PROGRAMS
US8719788B2 (en) * 2008-05-23 2014-05-06 Microsoft Corporation Techniques for dynamically determining test platforms
US20090307763A1 (en) * 2008-06-05 2009-12-10 Fiberlink Communications Corporation Automated Test Management System and Method
JP2010061461A (en) * 2008-09-04 2010-03-18 Ricoh Co Ltd System for automatic evaluation of software performance
US9111019B2 (en) 2008-09-30 2015-08-18 Interactive TKO, Inc. Modeling and testing interactions between components of a software system
US8135659B2 (en) 2008-10-01 2012-03-13 Sap Ag System configuration comparison to identify process variation
US8458666B2 (en) * 2008-10-22 2013-06-04 Oracle International Corporation Methods and systems for implementing a test automation framework for testing software applications on UNIX/LINUX based machines
US8396893B2 (en) 2008-12-11 2013-03-12 Sap Ag Unified configuration of multiple applications
US8255429B2 (en) 2008-12-17 2012-08-28 Sap Ag Configuration change without disruption of incomplete processes
CA2748607A1 (en) 2008-12-31 2010-07-08 Ardelyx, Inc. Compounds and methods for inhibiting nhe-mediated antiport in the treatment of disorders associated with fluid retention or salt overload and gastrointestinal tract disorders
EP2214099A1 (en) * 2009-01-30 2010-08-04 Tieto Oyj Method for software package deployment in a network node
US9268532B2 (en) * 2009-02-25 2016-02-23 International Business Machines Corporation Constructing a service oriented architecture shared service
US20100235807A1 (en) * 2009-03-16 2010-09-16 Hitachi Data Systems Corporation Method and system for feature automation
JP5368878B2 (en) * 2009-05-25 2013-12-18 キヤノン株式会社 Information processing apparatus, manufacturing apparatus, and device manufacturing method
US8949791B2 (en) * 2009-07-08 2015-02-03 Vmware, Inc. Distributed software testing using cloud computing resources
US8549476B2 (en) * 2009-07-30 2013-10-01 Hewlett-Packard Development Company, L.P. Comparison of result of program operation to result of an operation of a different version of the program
US8296342B2 (en) * 2009-08-31 2012-10-23 Hewlett-Packard Development Company, L.P. Fingerprinting a database
US20110061041A1 (en) * 2009-09-04 2011-03-10 International Business Machines Corporation Reliability and availability modeling of a software application
US9582396B2 (en) * 2009-10-23 2017-02-28 Novell, Inc. Techniques for generating an executable debugger script
US20110145643A1 (en) * 2009-12-10 2011-06-16 Microsoft Corporation Reproducible test framework for randomized stress test
US8615741B2 (en) * 2009-12-24 2013-12-24 International Business Machines Corporation Software defect tracking
US8489930B1 (en) * 2010-01-20 2013-07-16 Instavia Software, Inc. Method and system for creating virtual editable data objects by using a read-only data set as baseline
US20110214105A1 (en) * 2010-02-26 2011-09-01 Macik Pavel Process for accepting a new build
US8990813B2 (en) * 2010-03-29 2015-03-24 Red Hat, Inc. Automated virtual machine image deployment and testing by accessing downloadable test packages and dynamically-changing test parameters
US20110296386A1 (en) * 2010-05-28 2011-12-01 Salesforce.Com, Inc. Methods and Systems for Validating Changes Submitted to a Source Control System
US8966447B2 (en) * 2010-06-21 2015-02-24 Apple Inc. Capturing and displaying state of automated user-level testing of a graphical user interface application
US8572579B2 (en) * 2010-08-19 2013-10-29 Oracle International Corporation Break on next called function or method in java debugger agent
CN103180834B (en) 2010-09-09 2015-12-02 国际商业机器公司 Automatic operation system test frame
US9122803B1 (en) * 2010-10-26 2015-09-01 Interactive TKO, Inc. Collaborative software defect detection
US8850399B2 (en) * 2010-11-15 2014-09-30 Microsoft Corporation Software development using code retraction and background warm up
US8607203B1 (en) * 2010-12-17 2013-12-10 Amazon Technologies, Inc. Test automation framework using dependency injection
US20120174068A1 (en) * 2010-12-30 2012-07-05 Sap Ag Testing Software Code
US9104803B2 (en) * 2011-01-03 2015-08-11 Paypal, Inc. On-demand software test environment generation
CN102591754A (en) * 2011-01-18 2012-07-18 智比特信息技术（镇江）有限公司 Automatic testing method for electronic product controlled by computer
US8627311B2 (en) * 2011-02-01 2014-01-07 Hewlett-Packard Development Company, L.P. Systems, methods, and apparatus to deploy software
US9191327B2 (en) 2011-02-10 2015-11-17 Varmour Networks, Inc. Distributed service processing of network gateways using virtual machines
CN102736972B (en) * 2011-03-30 2016-03-09 国际商业机器公司 The test case treating Test Application carries out the method and system processed
US9448915B2 (en) * 2011-04-13 2016-09-20 Accenture Global Services Limited Modular script designer for next generation testing system
US9183124B2 (en) * 2011-04-18 2015-11-10 Accenture Global Services Limited Automation controller for next generation testing system
CA2775165C (en) * 2011-04-18 2016-02-09 Accenture Global Services Limited Automation controller for next generation testing system
WO2012167190A1 (en) * 2011-06-02 2012-12-06 Versata Development Group, Inc. End user remote enterprise application software testing
US8819488B1 (en) 2011-06-15 2014-08-26 Amazon Technologies, Inc. Architecture for end-to-end testing of long-running, multi-stage asynchronous data processing services
US9507699B2 (en) 2011-06-16 2016-11-29 Microsoft Technology Licensing, Llc Streamlined testing experience
US8738958B2 (en) * 2011-06-20 2014-05-27 QuorumLabs, Inc. Recovery node testing
US8713531B1 (en) 2011-06-28 2014-04-29 Google Inc. Integrated bug tracking and testing
EP2546749A1 (en) * 2011-07-15 2013-01-16 Siemens Aktiengesellschaft Method and system for test suite control
US8793535B2 (en) * 2011-07-21 2014-07-29 Microsoft Corporation Optimizing system usage when running quality tests in a virtual machine environment
US8769340B2 (en) 2011-09-08 2014-07-01 Microsoft Corporation Automatically allocating clients for software program testing
JP2013069077A (en) * 2011-09-21 2013-04-18 Canon Inc System, information processing device and control method thereof, image formation device and control method thereof and program
US9058423B1 (en) * 2011-11-18 2015-06-16 Google Inc. Dynamic environment deployment within system tests to clusters, local machines or production
FI20116278A (en) * 2011-12-16 2013-06-17 Codenomicon Oy Information network-based testing service and procedure for testing in an information network
US9355017B2 (en) * 2012-01-06 2016-05-31 Iii Holdings 4, Llc Automated error checking system for a software application and method therefor
CN104160370A (en) 2012-01-26 2014-11-19 惠普发展公司，有限责任合伙企业 Image-based application automation
US9152541B1 (en) * 2012-03-22 2015-10-06 Amazon Technologies, Inc. Automated mobile application verification
CN104246759B (en) * 2012-04-25 2018-01-02 英派尔科技开发有限公司 Application programming interfaces testing service
CN103377127B (en) * 2012-04-28 2016-04-13 阿里巴巴集团控股有限公司 The development and testing system of web page product, method of testing and device
US9146837B2 (en) * 2012-05-23 2015-09-29 Landis+Gyr Innovations, Inc. Automated build, deploy, and testing environment for firmware
US8776021B1 (en) 2012-06-07 2014-07-08 Amazon Technologies, Inc. Application experiment system
US8850267B2 (en) * 2012-08-02 2014-09-30 Avago Technologies General Ip (Singapore) Pte. Ltd. Middleware for multiprocessor software testing
JP5816144B2 (en) * 2012-08-30 2015-11-18 株式会社アドバンテスト Test program and test system
US9348569B1 (en) * 2012-09-11 2016-05-24 Emc Corporation Method and system for a configurable automation framework
US8850400B2 (en) 2012-09-25 2014-09-30 Oracle International Corporation System and method for providing an implementation accelerator and regression testing framework for use with environments such as fusion applications
US10067858B2 (en) 2012-10-12 2018-09-04 Vmware, Inc. Cloud-based software testing
US10387294B2 (en) * 2012-10-12 2019-08-20 Vmware, Inc. Altering a test
US9684587B2 (en) 2012-10-12 2017-06-20 Vmware, Inc. Test creation with execution
US8984484B2 (en) 2012-11-27 2015-03-17 Nvidia Corporation Video sequence recording during a testing session on a data processing device to enable fault detection
US9430364B1 (en) * 2012-11-30 2016-08-30 Mobile Labs, LLC Systems, methods, and apparatuses for testing mobile device applications
US8930767B2 (en) 2012-12-07 2015-01-06 Software Ag Techniques for test automation in emergent systems
US9448792B2 (en) 2013-03-14 2016-09-20 Microsoft Technology Licensing, Llc Automatic risk analysis of software
US9218270B2 (en) * 2013-03-15 2015-12-22 Digital River, Inc. Functional software testing framework for determinate level testing
JP5326060B1 (en) * 2013-04-19 2013-10-30 浮田建設株式会社 Game system control method, game system, and computer program
CN104123219B (en) 2013-04-28 2017-05-24 国际商业机器公司 Method and device for testing software
US9104814B1 (en) * 2013-05-03 2015-08-11 Kabam, Inc. System and method for integrated testing of a virtual space
US9021438B2 (en) * 2013-06-20 2015-04-28 Sap Portals Israel Ltd Automatic framework for parallel testing on multiple testing environments
US9183117B2 (en) * 2013-06-20 2015-11-10 Abbott Laboratories Inc. Method for developing and testing a connectivity driver for an instrument
US9372787B2 (en) 2013-07-15 2016-06-21 Sap Se System and method for automating testing
US9317411B2 (en) 2013-07-31 2016-04-19 Bank Of America Corporation Testing coordinator
US9197546B2 (en) * 2013-08-06 2015-11-24 Oracle International Corporation System and method for providing a messaging cluster with hybrid partitions
US9317356B2 (en) * 2013-10-15 2016-04-19 Globalfoundries Inc. Device state capture during operating system dump
US10025839B2 (en) 2013-11-29 2018-07-17 Ca, Inc. Database virtualization
US9483393B1 (en) 2013-12-05 2016-11-01 Amazon Technologies, Inc. Discovering optimized experience configurations for a software application
US20150178184A1 (en) * 2013-12-19 2015-06-25 International Business Machines Corporation Test management using distributed computing
US9973472B2 (en) 2015-04-02 2018-05-15 Varmour Networks, Inc. Methods and systems for orchestrating physical and virtual switches to enforce security boundaries
US10091238B2 (en) 2014-02-11 2018-10-02 Varmour Networks, Inc. Deception using distributed threat detection
US10264025B2 (en) 2016-06-24 2019-04-16 Varmour Networks, Inc. Security policy generation for virtualization, bare-metal server, and cloud computing environments
US9727314B2 (en) 2014-03-21 2017-08-08 Ca, Inc. Composite virtual services
US9531609B2 (en) 2014-03-23 2016-12-27 Ca, Inc. Virtual service automation
US9665473B2 (en) * 2014-03-25 2017-05-30 Accenture Global Services Limited Smart tester application for testing other applications
US20150309917A1 (en) * 2014-04-29 2015-10-29 Yongyan Wang Automation Framework Interface
US9811248B1 (en) 2014-07-22 2017-11-07 Allstate Institute Company Webpage testing tool
US10042747B2 (en) 2014-11-12 2018-08-07 International Business Machines Corporation System and method for determining requirements for testing software
GB2532508B (en) * 2014-11-24 2017-03-15 Anritsu Corp Mobile communication terminal test device and a test analysis unit therefor
US9507590B2 (en) * 2014-12-08 2016-11-29 Semmle Limited Transitive source code violation matching and attribution
GB2533117A (en) 2014-12-10 2016-06-15 Ibm Software test automation
US10193929B2 (en) 2015-03-13 2019-01-29 Varmour Networks, Inc. Methods and systems for improving analytics in distributed networks
US10009381B2 (en) 2015-03-30 2018-06-26 Varmour Networks, Inc. System and method for threat-driven security policy controls
US9380027B1 (en) 2015-03-30 2016-06-28 Varmour Networks, Inc. Conditional declarative policies
US9952965B2 (en) 2015-08-06 2018-04-24 International Business Machines Corporation Test self-verification with integrated transparent self-diagnose
US10324905B1 (en) * 2015-08-21 2019-06-18 Amazon Technologies, Inc. Proactive state change acceptability verification in journal-based storage systems
US10095608B2 (en) * 2015-09-15 2018-10-09 International Business Machines Corporation Application test automation transmitting data via phone/voice calls
US10169192B2 (en) 2015-11-11 2019-01-01 International Business Machines Corporation Automatic collection and presentation of runtime data semantics
US9436585B1 (en) 2015-11-19 2016-09-06 International Business Machines Corporation Image patching in an integrated development environment
US10191758B2 (en) 2015-12-09 2019-01-29 Varmour Networks, Inc. Directing data traffic between intra-server virtual machines
US9762599B2 (en) 2016-01-29 2017-09-12 Varmour Networks, Inc. Multi-node affinity-based examination for computer network security remediation
US9680852B1 (en) 2016-01-29 2017-06-13 Varmour Networks, Inc. Recursive multi-layer examination for computer network security remediation
US10003677B2 (en) 2016-01-31 2018-06-19 Nxp Usa, Inc. Network application verification at a network processor
KR101751515B1 (en) * 2016-02-11 2017-06-27 네이버 주식회사 Apparatus, method, and computer program for testing
US9521115B1 (en) 2016-03-24 2016-12-13 Varmour Networks, Inc. Security policy generation using container metadata
US10114736B2 (en) 2016-03-30 2018-10-30 Ca, Inc. Virtual service data set generation
US10838846B1 (en) * 2016-05-16 2020-11-17 Jpmorgan Chase Bank, N.A. Method and system for implementing an automation software testing and packaging framework
US10623295B2 (en) * 2016-05-26 2020-04-14 CloudBolt Software Inc. Infrastructure testing
WO2017212496A2 (en) * 2016-06-08 2017-12-14 Veriversion Labs Ltd. Methods and systems of software testing, distribution, installation and deployment
US10755334B2 (en) * 2016-06-30 2020-08-25 Varmour Networks, Inc. Systems and methods for continually scoring and segmenting open opportunities using client data and product predictors
US10223247B2 (en) 2016-07-05 2019-03-05 Red Hat, Inc. Generating pseudorandom test items for software testing of an application under test (AUT)
CN106055486A (en) * 2016-08-19 2016-10-26 浪潮(北京)电子信息产业有限公司 Automatic operation maintenance method and platform of distributed file system
US10061685B1 (en) * 2016-08-31 2018-08-28 Amdocs Development Limited System, method, and computer program for high volume test automation (HVTA) utilizing recorded automation building blocks
US9690690B1 (en) 2016-09-30 2017-06-27 Semmle Limited Scalable transitive violation matching
US9639352B1 (en) 2016-10-12 2017-05-02 Semmle Limited Computing rework churn for contributions to a code base
KR102460416B1 (en) * 2016-10-24 2022-10-28 삼성에스디에스 주식회사 System and method for managing container-based distributed application
US10452774B2 (en) 2016-12-13 2019-10-22 Bank Of America Corporation System architecture framework
US10229750B2 (en) 2017-01-18 2019-03-12 Bank Of America Corporation Memory management architecture for use with a diagnostic tool
US10496739B2 (en) 2017-01-18 2019-12-03 Bank Of America Corporation Test case consolidator
US10127141B2 (en) 2017-02-20 2018-11-13 Bank Of America Corporation Electronic technology resource evaluation system
US10489287B2 (en) * 2017-05-15 2019-11-26 Bank Of America Corporation Conducting automated software testing using centralized controller and distributed test host servers
US10430184B2 (en) * 2017-10-24 2019-10-01 Semmle Limited Violation match sets
US10692031B2 (en) 2017-11-02 2020-06-23 International Business Machines Corporation Estimating software as a service cloud computing resource capacity requirements for a customer based on customer workflows and workloads
CN110678850B (en) * 2017-11-10 2023-10-10 谷歌有限责任公司 Automated device test classification system and technique
US11323315B1 (en) 2017-11-29 2022-05-03 Amazon Technologies, Inc. Automated host management service
US10540171B2 (en) * 2017-12-29 2020-01-21 Business Objects Software, Ltd. State capture and retrieval for rapid deployment environments
US10255065B1 (en) * 2017-12-29 2019-04-09 Semmle Limited Automatically building software projects
US11038770B2 (en) 2018-02-01 2021-06-15 Keysight Technologies, Inc. Methods, systems, and computer readable media for managing deployment and maintenance of network tools
US10769056B2 (en) 2018-02-26 2020-09-08 The Ultimate Software Group, Inc. System for autonomously testing a computer system
US11954461B2 (en) 2018-02-26 2024-04-09 Ukg Inc. Autonomously delivering software features
US10783065B2 (en) * 2018-03-23 2020-09-22 Sungard Availability Services, Lp Unified test automation system
CN108614770B (en) * 2018-04-09 2021-08-27 中国工商银行股份有限公司 Automatic test assertion method, device, storage medium and equipment
CN108683567B (en) * 2018-05-30 2021-12-07 郑州云海信息技术有限公司 Switch port fault testing method and system based on MCS and server
US10747651B1 (en) 2018-05-31 2020-08-18 The Ultimate Software Group, Inc. System for optimizing system resources and runtime during a testing procedure
US11113175B1 (en) 2018-05-31 2021-09-07 The Ultimate Software Group, Inc. System for discovering semantic relationships in computer programs
US10599767B1 (en) 2018-05-31 2020-03-24 The Ultimate Software Group, Inc. System for providing intelligent part of speech processing of complex natural language
US10977155B1 (en) 2018-05-31 2021-04-13 The Ultimate Software Group, Inc. System for providing autonomous discovery of field or navigation constraints
US11010284B1 (en) 2018-05-31 2021-05-18 The Ultimate Software Group, Inc. System for understanding navigational semantics via hypothesis generation and contextual analysis
CN108829599A (en) * 2018-06-15 2018-11-16 郑州云海信息技术有限公司 A kind of test method and system of the QuickAssist technical software based on Linux
US11385994B2 (en) 2018-08-21 2022-07-12 Marlabs Incorporated Testing automation controller framework and a method to operate the same
US10528454B1 (en) * 2018-10-23 2020-01-07 Fmr Llc Intelligent automation of computer software testing log aggregation, analysis, and error remediation
KR102617906B1 (en) * 2019-05-07 2023-12-27 한국정보통신기술협회 Test automation framework system for medical software and method of test automation
US11711374B2 (en) 2019-05-31 2023-07-25 Varmour Networks, Inc. Systems and methods for understanding identity and organizational access to applications within an enterprise environment
US11290494B2 (en) 2019-05-31 2022-03-29 Varmour Networks, Inc. Reliability prediction for cloud security policies
US11290493B2 (en) 2019-05-31 2022-03-29 Varmour Networks, Inc. Template-driven intent-based security
US11575563B2 (en) 2019-05-31 2023-02-07 Varmour Networks, Inc. Cloud security management
US11863580B2 (en) 2019-05-31 2024-01-02 Varmour Networks, Inc. Modeling application dependencies to identify operational risk
US11310284B2 (en) 2019-05-31 2022-04-19 Varmour Networks, Inc. Validation of cloud security policies
US10951509B1 (en) * 2019-06-07 2021-03-16 Keysight Technologies, Inc. Methods, systems, and computer readable media for providing intent-driven microapps for execution on communications network testing devices
CN110286281B (en) * 2019-06-11 2021-11-02 上海龙旗科技股份有限公司 Method and equipment for aging test of intelligent equipment
US10846208B1 (en) 2019-09-12 2020-11-24 T-Mobile Usa, Inc. Automation framework with orchestrated test execution, such as for use in testing wireless network components
US11489745B2 (en) 2019-10-15 2022-11-01 Keysight Technologies, Inc. Methods, systems and computer readable media for providing a declarative network monitoring environment
CN110879769B (en) * 2019-10-16 2024-01-26 中国航空工业集团公司洛阳电光设备研究所 Method for constructing embedded system test environment based on dynamic configurable framework
US11029938B1 (en) 2019-11-22 2021-06-08 Dell Products L.P. Software update compatibility assessment
CN112988555A (en) * 2019-12-13 2021-06-18 中移信息技术有限公司 Interface test method, device, equipment and storage medium
US11200049B2 (en) 2020-01-06 2021-12-14 International Business Machines Corporation Automated test authorization management
US11442839B2 (en) * 2020-03-10 2022-09-13 International Business Machines Corporation Runtime metrics based test ordering
US11726897B2 (en) * 2020-04-13 2023-08-15 The Toronto-Dominion Bank System and method for testing applications
CN111813387A (en) * 2020-07-10 2020-10-23 斑马网络技术有限公司 Testing device, construction method thereof and automatic testing method
KR102481249B1 (en) * 2020-10-22 2022-12-26 주식회사 엔씨소프트 Apparatus and method for test automation service
US11347630B1 (en) * 2020-11-09 2022-05-31 Jpmorgan Chase Bank, N.A. Method and system for an automated testing framework in design pattern and validating messages
US11818152B2 (en) 2020-12-23 2023-11-14 Varmour Networks, Inc. Modeling topic-based message-oriented middleware within a security system
US11876817B2 (en) 2020-12-23 2024-01-16 Varmour Networks, Inc. Modeling queue-based message-oriented middleware relationships in a security system
US11777978B2 (en) 2021-01-29 2023-10-03 Varmour Networks, Inc. Methods and systems for accurately assessing application access risk
US11630749B2 (en) 2021-04-09 2023-04-18 Bank Of America Corporation Electronic system for application monitoring and preemptive remediation of associated events
US11734316B2 (en) 2021-07-08 2023-08-22 Varmour Networks, Inc. Relationship-based search in a computing environment
CN113835685B (en) * 2021-11-26 2022-02-18 之江实验室 Network operating system design method based on mimicry database
CN114629832A (en) * 2022-03-17 2022-06-14 广州超云科技有限公司 Remote automatic test method, system, electronic equipment and storage medium
CN114706796A (en) * 2022-06-07 2022-07-05 广州易方信息科技股份有限公司 UI (user interface) automatic diff assertion method and device based on DOM (document object model) tree structure

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040267485A1 (en) * 2003-06-30 2004-12-30 Penov Francislav P Test execution framework for automated software testing
US20050044533A1 (en) * 2003-08-18 2005-02-24 Microsoft Corporation System and method for focused testing of software builds
US20050086022A1 (en) * 2003-10-15 2005-04-21 Microsoft Corporation System and method for providing a standardized test framework

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5021997A (en) 1986-09-29 1991-06-04 At&T Bell Laboratories Test automation system
JPH03206531A (en) * 1990-01-08 1991-09-09 Matsushita Electric Ind Co Ltd Automatic generating device for test program
JPH06110731A (en) * 1992-05-26 1994-04-22 Nec Corp Software test support device
US5357452A (en) 1992-06-30 1994-10-18 Sun Microsystems, Inc. Automatic generation of auto-checking testing functions
US5359546A (en) 1992-06-30 1994-10-25 Sun Microsystems, Inc. Automatic generation of test drivers
US5513315A (en) 1992-12-22 1996-04-30 Microsoft Corporation System and method for automatic testing of computer software
US5390325A (en) 1992-12-23 1995-02-14 Taligent, Inc. Automated testing system
US5500941A (en) 1994-07-06 1996-03-19 Ericsson, S.A. Optimum functional test method to determine the quality of a software system embedded in a large electronic system
US5596714A (en) * 1994-07-11 1997-01-21 Pure Atria Corporation Method for simultaneously testing multiple graphic user interface programs
JPH0895826A (en) * 1994-09-21 1996-04-12 Hitachi Software Eng Co Ltd Program testing method
US5542043A (en) 1994-10-11 1996-07-30 Bell Communications Research, Inc. Method and system for automatically generating efficient test cases for systems having interacting elements
US5590330A (en) 1994-12-13 1996-12-31 International Business Machines Corporation Method and system for providing a testing facility in a program development tool
US5634002A (en) 1995-05-31 1997-05-27 Sun Microsystems, Inc. Method and system for testing graphical user interface programs
US5751941A (en) * 1996-04-04 1998-05-12 Hewlett-Packard Company Object oriented framework for testing software
US5892947A (en) * 1996-07-01 1999-04-06 Sun Microsystems, Inc. Test support tool system and method
US5995915A (en) * 1997-01-29 1999-11-30 Advanced Micro Devices, Inc. Method and apparatus for the functional verification of digital electronic systems
US6002869A (en) 1997-02-26 1999-12-14 Novell, Inc. System and method for automatically testing software programs
US6167537A (en) 1997-09-22 2000-12-26 Hewlett-Packard Company Communications protocol for an automated testing system
US6182245B1 (en) * 1998-08-31 2001-01-30 Lsi Logic Corporation Software test case client/server system and method
US6601018B1 (en) * 1999-02-04 2003-07-29 International Business Machines Corporation Automatic test framework system and method in software component testing
US6542841B1 (en) * 1999-08-10 2003-04-01 Tyco Telecommunications (Us) Inc. Method for managing test measurements
US6301701B1 (en) 1999-11-10 2001-10-09 Tenfold Corporation Method for computer-assisted testing of software application components
US6269457B1 (en) * 2000-06-01 2001-07-31 Testing Technologies, Inc. Technology regression and verification acceptance method
US6662312B1 (en) 2000-06-30 2003-12-09 Qwest Communications International Inc. Software-testing automation system
EP1179776A1 (en) * 2000-08-11 2002-02-13 Sony Service Centre (Europe) N.V. Test automation framework
CA2445195A1 (en) * 2001-04-24 2002-10-31 Wvhtc Foundation Software suitability testing system
US20030093716A1 (en) * 2001-11-13 2003-05-15 International Business Machines Corporation Method and apparatus for collecting persistent coverage data across software versions
GB0206761D0 (en) * 2002-03-22 2002-05-01 Object Media Ltd Software testing
US7024589B2 (en) * 2002-06-14 2006-04-04 International Business Machines Corporation Reducing the complexity of finite state machine test generation using combinatorial designs
US6876942B2 (en) * 2002-09-18 2005-04-05 Lsi Logic Corporation Methods and systems for enhanced automated system testing
US7178065B2 (en) * 2003-04-02 2007-02-13 Sun Microsystems, Inc. System and method for measuring performance with distributed agents
JP2005107803A (en) * 2003-09-30 2005-04-21 Hitachi Ltd System updating method and computer system for executing the same
US20050120274A1 (en) * 2003-11-14 2005-06-02 Haghighat Mohammad R. Methods and apparatus to minimize debugging and testing time of applications
US7428663B2 (en) * 2004-06-01 2008-09-23 Alcatel Lucent Electronic device diagnostic methods and systems
EP1856825A2 (en) * 2005-03-07 2007-11-21 Nettest North America, Inc. Passive optical network loss test apparatus and method of use thereof
US7526681B2 (en) * 2006-08-07 2009-04-28 Sap Portals Israel Ltd. Software testing framework

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040267485A1 (en) * 2003-06-30 2004-12-30 Penov Francislav P Test execution framework for automated software testing
US20050044533A1 (en) * 2003-08-18 2005-02-24 Microsoft Corporation System and method for focused testing of software builds
US20050086022A1 (en) * 2003-10-15 2005-04-21 Microsoft Corporation System and method for providing a standardized test framework

Also Published As

Publication number Publication date
EP1963964A2 (en) 2008-09-03
US20070234293A1 (en) 2007-10-04
JP2009519544A (en) 2009-05-14
EP1963964A4 (en) 2012-02-01
JP5535484B2 (en) 2014-07-02
US8230267B2 (en) 2012-07-24
US7694181B2 (en) 2010-04-06
WO2007070414A2 (en) 2007-06-21
US20110035629A1 (en) 2011-02-10

Similar Documents

Publication Publication Date Title
WO2007070414A3 (en) Automated software testing framework
Madeyski et al. Which process metrics can significantly improve defect prediction models? An empirical study
Tuteja et al. A research study on importance of testing and quality assurance in software development life cycle (SDLC) models
Basile et al. On the industrial uptake of formal methods in the railway domain: A survey with stakeholders
Yoo et al. A unified model for the implementation of both ISO 9001: 2000 and CMMI by ISO-certified organizations
Chiarini et al. TQM implementation for the healthcare sector: The relevance of leadership and possible causes of lack of leadership
JP2011505605A5 (en)
BR112014001389A2 (en) Method for Repairing a System File and Appliance to Repair a System File
CN103460196A (en) System and method for verification and validation of redundancy software in PLC systems
Laporte et al. Small tech firms: Seizing the benefits of software and systems engineering standards
Gomes et al. Project management in the context of organizational change: The case of the Portuguese public sector
Fraser et al. Evosuite at the second unit testing tool competition
Dubey Towards adopting ODC in automation application development projects
CN105320510A (en) Method and device for automatically tracking data relation
CN105653445A (en) Implementation method capable of meeting DO-178C test result
Balser et al. Protocure: supporting the development of medical protocols through formal methods
Butkovic et al. Advancing cybersecurity capability measurement using the CERT®-RMM maturity indicator level scale
Wedlich et al. Good laboratory practice. Part 3. Implementing good laboratory practice in the analytical lab
Schweigert et al. The feature set of testspice 3.0
Koteska et al. Software engineering practices and principles to increase quality of scientific applications
Kontogiannis et al. 2nd workshop on DevOps and software analytics for continuous engineering and improvement
Peddigari Unified Cloud Migration Framework—Using factory based approach
ATE487188T1 (en) SYSTEM AND METHOD FOR AUTOMATICALLY CHECKING PLANNING RESULTS
Temmink A corporate guide to implementing a sustainable real estate program
Van Heerden et al. PRACTICAL IMPLEMENTATION OF THE ISO 50 001 STANDARD FOR LARGE INDUSTRIES

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2008545688

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2006845087

Country of ref document: EP