[Webkit-unassigned] [Bug 116332] New: Hard to figure out how to run a single test with run-api-tests or run-test-webkit-api

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=116332

           Summary: Hard to figure out how to run a single test with
                    run-api-tests or run-test-webkit-api
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: jberlin at webkit.org
                CC: beidson at apple.com, rniwa at webkit.org


Jessies-MacBook-P:Scripts jessieberlin$ run-api-tests --help
Usage: run-api-tests [options] [suite or test prefixes]
  --help                Show this help message
  -v|--verbose          Verbose output
  -d|--dump-tests       Dump the names of testcases without running them
  --[no-]build          Build (or do not build) unit tests prior to running (default: build)
  --root=               Path to the pre-built root containing TestWebKitAPI

Jessies-MacBook-P:Scripts jessieberlin$ run-test-webkit-api --help
Usage: run-test-webkit-api [options] [args ...]
  --help                            Show this help message
  --no-saved-state                  Launch the application without state restoration (OS X 10.7 and later)
  --guard-malloc                    Enable Guard Malloc (OS X only)
  --use-web-process-xpc-service     Launch the Web Process as an XPC Service (OS X only)

Nothing in there tells me I need to do the following to just run a single test
run-api-tests WebKit2.AboutBlankLoad
or
run-test-webkit-api --gtest_filter=WebKit2.AboutBlankLoad

It took grepping the tools to find something that indicated I needed to pass --gtest-filter=“WebKit2.AboutBlankLoad” as an argument to Xcode and only then did I realize that you need to add the “Suite Name” to the front of the test name.

I feel like I have to go through this 10 to 15 minute discovery every single time I want to add a test. We should be printing more helpful help about how to run a single test for each of those scripts.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.