Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to What's New with Perfecto? - May 2017
Similar to What's New with Perfecto? - May 2017 (20)
More from Lizzy Guido (she/her)
More from Lizzy Guido (she/her) (20)
Recently uploaded
Recently uploaded (20)
What's New with Perfecto? - May 2017
- 1. What’s New? Lee Shoham, Solution Architect © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 2. What’s New- Agenda 5/31/2017 2© 2015, Perfecto Mobile Ltd. All Rights Reserved. • 10.2 • Support for Android 7.1.2 GA • Plugin for IntelliJ directly from JetBrains Repository • 10.3 • DigitalZoom Reporting Introduces New Features: • Reporting SDK updates • Jira Integration • CI Dashboard • Support of new CI tool – Circle CI • Increased Security Through Security Token • iOS Object Tree Optimization • HAR File Support
- 3. Release 10.2 © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 4. Support for Android 7.1.2 GA © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 5. Support for Android 7.1.2 GA 5/31/2017 5© 2015, Perfecto Mobile Ltd. All Rights Reserved. • Perfecto supports the latest GA version released by Google • See the full list of the latest versions supported by the Perfecto Lab
- 6. Plugin for IntelliJ directly from JetBrains Repository
- 7. Plugin for IntelliJ directly from JetBrains Repository 5/31/2017 7© 2015, Perfecto Mobile Ltd. All Rights Reserved. • The Perfecto Plugin for IntelliJ is now available for installation and updating directly from the JetBrains Repository • This will allow: Easier and more automatic access to the functionality provided Easier access to the Perfecto Lab.
- 8. Release 10.3 © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 9. DigitalZoom Reporting SDK Updates © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 10. DigitalZoom Reporting SDK Updates 5/31/2017 10© 2015, Perfecto Mobile Ltd. All Rights Reserved. • Test step command has been replaced by a Step start command • A new Step end command has been added to allow the tester to put an end bracket on the step • New command - reportiumAssert: A new Assert command supports the inclusion of test verification results in the test report • See how to integrate these new commands using Native Automation or the Selenium Reporting SDK - in each of the different language bindings.
- 11. DigitalZoom Reporting SDK Updates 5/31/2017 11© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 12. Reporting JIRA Integration © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 13. Reporting JIRA Integration 5/31/2017 13© 2015, Perfecto Mobile Ltd. All Rights Reserved. • Submit bugs to JIRA directly from the DigitalZoom Single Test Reports with a single click, in order to expedite feedback loop • Shorten your MTTR (Mean Time To Repair) by communicating bugs better and faster to JIRA • Embed the accurate data needed by engineering for the fix/debugging (command/step names, Screenshots, Stacktrace, Report URL) • Track JIRA issues status from within the DigitalZoom Report
- 14. Reporting JIRA Integration 5/31/2017 14© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 15. Reporting CI Dashboard © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 16. Reporting CI Dashboard 5/31/2017 16© 2015, Perfecto Mobile Ltd. All Rights Reserved. • New CI Dashboard - allows CI users to view an aggregation of their test results identified by their Job Name/Build Number as generated by their Continuous Integration (CI) tool: Real-time update of job/build quality status once triggered from Jenkins View Trends of previous executions
- 17. Reporting CI Dashboard 5/31/2017 17© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 18. Reporting Circle-CI Support © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 19. Reporting Circle-CI Support 5/31/2017 19© 2015, Perfecto Mobile Ltd. All Rights Reserved. • In order to maximize the ability to embed DigitalZoom Reporting to your toolchain, we now announce support for Circle CI tool. • See how to optimize the visibility to the quality status of your continuous integration by integrating your Job Names and Build Numbers to you reports in the following sample: example test suite.
- 20. Security Token for Increased Security © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 21. Security Token for Increased Security 5/31/2017 21© 2015, Perfecto Mobile Ltd. All Rights Reserved. • Perfecto CQ Lab introduces the use of a Security Token: New Single Sign-On (SSO) feature that allows a user to sign in for the Perfecto Lab without a need to later sign-in to the DigitalZoom Reporting server or any server associated with the Perfecto Lab strengthen the security Generated for a specific user on a specific Perfecto Lab Supply the security token for your Selenium/Appium scripts using the securityToken capability in place of the user and password capabilities
- 22. Security Token for Increased Security 5/31/2017 22© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 23. iOS Object Tree Optimization © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 24. iOS Object Tree Optimization 5/31/2017 24© 2015, Perfecto Mobile Ltd. All Rights Reserved. • The problem: a tested iOS application includes a View element with a large number of children elements, that generates long delays in executing a findElement() call and in extreme cases may throw an exception • The solution: Object Tree Optimization commands that instruct the system to limit the parsing of the UI Elements to the currently visible elements: Speed up the UI elements identification Prevent script from failing due to a timeout of element identification
- 25. iOS Object Tree Optimization 5/31/2017 25© 2015, Perfecto Mobile Ltd. All Rights Reserved. • The technique: applying the optimization for the entire script, using a capability: Applying the optimization to a particular section of Appium script:
- 26. iOS Object Tree Optimization 5/31/2017 26© 2015, Perfecto Mobile Ltd. All Rights Reserved. • The technique: applying the optimization for Perfecto native automation:
- 27. iOS Object Tree Optimization 5/31/2017 27© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 28. HAR File Support © 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 29. HAR File Support 5/31/2017 29© 2015, Perfecto Mobile Ltd. All Rights Reserved. • Perfecto provides support to generate a HAR file from an automation-script run, by activating the Network Virtualization functionality of the Perfecto CQ Lab • The HAR file will be included in the Reporting artifacts for the automation Single Test Report • in order to generate the HAR file successfully, a certificate would have to be installed on the device • After downloading, view the .har file with an appropriate viewer
- 30. HAR File Support 5/31/2017 30© 2015, Perfecto Mobile Ltd. All Rights Reserved.
- 31. 5/31/2017 31© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Editor's Notes
- Going to go over the latest perfecto releases: 10.2 & 10.3
- Perfecto now supports the latest GA version released by Google. You can review the full list of the latest versions supported by the Perfecto Lab.
- Perfeto lab plugin
- Perfecto now has the plugin available directly from JetBrains repo. DEMO: open Intellij -> File -> Settings -> Plugins -> Browse repositories -> search for ‘perfecto’
- 1. To help clarify the use of logical steps and make the Execution Report easier to follow, Perfecto has redefined the commands used for delineating the different logical steps of the execution. ‘Test step’ command has been replaced by ‘Step start’ command, and a new ‘step end’ command has been added, to allow the tester to put an end bracket on a step (we’ll demonstrate that in a minute). 2. Assertions support: the ability to add assertions and verifications results to the report. DEMO: ReportingAssertionsTest, demonstares using testng assertion + try catch or perfecto checkpoint + if else, using stepEnd and without.
- It’s possible to download the Assertions report, that includes only the assertions data (exporting this through REST API will be supported in upcoming version).
- Perfecto now supports submitting bugs to jira directly from the reporting single test report, by using a single click. This will shorten your mean time to repair and embed accurate data needed by engineering for the fix. You can also track jira issues from within the report.
- DEMO: https://branchtest.reporting-stg.perfectomobile.com/test/59217fb946e0fb00050c9d0b/ After successfully completing the integration configuration, the Single Test Report (STR) will display an icon that allows the user to connect directly to the project's JIRA space and open new "Bug" issues based on the test results. Creating the JIRA Issue: Click on the icon -> fill in the details (The Description field will auto-include basic information on the source of this issue: that it is associated with a Test Report, and when the test was run). Tracking the Issues: When issues were created from the STR, a counter will be displayed to the right of the "bug reporting" icon. The counter displays the number of open issues associated with the Test Report. Hovering over the counter will display a popup list of the issues. Each issue in the list includes: - The JIRA issue number and title. - Date that issue was opened. - Current status of the issue. Clicking on an entry in the list will transfer the user to the JIRA system to view the details of the issue. If there are multiple issues, you can open a JIRA "search" page that displays all of the issues by clicking on View all in JIRA.
- The Reporting system now offers a CI dashboard, which allows a view of an aggregation of test results, identified by job name. The CI view is broken down by job name, describing number of tests that were executed under each job, and the success/failure distribution. Also features the job’s history. Drilling down to each of those will present the single test reports associated with the specific job.
- The Reporting system now offers a CI dashboard, which allows a view of an aggregation of test results, identified by job name. The CI view is broken down by job name, describing number of tests that were executed under each job, and the success/failure distribution. Also features the job’s history. Drilling down to each of those will present the single test reports associated with the specific job.
- The most commonly used CI tool is Jenkins, but for customers who use Circle-CI as their CI tool, it is now possible to integrate reporting in your CI flow, similarly to Jenkins, and hence maximizing the ability to embed Reporting to your toolchain. You can later review the example test suite that demonstrates this.
- Perfecto CQ Lab introduces the use of a Security Token that will strengthen the security of Perfecto Lab access from automation scripts and will be used for authentication across Perfecto servers associated with the Perfecto Lab. This allows for 2 things: 1. Perfecto will begin to roll-out the new Single Sign-On (SSO) feature that allows a user to sign in for the Perfecto Lab without a need to later sign-in to the DigitalZoom Reporting server or any server associated with the Perfecto Lab. DEMO: demonstrate the SSO on branchtest. 2. You can Supply the security token for your Selenium/Appium scripts using the securityToken capability in place of the user and password capabilities used until now (old scripts using password authentication will continue to execute properly). DEMO: Demonstrate how to get the security token from lab (The security token is generated for a specific user on a specific Perfecto Lab). Demonstare in code: securityToken capability (ReportingAssertionsTest -> ReportingTest). Limitation: Use of the Security Token is not supported for On-Prem Perfecto Lab installations. Note: The roll-out of the feature will be implemented over the next few update cycles to eventually cover all hosted Perfecto Lab installations. Security token is also supported for perfecto REST API.
- Perfecto CQ Lab introduces the use of a Security Token that will strengthen the security of Perfecto Lab access from automation scripts and will be used for authentication across Perfecto servers associated with the Perfecto Lab. This allows for 2 things: 1. Perfecto will begin to roll-out the new Single Sign-On (SSO) feature that allows a user to sign in for the Perfecto Lab without a need to later sign-in to the DigitalZoom Reporting server or any server associated with the Perfecto Lab. DEMO: demonstrate the SSO on branchtest. 2. You can Supply the security token for your Selenium/Appium scripts using the securityToken capability in place of the user and password capabilities used until now (old scripts using password authentication will continue to execute properly). DEMO: Demonstrate how to get the security token from lab (The security token is generated for a specific user on a specific Perfecto Lab). Demonstare in code: securityToken capability (ReportingAssertionsTest -> ReportingTest). Limitation: Use of the Security Token is not supported for On-Prem Perfecto Lab installations. Note: The roll-out of the feature will be implemented over the next few update cycles to eventually cover all hosted Perfecto Lab installations. Security token is also supported for perfecto REST API.
- ***When an automation script attempts to identify a particular UI Element in an iOS application, Perfecto scans the application’s UI Object Tree and then identifies the element to interact with. Some iOS applications may include a View object (for example, a TableView) that has a large number of child elements, not all of which may be visible on the current application display. Parsing all of the children may take long time of processing (in an extreme case the parsing and building of the tree took almost an hour of processing time). This negatively affects the script execution time and in extreme cases may cause a Perfecto "Premature end of file" exception. To overcome these situations, Perfecto now offers Object Tree Optimization commands that instruct the system to limit the parsing of the UI Elements to the currently visible elements and perform the Element identification on this limited Object Tree. By performing this optimization, we achieve: - Speeding up the UI elements identification. - Preventing script from failing due to a timeout of the element identification.
- This new functionality may be applied to an entire test script, or limited to a particular area in the script. This would allow the Perfecto Lab to be configured for limited or non-optimization, but to apply the optimization to a particular application screen. - To apply the Object tree optimization to the entire application, use the objectsOptimization capability during the IOSDriver creation. A value of true, applies the optimization. - To apply the Object Tree optimization to a particular section of the test script, use the following set of Perfecto commands: mobile:objects.optimization:start - Starts ObjectSpy optimization for any object tree operations. mobile:objects.optimization:stop - Terminates the optimization. If the stop command does not appear, optimization will continue until the end of the script. These commands are applied using the driver.executeScript() method. To apply to Perfecto Native Automation use: objects.optimization start - Activate before searching for the element child of a large View object. objects.optimization stop - Activate when completed with the large View object. These commands do not require any parameters. Limitation: when this optimization is in use, the script should only interact with UI elements that are displayed on the screen, not elements that may be available by scrolling the display to show currently hidden UI elements. Note: - This functionality applies to automation test scripts for iOS applications on iOS 8 or later only. - This feature only affects native apps or the native sub-trees of hybrid apps (essentially, not applicable to WebViews or children of WebViews) Appium caching of object identifiers is suspended while the object optimization is in effect. DEMO: demonstrate the tree in object spy before and after the optimization. Export the tree and search for //*[@visible='false']
- This new functionality may be applied to an entire test script, or limited to a particular area in the script. This would allow the Perfecto Lab to be configured for limited or non-optimization, but to apply the optimization to a particular application screen. - To apply the Object tree optimization to the entire application, use the objectsOptimization capability during the IOSDriver creation. A value of true, applies the optimization. - To apply the Object Tree optimization to a particular section of the test script, use the following set of Perfecto commands: mobile:objects.optimization:start - Starts ObjectSpy optimization for any object tree operations. mobile:objects.optimization:stop - Terminates the optimization. If the stop command does not appear, optimization will continue until the end of the script. These commands are applied using the driver.executeScript() method. To apply to Perfecto Native Automation use: objects.optimization start - Activate before searching for the element child of a large View object. objects.optimization stop - Activate when completed with the large View object. These commands do not require any parameters. Limitation: when this optimization is in use, the script should only interact with UI elements that are displayed on the screen, not elements that may be available by scrolling the display to show currently hidden UI elements. Note: - This functionality applies to automation test scripts for iOS applications on iOS 8 or later only. - This feature only affects native apps or the native sub-trees of hybrid apps (essentially, not applicable to WebViews or children of WebViews)
- HTTP Archive (HAR) file is a JSON-formatted archive file format for logging an application’s (either browser or a native/hybrid app) interaction with HTTP servers. Perfecto now provides support for generating a HAR file from an automation script, by activating the Network Virtualization functionality of the Perfecto Lab. The HAR file can then be downloaded as an artifact from the single test report. Note: - This feature is currently available only for limited release. Customers who wish to use it should approach their CSM/support. - A certificate must be installed on the device in order to successfully generate the file. Relevant viewers: either a browser developer tool (Chrome, Firefox tools) or an external tool like Charles. You can expect a HAR file to include a breakdown of timings including: - How long it takes to fetch DNS information. - How long each object takes to be requested. - How long it takes to connect to the server. - How long it takes to transfer assets from the server to the browser of each object.
- HTTP Archive (HAR) file is a JSON-formatted archive file format for logging an application’s (either browser or a native/hybrid app) interaction with HTTP servers. Perfecto now provides support for generating a HAR file from an automation script, by activating the Network Virtualization functionality of the Perfecto Lab. The HAR file can then be downloaded as an artifact from the single test report. Note: - This feature is currently available only for limited release. Customers who wish to use it should approach their CSM/support. - A certificate must be installed on the device in order to successfully generate the file. Relevant viewers: either a browser developer tool (Chrome, Firefox tools) or an external tool like Charles. You can expect a HAR file to include a breakdown of timings including: - How long it takes to fetch DNS information. - How long each object takes to be requested. - How long it takes to connect to the server. - How long it takes to transfer assets from the server to the browser of each object.