Download to read offline
![UPath (Unity Path Language)
“/RootElement
/descendant::childName
//name[active]
[1]”](https://image.slidesharecdn.com/eyesorheart-190330203700/75/Eyes-or-heart-37-2048.jpg)
![UPath – Properties
- [number] – index
- [axis::{name}] – has relation according to the axis
- [active] – is active in hierarchy right now
- [!active] – is not active in hierarchy right now](https://image.slidesharecdn.com/eyesorheart-190330203700/75/Eyes-or-heart-39-2048.jpg)
![TEST
[Test]
public void Login_CorrectCredentials_Success()
{
//Arrange
var name = "Yevhen";
var password = “TestingStage2019";
//Act
var screen = new LoginScreen().MakeSuccessLogin(name, password);
//Assert
Assert.IsTrue(screen.IsPageOpened,
$"Main Menu was not opened after login with {name} and {password}")
}](https://image.slidesharecdn.com/eyesorheart-190330203700/75/Eyes-or-heart-52-2048.jpg)
Eyes or heart
- 1. TALK - BATTLE EYESOR HEART? WHOM TO BELIEVE? Yevhen vs Denys and Oleksii
- 2. PART 1: HEART Automateyour Unity3d application testing with Puppetry Yevhen Rudiev
- 3. Yevhen Rudiev • QATech Lead at TT Soltuions • 7 years experience in IT • 4 years experience in Automated Testing • Founder of Test Unit Lab organization
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 15.
- 16.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24. PUBLIC CLASSES public staticclass PuppetryDriver public static class Configuration public static class Editor public static class Game public class GameObject
- 25.
- 26. PUPPETRY DRIVER static voidReleaseCurrentSession() static void ReleaseAllSession()
- 27.
- 28. CONFIGURATION static void Set(Settingssetting, object value) public enum Settings { BaseUrl, Port, Timeout, SessionTimeoutMs, StartPlayModeSessionTimeoutMs, PollingStrategy }
- 29.
- 30.
- 31.
- 32. GAME void MakeScreenShot(string fullPath); voidMakeScreenShot(string fileName, string folderName) void DeletePlayerPref(string key); void DeleteAllPlayerPrefs(); float GetFloatPlayerPref(string key); string GetStringPlayerPref(string key); int GetIntPlayerPref(string key); void SaveFloatPlayerPref(string key, float value); void SaveStringPlayerPref(string key, string value); void SaveIntPlayerPref(string key, int value); bool PlayerPrefHasKey(string key); void ExecuteCustomMethod(string method, string value = null)
- 33.
- 34. FIND GAME OBJECT GameObjectFindByName(string root, string name);
- 35.
- 36. FIND GAME OBJECT GameObjectFindByName(string root, string name); GameObject FindByNameAndParent( string root, string name, string parent); GameObject FindByUpath(string upath);
- 37. UPath (Unity PathLanguage) “/RootElement /descendant::childName //name[active] [1]”
- 38. UPath – Typeof search - “/RootElement” – Beginning of Upath is root element - “//{name}” – child or grandchild - “/{name}” – direct child - “/..” – return to parent - “/parent::{name}” – parent - “/ancestor::{name}” – parent or grand parent - “/child::{name}” – child - “/descendant::{name}” – child or grand child - “/contains({partialName})” – partial name
- 39. UPath – Properties -[number] – index - [axis::{name}] – has relation according to the axis - [active] – is active in hierarchy right now - [!active] – is not active in hierarchy right now
- 40. SUPPORTED METHODS void Click(); voidSendKeys(string value); void DragTo(GameObject toGameObject); void DragTo(ScreenCoordinates toCoordinates); void Swipe(Direction direction); string GetComponent(string componentName); ScreenCoordinates GetCoordinates(); int Count(); GameObject FindRelative(string upath)
- 41. VERIFICATION bool Exist; bool IsActiveInHierarchy; boolIsRendering; bool IsOnScreen; bool IsHitByGraphicRaycast; bool IsHitByPhysicsRaycast;
- 42.
- 43.
- 44.
- 45.
- 46.
- 47.
- 48.
- 49. PAGE OBJECTSCREEN OBJECT publicclass LoginScreen { GameObject nameField = new GameObject(“Canvas”, “nameField”); GameObject passwordField = new GameObject(“Canvas”, “passwordField”); GameObject loginButton = new GameObject() .FindByUpath(“/Canvas//loginForm//loginButton); . . . }
- 50. public MainMenuScreen MakeSuccessLogin (stringname, string password) { nameField.SendKeys(name); passwordField.SendKeys(password); loginButton.Click(); return new MainMenuScreen(); } SCREEN OBJECT
- 51. ISOLATION OF TESTS publicstatic class Editor { public static void StartPlayMode() public static void StopPlayMode() } public static class Game { public static void DeleteAllPrefs() public static void DeletePref(string key) }
- 52. TEST [Test] public void Login_CorrectCredentials_Success() { //Arrange varname = "Yevhen"; var password = “TestingStage2019"; //Act var screen = new LoginScreen().MakeSuccessLogin(name, password); //Assert Assert.IsTrue(screen.IsPageOpened, $"Main Menu was not opened after login with {name} and {password}") }
- 53.
- 56.
- 57. HEADLESS MODE ComandLine argument:-batchmode Example: /Applications/Unity/Unity.app/Contents/MacOS/Unity -batchmode https://docs.unity3d.com/Manual/CommandLineArguments.html
- 58.
- 59.
- 60.
- 61.
- 62. PART 2: EYES Automationof Unity Games with Image Recognition Oleksii and Denys
- 63. О нас: ● MobileAQA in Moonactive ● Master degree of system analysis, data processing and analysing
- 64. О нас: ● MobileAQA in Moonactive ● 6 years as Mobile QA ● Winner of 3 Testons in IOS Nomination ● Lector in BeQA
- 65. ● Проблемы ● Решение ●Еще проблемы ● Текущее решение и то как это работает ● Куда стремимся План:
- 66.
- 68.
- 70. Unity Игры нельзяавтоматизировать классическим подходом
- 71.
- 72.
- 73. OpenCV (Open SourceComputer Vision Library) is released under a BSD license and hence it’s free for both academic and commercial use. It has C++, Python and Java interfaces and supports Windows, Linux, Mac OS, iOS and Android
- 74. И теперь добавилиинтерфейс для JS….
- 75.
- 79. cv.MatchTemplate(image, templ, result,method) Parameters: ● image – Image where the search is running. It must be 8-bit or 32-bit floating-point. ● templ – Searched template. It must be not greater than the source image and have the same data type. ● result – Map of comparison results. It must be single-channel 32-bit floating- point. If image is and templ is , then result is . ● method – Parameter specifying the comparison method (see below).
- 81. 1. Делаем скриншот 2.Вырезаем темплейт 3. В тесте ищем темплейт на скриншоте с заданной точностью
- 82. И вот всекруто и мы начинаем писать тесты
- 83.
- 84.
- 86.
- 87. 1. Делаем скриншоти ресайзим в дефолтный размер 2. Вырезаем нужный темплейт 3. В тесте Ищем нужный темплейт на скриншоте который ресайзим в дефолтный размер
- 88. *this code isnot used in real project
- 89.
- 90. UI зависит отпрофиля
- 91.
- 92.
- 93. *this code isnot used in real project
- 94.
- 95. Нет возможности получить состояниеприложения
- 96.
- 98.
- 99.
- 100.
- 101.
- 102.
- 103.
- 104.
- 105.
- 106. Куда двигаемся: 1. НейронныеСети для Лучшего распознавания 2. Понимание Состояния приложения
- 107. Appium release 27 Aug2018: Appium v1.9.0 added “-image” find element strategy Available methods: ● click ● isDisplayed ● getSize ● getLocation ● getLocationInView ● getElementRect
- 108. Links: 1. Open CV- https://opencv.org 2. AltUnityDriver - https://gitlab.com/altom/altunitytester 3. AsyncIO - https://docs.python.org/3/library/asyncio.html
- 109.
- 110. PART 3: BATTLE EYESOR HEART? WHOM TO BELIEVE? Yevhen vs Denys and Oleksii
- 111.
- 112. DRIVER 1. Start thegame 2. Open Menu 3. Click “2D” button 4. Check that it contains “Back” button
- 113. IMAGE RECOGNITION Steps: 1. Openscreen with fox 2. Check that screen is displayed 3. Tap on button with feed 4. Tap on back button * MacBook Pro 2.6 GHz Intel Core i7 16GB RAM
- 114.
- 115.
- 116. IMAGE RECOGNITION 1. Searchingall elements with predefined threshold 2. Searching multiply elements simultaneously 3. For “unstable” elements implemented “retry” functionality
- 117.
- 118. DRIVER GameObject nameField =new GameObject(“Canvas”, “nameField”); GameObject passwordField = new GameObject(“Canvas”, “passwordField”); GameObject loginButton = new GameObject() .FindByUpath(“/Canvas//loginForm//loginButton);
- 119. IMAGE RECOGNITION Taking screenshot Converting and resizing Moveto project directory Use as selector *this code is not used in real project
- 120.
- 121. DRIVER • Selenium likeframework • How to run up Puppetry • Unity specific staff (GameObject, Components, Unity Editor)
- 122. IMAGE RECOGNITION • Appiumknowledge base • Check the basic methods (search and tap on element) conception • Devices handling procedures - searching and set up emulators/simulators, real devices
- 123.
- 124. DRIVER • Up to30 minutes if use Puppetry or others • Months if you want to write own
- 125. IMAGE RECOGNITION • Upto 29 minutes • 2-3 Weeks if you want to write your own solution
- 126.
- 127. DRIVER • Declare newScreenObjects • Declare all GameObjects and their locators • Describe all methods in the ScreenObject • Write the test
- 128. IMAGE RECOGNITION Yup, Totallythe same
- 129.
- 130.
- 131. IMAGE RECOGNITION Detecting allneeded UI elements *this code is not used in real project
- 132.
- 133.
- 134. IMAGE RECOGNITION • Checkingany element (templates) with localization (same as in Round 7)
- 135.
- 136. DRIVER • Different platformsin Unity Editor • Mobile devices (iOS, Android) with Appium combination • Potentially other platforms like: Xbox, PlayStation, VR, Nintendo Switch - if you can create Socket connection from a device
- 137. IMAGE RECOGNITION • Mobileusing appium: iOS, Android • Almost the same for web with Selenium (with some modifications) • All other OS with available drivers
- 138.
- 139. DRIVER • You needto have Unity Editor to start • Appium and mobile devices / emulators to test on devices
- 140. IMAGE RECOGNITION • Appium •Emulators/Simulators (Android SDK, Xcode)
- 141.
- 142. DRIVER 1. Start PuppetryDriver 2.Start Unity editor 3. Start Test 4. Kill PuppetryDriver process 5. Kill Unity editor process
- 143. IMAGE RECOGNITION 1. Installvirtualenv (pipenv) 2. Start Test (appium driver starts devices automatically) 3. Kill devices
- 144.
- 145.
- 146.
- 147. DRIVER Tests Unity application Unity application Unityapplication Puppetry Driver
- 148.
- 149.
- 150.
- 151.
- 155.