S6 the guardian of line today automation test

•

7 likes•6,764 views

LINE Corporation

2016/12/26 LINE Taiwan TechPulse

Technology

The Guardian of LINE TODAY
Automation Test
Kent Han

• LINE TODAY
• Challenges
• CI and Automation Test
CI Pipeline
Unit Test
Functional Test
Service Monitoring
• Wrap Up
AGENDA

FastTrack RegularTrack
2016.03 - Fast Track as Proof Of Concept
2016.06 - Regular Track as long-term product
GLN - Global LINE News

GLN - Global LINE News
TW
18m
TH
36m
IR
3m
ID
32m
JP
58m

TW TH ID IR
(RTL)
GLN - Global LINE NewsGLN - Global LINE News

Fast Track - 02/26 (TW, TH, ID, US, MM)
Regular Track - 06/16 (TW, TH, ID) 10/04 (IR)
3/2 3/5 3/8 3/113/14 3/17 3/20 3/23 3/263/29 4/1 4/4 4/7 4/10 4/134/16 4/19 4/22 4/25 4/28 5/1 5/4 5/7 5/10 5/13 5/16 5/19 5/225/25 5/28 5/31 6/3 6/6 6/9 6/12 6/15 6/18 6/21 6/24 6/276/30 7/3 7/6 7/9 7/12 7/157/18 7/21 7/24 7/27 7/30 8/2 8/5 8/8 8/11 8/14 8/17 8/208/23 8/26 8/29 9/1 9/4 9/7 9/10
DUB
DPV
Fast
Track
Regular
Track

Challenges
Swiftly adjust to survive, or die

• Jenkins IFTTT LINE Notify
• https://ifttt.com/line
CI Notification

Testing Pyramid
https://watirmelon.blog/tag/
testing-pyramid/
Unit test vs. Integration test
• Speed
• Stable
• Easy to troubleshoot
Testing Pyramid

Pull Request must be checked by unit test
Unit Test

Static Code Analysis
• Checkstyle
• FindBugs
• PMD
• Duplicate Code

Testing Tools
• Python
• Robot Framework
• Selenium
• Appium
• Jenkins
• Gatling
Functional Test

Why Did We Adopt
Robot Framework?
• Human-readable test cases for
Maintainability
• Python and Java support for Versatility
• --rerunfailed for flaky tests
*** Test Cases ***
Add A Comment To An Article
[Tags] comment RAT
New An Article In Category
Add Comment To The Article 1 Times
Comment Count Of The Article Is 1
Reply A Comment To A Comment
[Tags] reply RAT
New An Article In Category
Add Comment To The Article 1 Times
Comment Count Of The Article Is 1
Reply To The Comment With Text Comment
Comment Should Be Included In Article
Vote Up To A Comment
[Tags] vote RAT
New An Article In Category
Add Comment To The Article 1 Times
Comment Count Of The Article Is 1
Vote The Comment With UP

Feeding Test
• Average 5,500 articles
imported a day
• Should ensure the input
stream
• Fake articles for testing
Thumbnail
Image
Video
Youtube
<?xml version='1.0' encoding='UTF-8'?>
<articles>
<UUID>c11ae751-b180-11e6-96c0-985aeb8c0520</UUID>
<time>1461117682767</time>
<article>
<ID>c11b1973-b180-11e6-8d03-985aeb8c0520</ID>
<nativeCountry>TW</nativeCountry>
<language>zh</language>
<startYmdtUnix>1479907723508</startYmdtUnix>
<endYmdtUnix>1571117682767</endYmdtUnix>
<title>20161123212843_all_medias</title>
<category> </category>
<publishTimeUnix>1479907723508</publishTimeUnix>
<contents>
<image>
<description>Mountain is beautiful!</description>
<url>yama_1.png</url>
</image>
<video>
<description>Kobe Top 1</description>
<thumbnail>thumbnail_1.jpg</thumbnail>
<url>kobe_1.mp4</url>
</video>
<video>
<description>Youtube</description>
<url>https://www.youtube.com/embed/c7rCyll5AeY</url>
</video>
<text>
<content> Google Google
Alphabet
Larry Page Alphabet Google Sundar Pichi
Google Larry Page
Google ......
Alphabet
</content>
</text>
</contents>
</article>
</articles>

CMS Test
• OA Digest
• Timeline Digest
• Category publication
• When new features are added,
basic functions should not fail

Front-end Test
• Selenium covers the most
• Appium for the mobile-only feature
• API test as a tool to generate testing
data

• Internal tools
iMON - application error
NSight - system error
• Health check script
Web response time
RabbitMQ management api
ElasticSearch cluster/node/stats/
status api
Service Monitoring

0
100
200
300
400
v2.1 v2.2 v2.3 v3.0 v3.1 v3.2 v3.3
major bugs total bugs
Bug Stats

Wrap Up
Quality is everyone’s KPI
Find a pain point in retrospective then improve in next sprint

Similar to S6 the guardian of line today automation test

6-Sigma Training-Awareness for automobile industries

VivekSingh140912

Supply chain design and operation

AngelainBay

Has your organization moved to agile but your metrics have not? Do you spend multiple hours each week generating separate sets of metrics for your agile squad, management, and C-level executives? Do you find yourself questioning the things you measure and actions you take as a result of those measurements? Prachi Maini introduces you to a set of lean but comprehensive metrics that show the efficiency and effectiveness of the squads, the primary activities of the squad, and that of the overall project. Learn the key evaluators for measuring quality of code, quality of quality assurance (testing), project progress, automation ROI, and team sentiments. Take back an agile dashboard that can easily be generated to provide measurable data to both squad members and key executives, to help quantify risk and process improvements, and to allow for more effective and efficient project planning, forecasting, and estimating.

An Agile Testing Dashboard: Metrics that Matter

TechWell

Qa management in big agile teams

Vladimir Primakov (Volodymyr Prymakov)

ThoughtWorks Continuous Delivery

Kyle Hodgson

Value add: Single User Performance Testing (http://managingperformancetesting...

akbollinger

Advanced problems solving using A3 Report - January 2017

W3 Group Canada Inc.

Scrum and Lean : Multiply the Powers by Om Band

agilencr

Test Metrics in Agile - powerful tool to support changes - Zavertailo Iuliia

Yulia Zavertailo

Company profile 2018

福佑電機 FULLTECH

In the past several years the software development lifecycle has changed significantly with high-speed software releases, shared application services, and platform virtualization. The traditional performance assurance approach of pre-release testing does not address these innovations. To maintain confidence in acceptable performance in production, pre-release testing must be augmented with in-production performance monitoring. Obbie Pet describes three types of monitors—performance, resource, and VM platform—and three critical metrics fundamental to isolating performance problems—response time, transaction rate, and error rate. Obbie reviews techniques to acquire and interpret these metrics, and describes how to develop a continuous performance monitoring process. In conjunction with pre-release testing, this monitoring can be woven into a single integrated process, offering a best bet in assuring performance in today’s development world. Take away this integrated process for consideration in your own shop.

Continuous Performance Testing: The New Standard

TechWell

Test Metrics

Devukjs

UTC Aerospace System - Value Stream Mapping

Lean6Sigma4all

Vladimir Primakov - Qa management in big agile teams

Ievgenii Katsan

Continuous Delivery is a solved problem. Really? A lot of organisations still struggle for many reasons and Confluence was one of them. What if the world your engineering team lives in is not perfect. This talk is all about making continues deployment happen in a real and not so perfect engineering organisation. This talk is all about the options you have a to achieve a goal without trying to solve all the problems at once. The talk will start with setting the scene of Confluence’s build and deployment process. There will be some interesting insights in the sheer size of builds, tests and the complexities we have around deployments. Once the stage is set for Confluence’s environment, the next step is to explore the problems that are preventing the team to move faster both culturally and technically. To name a few: Build structure, build times, flakey tests, lack of automation, wrong culture, dealing with release blockers, test automation, post-deployment verification, monitoring and operating a production system. With the problems defined, we will go into them in more detail and also learn about the ways the Confluence team resolved them. To wrap it all up we go through the current situation and explain how far we have come with the strategies taken and implemented by the team. As a bonus, a sneak peak of the road ahead for Confluence's Continuous Deployment and Site Reliability Engineering will be shared with the audience.

Dev opstalks 2018 releasing the monolith on a daily basis

Vincent Kok

From Waterfall to Weekly Releases: A Case Study in using Evo and Kanban (2004...

Tathagat Varma

Lewis Chu,Marketing Director,GUC

chiportal

Find out how Kanban is accelerating product design and development at Jaguar Land Rover. Watch the recorded webinar here: https://vimeo.com/172780037 Hamish McMinn, Automotive and IT Project Manager, will explain how Kanban is improving time, cost and quality across new vehicle development projects at Jaguar Land Rover. You'll learn: -Why new product development provides rich opportunities for continuous process improvement. -Benefits and challenges of transferring agile software techniques to hardware design and development. -How to visualize work, focus on flow and increase cross-functional collaboration using LeanKit. Hamish will share learnings from the initial pilot project, and how Kanban is now being scaled across multiple engineering teams.

Driving Innovation with Kanban at Jaguar Land Rover

LeanKit

Baskaren Accomplishments Summary

guest524810

聊聊測試左移

Jersey (CHE-PING) Su

Similar to S6 the guardian of line today automation test (20)

6-Sigma Training-Awareness for automobile industries

Supply chain design and operation

An Agile Testing Dashboard: Metrics that Matter

Qa management in big agile teams

ThoughtWorks Continuous Delivery

Value add: Single User Performance Testing (http://managingperformancetesting...

Advanced problems solving using A3 Report - January 2017

Scrum and Lean : Multiply the Powers by Om Band

Test Metrics in Agile - powerful tool to support changes - Zavertailo Iuliia

Company profile 2018

Continuous Performance Testing: The New Standard

Test Metrics

UTC Aerospace System - Value Stream Mapping

Vladimir Primakov - Qa management in big agile teams

Dev opstalks 2018 releasing the monolith on a daily basis

From Waterfall to Weekly Releases: A Case Study in using Evo and Kanban (2004...

Lewis Chu,Marketing Director,GUC

Driving Innovation with Kanban at Jaguar Land Rover

Baskaren Accomplishments Summary

聊聊測試左移

Recently uploaded

Architecting Cloud Native Applications

WSO2

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

apidays

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

DBX First Quarter 2024 Investor Presentation

Dropbox

Tracing the root cause of a performance issue requires a lot of patience, experience, and focus. It’s so hard that we sometimes attempt to guess by trying out tentative fixes, but that usually results in frustration, messy code, and a considerable waste of time and money. This talk explains how to correctly zoom in on a performance bottleneck using three levels of profiling: distributed tracing, metrics, and method profiling. After we learn to read the JVM profiler output as a flame graph, we explore a series of bottlenecks typical for backend systems, like connection/thread pool starvation, invisible aspects, blocking code, hot CPU methods, lock contention, and Virtual Thread pinning, and we learn to trace them even if they occur in library code you are not familiar with. Attend this talk and prepare for the performance issues that will eventually hit any successful system. About authorWith two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Victor Rentea

ICT role in 21st century education and its challenges

rafiqahmad00786416

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

Angeliki Cooney has spent over twenty years at the forefront of the life sciences industry, working out of Wynantskill, NY. She is highly regarded for her dedication to advancing the development and accessibility of innovative treatments for chronic diseases, rare disorders, and cancer. Her professional journey has centered on strategic consulting for biopharmaceutical companies, facilitating digital transformation, enhancing omnichannel engagement, and refining strategic commercial practices. Angeliki's innovative contributions include pioneering several software-as-a-service (SaaS) products for the life sciences sector, earning her three patents. As the Senior Vice President of Life Sciences at Avenga, Angeliki orchestrated the firm's strategic entry into the U.S. market. Avenga, a renowned digital engineering and consulting firm, partners with significant entities in the pharmaceutical and biotechnology fields. Her leadership was instrumental in expanding Avenga's client base and establishing its presence in the competitive U.S. market.

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Angeliki Cooney

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions. About the author With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Victor Rentea

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Passkeys: Developing APIs to enable passwordless authentication Cody Salas, Sr Developer Advocate | Solutions Architect - Yubico Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

apidays

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Recently uploaded (20)

Architecting Cloud Native Applications

MS Copilot expands with MS Graph connectors

Artificial Intelligence Chap.5 : Uncertainty

Why Teams call analytics are critical to your entire business

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

How to Troubleshoot Apps for the Modern Connected Worker

DBX First Quarter 2024 Investor Presentation

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

ICT role in 21st century education and its challenges

FWD Group - Insurer Innovation Award 2024

AWS Community Day CPH - Three problems of Terraform

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

presentation ICT roal in 21st century education

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

S6 the guardian of line today automation test

1. The Guardian of LINE TODAY Automation Test Kent Han

2. • LINE TODAY • Challenges • CI and Automation Test CI Pipeline Unit Test Functional Test Service Monitoring • Wrap Up AGENDA

3. LINE TODAY

4. FastTrack RegularTrack 2016.03 - Fast Track as Proof Of Concept 2016.06 - Regular Track as long-term product GLN - Global LINE News

5. GLN - Global LINE News TW 18m TH 36m IR 3m ID 32m JP 58m

6. TW TH ID IR (RTL) GLN - Global LINE NewsGLN - Global LINE News

7. Fast Track - 02/26 (TW, TH, ID, US, MM) Regular Track - 06/16 (TW, TH, ID) 10/04 (IR) 3/2 3/5 3/8 3/113/14 3/17 3/20 3/23 3/263/29 4/1 4/4 4/7 4/10 4/134/16 4/19 4/22 4/25 4/28 5/1 5/4 5/7 5/10 5/13 5/16 5/19 5/225/25 5/28 5/31 6/3 6/6 6/9 6/12 6/15 6/18 6/21 6/24 6/276/30 7/3 7/6 7/9 7/12 7/157/18 7/21 7/24 7/27 7/30 8/2 8/5 8/8 8/11 8/14 8/17 8/208/23 8/26 8/29 9/1 9/4 9/7 9/10 DUB DPV Fast Track Regular Track

8. Challenges Swiftly adjust to survive, or die

9. Feature requests are diverse

10. Agile is the Only Solution

11. How Fast is Your Agile

12. CI + Automation Test

13. Jenkins 2.0 CI Pipeline by Jenkinsews

14. • Jenkins IFTTT LINE Notify • https://ifttt.com/line CI Notification

15. Testing Pyramid https://watirmelon.blog/tag/ testing-pyramid/ Unit test vs. Integration test • Speed • Stable • Easy to troubleshoot Testing Pyramid

16. Pull Request must be checked by unit test Unit Test

17. Static Code Analysis • Checkstyle • FindBugs • PMD • Duplicate Code

18. Testing Tools • Python • Robot Framework • Selenium • Appium • Jenkins • Gatling Functional Test

19. Why Did We Adopt Robot Framework? • Human-readable test cases for Maintainability • Python and Java support for Versatility • --rerunfailed for flaky tests *** Test Cases *** Add A Comment To An Article [Tags] comment RAT New An Article In Category Add Comment To The Article 1 Times Comment Count Of The Article Is 1 Reply A Comment To A Comment [Tags] reply RAT New An Article In Category Add Comment To The Article 1 Times Comment Count Of The Article Is 1 Reply To The Comment With Text Comment Comment Should Be Included In Article Vote Up To A Comment [Tags] vote RAT New An Article In Category Add Comment To The Article 1 Times Comment Count Of The Article Is 1 Vote The Comment With UP

20. Robot Framework Report

21. Content Working Flow

22. Feeding Test • Average 5,500 articles imported a day • Should ensure the input stream • Fake articles for testing Thumbnail Image Video Youtube <?xml version='1.0' encoding='UTF-8'?> <articles> <UUID>c11ae751-b180-11e6-96c0-985aeb8c0520</UUID> <time>1461117682767</time> <article> <ID>c11b1973-b180-11e6-8d03-985aeb8c0520</ID> <nativeCountry>TW</nativeCountry> <language>zh</language> <startYmdtUnix>1479907723508</startYmdtUnix> <endYmdtUnix>1571117682767</endYmdtUnix> <title>20161123212843_all_medias</title> <category> </category> <publishTimeUnix>1479907723508</publishTimeUnix> <contents> <image> <description>Mountain is beautiful!</description> <url>yama_1.png</url> </image> <video> <description>Kobe Top 1</description> <thumbnail>thumbnail_1.jpg</thumbnail> <url>kobe_1.mp4</url> </video> <video> <description>Youtube</description> <url>https://www.youtube.com/embed/c7rCyll5AeY</url> </video> <text> <content> Google Google Alphabet Larry Page Alphabet Google Sundar Pichi Google Larry Page Google ...... Alphabet </content> </text> </contents> </article> </articles>

23. CMS Test • OA Digest • Timeline Digest • Category publication • When new features are added, basic functions should not fail

24. Front-end Test • Selenium covers the most • Appium for the mobile-only feature • API test as a tool to generate testing data

25. • Internal tools iMON - application error NSight - system error • Health check script Web response time RabbitMQ management api ElasticSearch cluster/node/stats/ status api Service Monitoring

26. 0 100 200 300 400 v2.1 v2.2 v2.3 v3.0 v3.1 v3.2 v3.3 major bugs total bugs Bug Stats

27. Wrap Up Quality is everyone’s KPI Find a pain point in retrospective then improve in next sprint

28. THANK YOU

S6 the guardian of line today automation test

Recommended

Recommended

More Related Content

Similar to S6 the guardian of line today automation test

Similar to S6 the guardian of line today automation test (20)

More from LINE Corporation

More from LINE Corporation (20)

Recently uploaded

Recently uploaded (20)

S6 the guardian of line today automation test