Considering how popular APIs are these days, it’s frustrating to run into a service or site without one. But, it’s actually quite common. If you need to collect data or perform an action on the web without access to an API, there are a couple ways you can hack it using OutSystems.
Creating web pages that work perfectly regardless of external variables (e.g., latency) is equal parts technical know-how and art-form. In this “hands-on” session, we will take a look at how OutSystems can help you build responsively smooth, and beautiful web pages that work as good as they look.
"The recently-released OutSystems' Data Grid component provides a rich way of displaying tabular data, with more functionality and flexibility than a standard Table Records widget.
In this session, you'll see the Data Grid component in action, and learn how to use it for a variety of common scenarios."
Measure Customer Experience of Your OutSystems Web and Mobile ApplicationsOutSystems
Want to measure customer experience of your OutSystems web and mobile applications? It’s easy. Just add 3rd party instrumentation from New Relic or Dynatrace to your OutSystems application to begin to visualize the customer experience of your applications in real-time. It’s a snap to get started using brand new Forge components; start optimizing customer experience in minutes!
When setting up a new project we have some tips and tricks to help you do this in the best way possible, incl. infrastructure, database, standard attributes, logging, code alignment, and service center.
Speed up Development by Turning Web Blocks Into First-Class CitizensOutSystems
"What if:
- You could have a 2-way sync between a (structure) variable and a we block (e.g. input widgets)
- There was a valid runtime property for web blocks (e.g. built-in widgets)
- Web block behaved LIKE built-in widgets?
In this talk, we will present an approach, and a couple of tools, that help promote web blocks to first class citizens. It has helped us speed up development and improve maintainability. Maybe it will also be helpful to you."
Sometimes we want our UI to respond to external events. With the power of Google's Firebase, we can interact with those events in OutSystems to build extremely powerful and interactive applications
How to Be More Productive With AI Development AssistanceOutSystems
AI is transforming seemingly all kinds of human activities, and software development is the next frontier. OutSystems is leading this transformation, focused on augmenting developers with built-in, intelligent assistance that makes you more productive and doing less grunt work. Learn how in this session!
The recently-released OutSystems' Data Grid component provides a rich way of displaying tabular data, with more functionality and flexibility than a standard Table Records widget. In this session, you'll see the Data Grid component in action, and learn how to use it for a variety of common scenarios.
Creating web pages that work perfectly regardless of external variables (e.g., latency) is equal parts technical know-how and art-form. In this “hands-on” session, we will take a look at how OutSystems can help you build responsively smooth, and beautiful web pages that work as good as they look.
"The recently-released OutSystems' Data Grid component provides a rich way of displaying tabular data, with more functionality and flexibility than a standard Table Records widget.
In this session, you'll see the Data Grid component in action, and learn how to use it for a variety of common scenarios."
Measure Customer Experience of Your OutSystems Web and Mobile ApplicationsOutSystems
Want to measure customer experience of your OutSystems web and mobile applications? It’s easy. Just add 3rd party instrumentation from New Relic or Dynatrace to your OutSystems application to begin to visualize the customer experience of your applications in real-time. It’s a snap to get started using brand new Forge components; start optimizing customer experience in minutes!
When setting up a new project we have some tips and tricks to help you do this in the best way possible, incl. infrastructure, database, standard attributes, logging, code alignment, and service center.
Speed up Development by Turning Web Blocks Into First-Class CitizensOutSystems
"What if:
- You could have a 2-way sync between a (structure) variable and a we block (e.g. input widgets)
- There was a valid runtime property for web blocks (e.g. built-in widgets)
- Web block behaved LIKE built-in widgets?
In this talk, we will present an approach, and a couple of tools, that help promote web blocks to first class citizens. It has helped us speed up development and improve maintainability. Maybe it will also be helpful to you."
Sometimes we want our UI to respond to external events. With the power of Google's Firebase, we can interact with those events in OutSystems to build extremely powerful and interactive applications
How to Be More Productive With AI Development AssistanceOutSystems
AI is transforming seemingly all kinds of human activities, and software development is the next frontier. OutSystems is leading this transformation, focused on augmenting developers with built-in, intelligent assistance that makes you more productive and doing less grunt work. Learn how in this session!
The recently-released OutSystems' Data Grid component provides a rich way of displaying tabular data, with more functionality and flexibility than a standard Table Records widget. In this session, you'll see the Data Grid component in action, and learn how to use it for a variety of common scenarios.
Rencore Webinar: SharePoint Customizations - the most overlooked road block t...Rencore
Erwin van Hunen, Product Owner of SPTransformator, Microsoft MCM and MVP, introduces you to some things to keep an eye on that will help you in preventing your SharePoint migration projects from stalling.
What you will learn:
Meet the single most overlooked and potentially crucial factor for your migration project: SharePoint Customizations.
- Find out, why and how to assess your SharePoint
- Customizations in terms of migratability
- and much more…
Slides by Anton Hristov, Product Manager of mabl.
Watch the accompanying webinar: https://www.mabl.com/blog/end-to-end-automation-at-scale
Testing end-to-end user scenarios is challenging, yet more important than ever due to increased complexity, variety and importance of user interfaces. Delivering a quality user experience requires taking a holistic view of the end-to-end user journey, which can span across applications, browsers, devices and different modes of interaction such as touch and voice.
In this webinar, we will explore different ways mabl can help you create intelligent end-to-end tests that focus on the user journey and run at scale across browsers. No scripting necessary.
Learning outcomes:
Why we need to shift from quality assurance to quality intelligence
How to create intelligent tests quickly to increase coverage
What diagnostics information is available for root-cause analysis
When and how to reuse a set of steps across multiple tests
When and how to apply data-driven (parameterized) testing approach
In the general view, Scrum is the best Agile method for building a product and developing projects. However, when we have projects that include production support, we should be advised to combine with Kanban. This provides some ideas about Scrumban.
On the one hand, it has the Agile of Scrum, on the other hand it encourages teams to continuously improve their processes along with Kanban.
Scrumban is a solution favored by the service industry, and a great project management tool for teams that deal with product development and its maintenance together.
In this Scrum Breakfast, we would like to share our real life of Scrumban team that we applied to work with our customers.
Topic: The real life of Scrumban team
Speaker: Ms. Anh Thu – Scrum Master at Axon Active Vietnam
Time: Saturday – 25th Feb, 2016 | 9:00 AM – 11:00AM
Venue: Trung Nguyên Cafe, 264A Nam Kỳ Khởi Nghĩa, Ho Chi Minh
#scrum #scrumbreakfast #agile #scrumban #AxonActiveVietnam
mabl's Machine Learning Implementation on Google Cloud PlatformJoseph Lust
mabl software engineer Joe Lust presents the mabl cloud architecture at the Cambridge Cloud Exchange: Machine Learning meetup at Google Cambridge. The talk takes an in-depth look at mabl’s machine learning and specifically how mabl uses numerous Google Cloud systems for its intelligent auto-healing tests and visual change detection.
Using React you can easily build web applications with rich UI. New to React? No worries! In this session you will learn what React is, why you would use it and how you could leverage React for building solutions for Office 365 and SharePoint.
It seems easy to repeat what we have already known and done? But think about what you are missing out. Are you getting stuck in a rut doing repeated processes days after days.
Whether you are a newbie or an Agile/Scrum expert, this September Scrum Breakfast could help you find a creative way to refresh yourself and your Agile/Scrum practices.
How can we avoid misunderstanding, save time and meet business requirements from customers? How can we apply smoothly in the working process? Let's get the right thing at the beginning!
In this session we will cover a range of topics regarding Chat automation and the possibilities this gives us. We will dive into the concept of ChatOps, what it is, how we can implement it and what the benefits are. After this brief introduction we will dive into real-world examples of setting up and configuring your first chatbot, configuring security and resolving real-world incidents using this chatbot. By the end of the session we will used different platforms and bots in order to set the first steps of implementing a valid chat infrastructure.
Alexandr Vronskiy "Evolution of Ecommerce Application"Fwdays
История одного кастомного маркетплейса и его эволюция с нуля
До энтерпрайз решения
Как правильно готовить монолитную архитектуру и почему не стоит использовать микросервисы везде и всегда
Как можно балансировать между требованием бизнеса и техническим долгом
Rencore Webinar: SharePoint Customizations - the most overlooked road block t...Rencore
Erwin van Hunen, Product Owner of SPTransformator, Microsoft MCM and MVP, introduces you to some things to keep an eye on that will help you in preventing your SharePoint migration projects from stalling.
What you will learn:
Meet the single most overlooked and potentially crucial factor for your migration project: SharePoint Customizations.
- Find out, why and how to assess your SharePoint
- Customizations in terms of migratability
- and much more…
Slides by Anton Hristov, Product Manager of mabl.
Watch the accompanying webinar: https://www.mabl.com/blog/end-to-end-automation-at-scale
Testing end-to-end user scenarios is challenging, yet more important than ever due to increased complexity, variety and importance of user interfaces. Delivering a quality user experience requires taking a holistic view of the end-to-end user journey, which can span across applications, browsers, devices and different modes of interaction such as touch and voice.
In this webinar, we will explore different ways mabl can help you create intelligent end-to-end tests that focus on the user journey and run at scale across browsers. No scripting necessary.
Learning outcomes:
Why we need to shift from quality assurance to quality intelligence
How to create intelligent tests quickly to increase coverage
What diagnostics information is available for root-cause analysis
When and how to reuse a set of steps across multiple tests
When and how to apply data-driven (parameterized) testing approach
In the general view, Scrum is the best Agile method for building a product and developing projects. However, when we have projects that include production support, we should be advised to combine with Kanban. This provides some ideas about Scrumban.
On the one hand, it has the Agile of Scrum, on the other hand it encourages teams to continuously improve their processes along with Kanban.
Scrumban is a solution favored by the service industry, and a great project management tool for teams that deal with product development and its maintenance together.
In this Scrum Breakfast, we would like to share our real life of Scrumban team that we applied to work with our customers.
Topic: The real life of Scrumban team
Speaker: Ms. Anh Thu – Scrum Master at Axon Active Vietnam
Time: Saturday – 25th Feb, 2016 | 9:00 AM – 11:00AM
Venue: Trung Nguyên Cafe, 264A Nam Kỳ Khởi Nghĩa, Ho Chi Minh
#scrum #scrumbreakfast #agile #scrumban #AxonActiveVietnam
mabl's Machine Learning Implementation on Google Cloud PlatformJoseph Lust
mabl software engineer Joe Lust presents the mabl cloud architecture at the Cambridge Cloud Exchange: Machine Learning meetup at Google Cambridge. The talk takes an in-depth look at mabl’s machine learning and specifically how mabl uses numerous Google Cloud systems for its intelligent auto-healing tests and visual change detection.
Using React you can easily build web applications with rich UI. New to React? No worries! In this session you will learn what React is, why you would use it and how you could leverage React for building solutions for Office 365 and SharePoint.
It seems easy to repeat what we have already known and done? But think about what you are missing out. Are you getting stuck in a rut doing repeated processes days after days.
Whether you are a newbie or an Agile/Scrum expert, this September Scrum Breakfast could help you find a creative way to refresh yourself and your Agile/Scrum practices.
How can we avoid misunderstanding, save time and meet business requirements from customers? How can we apply smoothly in the working process? Let's get the right thing at the beginning!
In this session we will cover a range of topics regarding Chat automation and the possibilities this gives us. We will dive into the concept of ChatOps, what it is, how we can implement it and what the benefits are. After this brief introduction we will dive into real-world examples of setting up and configuring your first chatbot, configuring security and resolving real-world incidents using this chatbot. By the end of the session we will used different platforms and bots in order to set the first steps of implementing a valid chat infrastructure.
Alexandr Vronskiy "Evolution of Ecommerce Application"Fwdays
История одного кастомного маркетплейса и его эволюция с нуля
До энтерпрайз решения
Как правильно готовить монолитную архитектуру и почему не стоит использовать микросервисы везде и всегда
Как можно балансировать между требованием бизнеса и техническим долгом
Reports, reports, reports! People always want more reports. This session will show you how you can create amazing reports in OutSystems from Simple Report (free) to External Tools (integrating with paid tools).Covering since HTML2PDF&ReportSystems, SimpleReports and StimulSoftJS.
vue-storefront - PWA eCommerce for Magento2 MM17NYC presentationDivante
Vue.js, mobile first, offline second eCommerce frontend, we're developing under MIT - http://vuestorefront.io. Become a contributor today - https://github.com/DivanteLtd/vue-storefront
Techniques for building robust machine learning systemsStephen Whitworth
A talk I gave at PyData London on production machine learning systems. It focused on how to ensure they are well tested, robust, upgradeable, and a pleasure to work with.
Get to know more about "WH" questions on RPA, the benefits of RPA, Why we need to choose UiPath for RPA, and also developing small use cases using UI Path studio.
Introduction to web analytics and the Google analytics platform pdfMartin Bloomfield
An introduction to Google Analytics - tracking and understanding user behaviour on your website.
Sussex guru Julian Erbsloeh - Head of Insight at Fresh Egg, explains in a little detail to the members of Worthing and Adur Chamber of Commerce at Northbrook College, Worthing.
For a PDF version of the presentation please click the link here https://goo.gl/CV6CLD
See and hear Julian on the YouTube Video version of this presentation: https://youtu.be/WdH1NBnnooU
Single Source of Truth for Network AutomationAndy Davidson
The importance of building a single source of truth for information within your organisation, when you embark upon a network automation project. Simply automating router configuration steps is not "network automation".
How to Monitor Your Java & .NET Applications with eG EnterpriseeG Innovations
Troubleshooting application problems is never easy. There’s always a blame game going on between App Dev, IT Ops and DevOps teams to decide where an application problem originated and who owns it. There could be a code-level issue in the application, a long-running query can slow application processing, slow third-party calls are another common problem in the application framework.
In the latest update of our IT monitoring solution, eG Enterprise version 6.3, we’ve introduced new application performance monitoring (APM) capabilities to deliver code-level and query-level visibility for Java and .NET environments. Join this session and learn how the new capabilities will help you extend performance monitoring to solve more complex IT problems.
Key topics to be covered in the webinar:
Real User Monitoring: Track user experience issues in real time
Business Transaction Tracing: Analyze application transactions and identify code-level issues
Converged App & Infra Monitoring: Get correlated insight to pinpoint the root cause of problems: Network? Database? Virtualization? App code?
Measure Customer Experience of Your OutSystems Web and Mobile ApplicationsOutSystems
Want to measure customer experience of your OutSystems web and mobile applications? It’s easy. Just add 3rd party instrumentation from New Relic or Dynatrace to your OutSystems application to begin to visualize the customer experience of your applications in real-time. It’s a snap to get started using brand new Forge components; start optimizing customer experience in minutes!
Web scraping tools are software developed specifically to simplify the process of extracting data from websites. Data mining is a rather useful and commonly used process, but it can also easily turn into a complicated and messy activity and take a lot of time and effort.
H2o.ai presentation at 2nd Virtual Pydata Piraeus meetupPyData Piraeus
AI and Machine Learning have become must-haves for almost all industries and companies. H2O.ai's goal is to help companies all over the world to use Machine Learning.
H2O.ai's opensource toolset, which includes packages R, Python and Spark, starts from offering products which can accelerate the data preparation, then help with ML model building and finally make the deployment easier and platform agnostic!
A software which mimics human execution of applications, usually for repetitive processes. It
is controlled by business users (user-friendly configuration), and governed by IT.
Robotic Process Automation
● Abstract
● Introduction
● Why Robotic Process Automation
● Processes Assessment
● Return on Investment (ROI)
● Automation Potential
● Type Of automation
● Assisted/Unattended
● RPA tool Overview
Innovating at the Speed of Business in the High-Bandwidth World of Digital MediaOutSystems
At NOS, the term “IT Driven” refers to IT activities as adding value to the business. That drove the use of low-code to speed up the delivery of critical projects their business needed. Hear how this leading telecommunications company grew through its relationship with OutSystems and evolved its processes into a bimodal IT approach to implement continuous delivery and provide app delivery roadmaps that benefits its customers and users.
Beyond “Location”: Informing Real-Estate Decisions Through Innovative TechnologyOutSystems
Beyond “Location”: Informing Real-Estate Decisions Through Innovative Technology
Colliers International is on a mission to empower its customers with innovative technology to help them make informed decisions. In this session, see how the company addressed modernization challenges, rewrote a mission-critical application, replaced much of its legacy technology, and produced more applications in the last two years than it had in the last decade.
Beyond Digital Transformation: A Mandate for Disruptive Innovation in the Age...OutSystems
Before a customer ever sees your product, there are hundreds of processes, tools, decisions, and people that impact its delivery. Learn more about how the CVS Health business, swift, implemented the transformative power of low-code to create a wave of disruptive innovation that has impacted every aspect of its business and has the potential to redefine its industry.
From Core Systems to Mobile Apps: Digital Transformation from the Inside-OutOutSystems
When Chilean telecom leader, Entel, launched its digital transformation project, it followed the guidance of experts: Start with your core and work outwards. With its core modernized, the company released a new mobile app in less than a year. Hear how the company’s focus on core systems first, allowed it to layer on innovative new services helping it become not just a leader in Chile, but a challenger in the Peruvian market as well.
Orchestrating the Art of the Impossible Using Low-Code to Automate Manual Wor...OutSystems
Task and process automation is often praised as the holy grail of cutting costs and maximizing profitability. But what about less tangible activities such as compliance and auditing? Join Standard Insurance Company and hear how OutSystems helped them automate and minimize manual work steps resulting in across-the-board efficiencies that saved time and money.
Fast and Furious: Modernizing Clinical ApplicationOutSystems
Twice, Mednax has attempted to modernize its legacy clinical app. After the most recent 6-year project was canceled prior to deployment, Mednax turned to OutSystems. In just five months, the company rolled out an MVP and in eight months the new Clinical Application went live. Hear this amazing success story that is helping to reduce the burden on providers and deliver better patient care where it matters most.
Enrich Visually Google Map Information With LayersOutSystems
In this lightning session, we will explain that maps should not be boring! With our KML for Google Maps component, we have enriched them visually and with real-time business information to provide maps for users to love.
Using Processes and Timers for Long-Running Asynchronous TasksOutSystems
What do you do when a task can take more than five minutes and then times out? How do you run it asynchronously and present the status to the user? Come and see how processes and timers can be used together.
"With OutSystems, we can publish our application with the click of a single button. How awesome would it be if we could create an entire OutSystems infrastructure with just one click?
This is possible! In this session, we will tell you all the secrets about unattended installation and/or upgrading the OutSystems platform."
Many OutSystems projects begin simply. The requirements are not complex and therefore, neither is the architecture. But, as implementations grow, so grows the complexity and functionality needs of the enterprise. In this session, we will explore the 4-Layer Architecture and show you what we encountered, and learned, moving from a simple architecture to a 4-Layer one.
Excited about the new reactive web features? Come to this session to learn some of the best practices to make sure that you get started on the right foot.
After five years, "Company X's" HR application was not performing very well due to legacy issues. Simply loading the Dashboard could take up to 10 minutes. We will share some tricks we used to make sure the Dashboard could be properly used again.
Link Users to Your Specific Page in a Mobile App With DeeplinksOutSystems
This session will show you how to use weblinks that directly open your OutSystems mobile app on that one specific page or otherwise redirect towards the correct app store depending on the device. This helps you or your users to promote your app or a specific profile page. Mobile deeplinks are explained and taken to the next level.
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteGoogle
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-pilot-review/
AI Pilot Review: Key Features
✅Deploy AI expert bots in Any Niche With Just A Click
✅With one keyword, generate complete funnels, websites, landing pages, and more.
✅More than 85 AI features are included in the AI pilot.
✅No setup or configuration; use your voice (like Siri) to do whatever you want.
✅You Can Use AI Pilot To Create your version of AI Pilot And Charge People For It…
✅ZERO Manual Work With AI Pilot. Never write, Design, Or Code Again.
✅ZERO Limits On Features Or Usages
✅Use Our AI-powered Traffic To Get Hundreds Of Customers
✅No Complicated Setup: Get Up And Running In 2 Minutes
✅99.99% Up-Time Guaranteed
✅30 Days Money-Back Guarantee
✅ZERO Upfront Cost
See My Other Reviews Article:
(1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...informapgpstrackings
Keep tabs on your field staff effortlessly with Informap Technology Centre LLC. Real-time tracking, task assignment, and smart features for efficient management. Request a live demo today!
For more details, visit us : https://informapuae.com/field-staff-tracking/
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfJay Das
With the advent of artificial intelligence or AI tools, project management processes are undergoing a transformative shift. By using tools like ChatGPT, and Bard organizations can empower their leaders and managers to plan, execute, and monitor projects more effectively.
Globus Connect Server Deep Dive - GlobusWorld 2024Globus
We explore the Globus Connect Server (GCS) architecture and experiment with advanced configuration options and use cases. This content is targeted at system administrators who are familiar with GCS and currently operate—or are planning to operate—broader deployments at their institution.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxrickgrimesss22
Discover the essential features to incorporate in your Winzo clone app to boost business growth, enhance user engagement, and drive revenue. Learn how to create a compelling gaming experience that stands out in the competitive market.
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
No API? No Problem! Let the Robot Do Your Work! Web Scraping and Automation With Outsystems
1. | Web Scraping and Automation With Outsystems
No API? No Problem! Let
the Robot Do Your Work!
Web Scraping and Automation With Outsystems
2. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
Miguel
Antunes
OutSystems MVP - Tech Lead | Do iT Lean
@
in
miguel.antunes@doitlean.com
/antunes-miguel
3. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
we ♥ APIs,
but… we don’t always have them
4. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
Pulling data straight out
of HTML – otherwise
known as web scraping.
5. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
Any content that can be
viewed on a webpage
can be scraped.
6. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
but… Why You Should
Scrape?
8. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
No Rate-Limiting
9. | Web Scraping and Automation With Outsystems
Anonymous Access
10. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
The Data’s Already in
Your Face
11. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
Let’s Get to Scraping
12. | Web Scraping and Automation With Outsystems
No matter what language you’re
into, there’s a great scraping
library for your project:
● BeautifulSoup or Scrapy,
Python
● Upton or Wombat or
Nokogiri, Ruby
● Scraperjs or X-ray, Node
● Scrape, Go
● Jaunt, Java
13. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
+ Text and HTML
Processing
14. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
Leonardo Fernandes
Head of Delivery OutSystems, MVP | Phoenix Services
15. | Web Scraping and Automation With Outsystems
Extract information from plain text data with regular
expressions, or from HTML with CSS selectors.
Manipulate HTML documents with ease, and sanitize user
input against HTML injection.
16. | Web Scraping and Automation With Outsystems
The Plan
● Pinpoint your target: a simple
html website
● Design your scraping scheme
● Run & let the magic operate
17. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
Hands-on!
18. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
What about Enterprise
usage?
You may ask...
20. | Web Scraping and Automation With Outsystems
Frankort & Koning needs
● Check if Product/Producers is
certified
● Do that multiple times per
day, multiple times per
product
Global Gap problems
● No API available
● All the checks needs to be
done manually
21. | Web Scraping and Automation With Outsystems
How does it work…
You want to know which farm
produced your product?
● On the packaging of several products, you can find a 13-digit GLOBALG.A.P. Number
(GGN).
This number identifies the producer or producer group that has farmed your
product.
● As a consumer, you can use it to verify whether the product is from a certified
producer or not in the GLOBALG.A.P. Database.
● Retailers also use this number for business-to-business traceability to ensure that
products–especially fresh fruit and vegetables–come from a certified origin and that
the production is safe and sustainable.
23. | Web Scraping and Automation With Outsystems
OutSystems + Selenium + Chrome
● Automate user
interactions
● Extract HTML
● Parse HTML as before
24. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
Let’s see it in action...
25. | Web Scraping and Automation With Outsystems| Web Scraping and Automation With Outsystems
700+
Producers
160+
Products
900+
Certificates
*estimating that each certificate would take 1 minute to check manually
~15h
Manually*
~2h
Automatically
26. | Web Scraping and Automation With Outsystems
Thank You!
@
in
miguel.antunes@doitlean.co
m
/antunes-miguel
Editor's Notes
Thank you all for being here, let me also thanks OutSystems to let be here on the stage talking about a topic that I really like.
Which is Web Scraping and Automation with OutSystems.
They’re like the one ring of programming, enabling you to pull info and perform actions from different services.
I doubt Slack would be nearly as popular is it is without all those cool API integrations.
Now, considering how popular APIs are these days, it’s frustrating to run into a service or site without one. But, it’s actually quite common.
Netflix shut down it’s API years ago. My bank doesn’t have one. Most news sources don’t either. Bottom line, many apps & data aren’t designed for programmatic access.
But don’t let that discourage you from building your next big thing. If you need to collect data or perform an action on the web without access to an API, there are a couple ways you can hack it.
If a website provides a way for a visitor’s browser to download content and render that content in a structured way, then almost by definition, that content can be accessed programmatically. In this presentation, I’ll show you how.
Over the past few years, I’ve scraped dozens of websites – from cinema blogs, models agencies to cooking recipes sites, undocumented JSON endpoints that I found by inspecting network traffic in my browser, you name it.
There are some tricks that site owners will use to thwart this type of access – which we’ll dive into later – but they almost all have simple work-arounds.
Let me share with you some good point why web scraping is a good thing.
Of course, the first one is when we don’t have an API.
Site owners generally care way more about maintaining their public-facing visitor website than they do about their structured data feeds.
We’ve seen it very publicly with Twitter clamping down on their developer ecosystem, and I’ve seen it multiple times in my projects where APIs change or feeds move without warning.
Sometimes it’s deliberate, but most of the time these sorts of problems happen because no one at the organization really cares or maintains the structured data. If it goes offline or gets horribly mangled, no one really notices.
One the other hand, if the website goes down or is having issues, that’s a more of an in-your-face, drop-everything-until-this-is-fixed kind of problem, and gets dealt with quickly.
Another thing to think about is that the concept of rate-limiting is virtually non-existent for public websites.
Aside from the occasional captchas on sign up pages, most businesses generally don’t build a lot of defenses against automated access. I’ve scraped a single site for over 4 hours at a time and not seen any issues.
Unless you’re making an high amount of concurrent requests, you probably won’t be viewed as a DDOS attack, you’ll just show up as a super-avid visitor in the logs, in case anyone’s looking.
There are also fewer ways for the website’s administrators to track your behavior, which can be useful if you want gather data more privately.
With APIs, you often have to register to get a key and then send along that key with every request. But with simple HTTP requests, you’re basically anonymous besides your IP address and cookies, which can be easily spoofed.
Web scraping is also universally available, as I mentioned earlier.
You don’t have to wait for a site to come up with an API or even contact anyone at the organization to ask for it. Just spend some time browsing the site until you find the data you need and figure out some basic access patterns – which we’ll talk about next.
OutSystems has some libraries too, they are at the forge ready to be downloaded and to be used.
I personally like Text and HTML Processing
It was created by Leonardo, kudos to him.
It is probably a horrible idea to try parsing the HTML of the page as a long string, right? (although there are times I’ve needed to fall back on that).
A good library will read in the HTML that you pull in using some HTTP request and turn it into an object that you can iterate over to your heart’s content, similar to a JSON object. And this component just does that perfectly.The key to web scraping is figuring out how to identify the exact elements you’re looking for. This could be by looking for element types (divs, list items), particular ids or classes, or by doing regex / XPath searches.
So the first thing you’re going to need to do is fetch the data. You’ll need to start by finding your “endpoints” – the URL or URLs that return the data you need.
If you know you need your information organized in a certain way – or only need a specific subset of it – you can browse through the site using their navigation. Pay attention to the URLs and how they change as you click between sections and drill down into sub-sections.
The other option for getting started is to go straight to the site’s search functionality. Try typing in a few different terms and again, pay attention to the URL and how it changes depending on what you search for. You’ll probably see a GET parameter like q= that always changes based on you search term.
Try removing other unnecessary GET parameters from the URL, until you’re left with only the ones you need to load your data. Make sure that there’s always a beginning ? to start the query string and a & between each key/value pair.
I’m going to share with you on real scenario where we used Web Scraping to overcome the problem of not having an API to interact with a third party system.
Frankort & Koning is an international organisation that trades in fruit and vegetables.
Let me try do simplify their business process. They buy from the producers and sell to the markets. And since we’re talking about fruits and vegetables, they’re really worried about the freshness of the products they trade.
And this is an area with a lot of regulations, for example they can only sold products that came from certified producers.
Global GAP is the organization that certify the producers.
Frankort needed to have a way to know for each product that comes to the warehouse was certified for that specific producer.
The problem is that Global Gab, doesn't have an api to cross check that information, everything is done manually.
And I can we do that cross check?
There’s a 13-digit code on the packaging of the products. Like a traditional barcode that we are used to see.
With this code we can check the global gap database for the product certification.
This is how we can check the certification for a GGN number on the Global Gap database.
After inserting the producer GGN It will show us what this producer is certified to produce and sell, for this case he is certified to do it for cucumbers.
Now imagine this… Frankort receives thousands of products daily, checking all the products manually would make someone jump of a bridge for sure!
What we did, was to combine outsystems with selenium and then selenium with google chrome.
This way we can automate user actions, extract the HTML that resulted from that interaction and parse it as we did before.