Document Conversion & Retrieve and Rank 一問一答
•
1 like•1,091 views
This document provides information about using Watson services like Document Conversion and Retrieve and Rank through their APIs. It includes examples of calling the APIs to index documents, search a Solr collection, create a ranker, and perform a ranked search.
Report
Share
Report
Share
Download to read offline
Recommended
Scala.js: Next generation front end development in Scala
This document discusses Scala.js, which allows developers to write Scala code and compile it to JavaScript. Some key points:
- Scala.js provides the full Scala language experience and full interoperability with JavaScript. The generated JavaScript code is as fast as handwritten JS.
- It demonstrates Scala code that performs a Twitter API request and parses the response - but this is actually compiled to JavaScript, not run natively on the JVM.
- Compared to other languages that compile to JS like TypeScript, ClojureScript and Dart, Scala.js offers strong static types, powerful functional programming capabilities, and good tooling support in IDEs like Eclipse and IntelliJ
Large Scale Log Analytics with Solr (from Lucene Revolution 2015)
In this talk from Lucene/Solr Revolution 2015, Solr and centralized logging experts Radu Gheorghe and Rafal Kuć cover topics like: flow in Logstash, flow in rsyslog, parsing JSON, log shipping, Solr tuning, time-based collections and tiered clusters.
Template of nested stack
This CloudFormation template launches two nested stacks - one to create an EC2 instance and another to create an RDS database instance. It defines the stack resources, provides URLs to the nested stack templates located in S3, and passes parameters for the database username and password to the RDS stack.
Apache flink: data streaming as a basis for all analytics by Kostas Tzoumas a...
Flink is one of the largest and most active Apache big data projects with well over 120 contributors.
Session presented at Big Data Spain 2015 Conference
16th Oct 2015
Kinépolis Madrid
http://www.bigdataspain.org
Event promoted by: http://www.paradigmatecnologico.com
Abstract:http://www.bigdataspain.org/program/fri/slot-31.html
Mist - Serverless proxy to Apache Spark
Mist is a serverless framework that allows running Apache Spark jobs via a REST API. It addresses issues with deploying and running Spark jobs in production by providing a programming model and infrastructure similar to serverless computing. Mist runs Spark functions on demand across multiple clusters. Functions are defined using a MistFn trait and are triggered via a REST API. The Mist master queues and schedules requests on Mist workers. Contexts define Spark configuration and resources for running functions in parallel in a shared or exclusive mode. This improves scalability, multi-tenancy and provides a more normal development experience for Spark jobs compared to the usual approach of submitting jobs via the Spark shell.
Infrastructure as code terraformujeme cloud
OpenAlt2019 - Ako si uľahčiť a zautomatizovať vytváranie cloudovej infraštruktúry ako sú virtuálne stroje, databázy, siete, používateľské kontá a mnoho iného? Poďme sa pozrieť, ako si deklaratívnym spôsobom pohodlne zadefinujeme, čo všetko chceme mať napríklad v AWS cloude a ako si pomocou open source nástrojov Terraform a Terragrunt všetko jednoducho vytvoríme, zmeníme alebo odstránime.
regular expressions and the world wide web
This document discusses regular expressions (REs) and their extraordinary power. It covers how REs can be used to parse HTTP responses and extract information from websites through web scraping. Specifically, it explains that REs allow software to gather, replace, search, and validate text. REs can parse response headers and process response bodies. Web crawlers and scrapers use REs to systematically extract hyperlinks, images, and other data from websites.
Serverless to author, schedule, execute and monitor data workflows.
Expedia Affiliates Network (EAN), is the B2B partnership brand of Expedia, Inc. Our technology powers the hotel offering of thousands of partners around the world. Everyday EAN produces, processes and consumes more than 10TB of data to drive applications, services and business through granular insights. EAN new data cloud platform is an opportunity to be nimble, simplify and consolidate the authoring, schedule, execution and monitoring of complex data workflows. The talk explores EAN’s strategy on data processing in the cloud, moving from traditional workflow tools to a serverless approach, leveraging step-function, lambda, API gateway, EMR and Cloud Watch.
Recommended
Scala.js: Next generation front end development in Scala
This document discusses Scala.js, which allows developers to write Scala code and compile it to JavaScript. Some key points:
- Scala.js provides the full Scala language experience and full interoperability with JavaScript. The generated JavaScript code is as fast as handwritten JS.
- It demonstrates Scala code that performs a Twitter API request and parses the response - but this is actually compiled to JavaScript, not run natively on the JVM.
- Compared to other languages that compile to JS like TypeScript, ClojureScript and Dart, Scala.js offers strong static types, powerful functional programming capabilities, and good tooling support in IDEs like Eclipse and IntelliJ
Large Scale Log Analytics with Solr (from Lucene Revolution 2015)
In this talk from Lucene/Solr Revolution 2015, Solr and centralized logging experts Radu Gheorghe and Rafal Kuć cover topics like: flow in Logstash, flow in rsyslog, parsing JSON, log shipping, Solr tuning, time-based collections and tiered clusters.
Template of nested stack
This CloudFormation template launches two nested stacks - one to create an EC2 instance and another to create an RDS database instance. It defines the stack resources, provides URLs to the nested stack templates located in S3, and passes parameters for the database username and password to the RDS stack.
Apache flink: data streaming as a basis for all analytics by Kostas Tzoumas a...
Flink is one of the largest and most active Apache big data projects with well over 120 contributors.
Session presented at Big Data Spain 2015 Conference
16th Oct 2015
Kinépolis Madrid
http://www.bigdataspain.org
Event promoted by: http://www.paradigmatecnologico.com
Abstract:http://www.bigdataspain.org/program/fri/slot-31.html
Mist - Serverless proxy to Apache Spark
Mist is a serverless framework that allows running Apache Spark jobs via a REST API. It addresses issues with deploying and running Spark jobs in production by providing a programming model and infrastructure similar to serverless computing. Mist runs Spark functions on demand across multiple clusters. Functions are defined using a MistFn trait and are triggered via a REST API. The Mist master queues and schedules requests on Mist workers. Contexts define Spark configuration and resources for running functions in parallel in a shared or exclusive mode. This improves scalability, multi-tenancy and provides a more normal development experience for Spark jobs compared to the usual approach of submitting jobs via the Spark shell.
Infrastructure as code terraformujeme cloud
OpenAlt2019 - Ako si uľahčiť a zautomatizovať vytváranie cloudovej infraštruktúry ako sú virtuálne stroje, databázy, siete, používateľské kontá a mnoho iného? Poďme sa pozrieť, ako si deklaratívnym spôsobom pohodlne zadefinujeme, čo všetko chceme mať napríklad v AWS cloude a ako si pomocou open source nástrojov Terraform a Terragrunt všetko jednoducho vytvoríme, zmeníme alebo odstránime.
regular expressions and the world wide web
This document discusses regular expressions (REs) and their extraordinary power. It covers how REs can be used to parse HTTP responses and extract information from websites through web scraping. Specifically, it explains that REs allow software to gather, replace, search, and validate text. REs can parse response headers and process response bodies. Web crawlers and scrapers use REs to systematically extract hyperlinks, images, and other data from websites.
Serverless to author, schedule, execute and monitor data workflows.
Expedia Affiliates Network (EAN), is the B2B partnership brand of Expedia, Inc. Our technology powers the hotel offering of thousands of partners around the world. Everyday EAN produces, processes and consumes more than 10TB of data to drive applications, services and business through granular insights. EAN new data cloud platform is an opportunity to be nimble, simplify and consolidate the authoring, schedule, execution and monitoring of complex data workflows. The talk explores EAN’s strategy on data processing in the cloud, moving from traditional workflow tools to a serverless approach, leveraging step-function, lambda, API gateway, EMR and Cloud Watch.
2014 09 30_sparkling_water_hands_on
How Sparkling Water brings Fast Scalable Machine learning via H2O to Apache Spark.
By Michal Malohlava and H2O.ai
Our 100th Meetup at 0xdata, September 30, 2014
Open Source meets Out Door.
- Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai
- To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata
HTML Flight Scraper
This document summarizes a Python script that scrapes airfare data from Kayak.com. It uses the Selenium library to control a Chrome webdriver and interact with webpage elements. The script opens each flight element to dynamically load data before scraping. It collects data like destination, time, airline from each saved flight. The data is organized into a nested list and identifiers are added before writing rows to an Excel file every 4 hours or a MySQL database daily. A Raspberry Pi was used to run the script continuously without keeping a desktop on. A front-end GUI was created with Tkinter but not connected to the backend database yet.
Side by Side with Elasticsearch & Solr, Part 2
This document compares the performance and scalability of Elasticsearch and Solr for two use cases: product search and log analytics. For product search, both products performed well at high query volumes, but Elasticsearch handled the larger video dataset faster. For logs, Elasticsearch performed better by using time-based indices across hot and cold nodes to isolate newer and older data. In general, configuration was found to impact performance more than differences between the products. Proper testing with one's own data is recommended before making conclusions.
R and Athena … there is another way!?
When setting up JDBC or ODBC drivers to AWS Athena proves to be too difficult, is there another way? Well yes! with the new RAthena and noctua packages, R users can now connect to AWS Athena by using AWS SDK's.
grlc: Bridging the Gap Between RESTful APIs and Linked Data
This document summarizes a presentation about bridging the gap between RESTful APIs and Linked Data using GitHub and SPARQL queries. It discusses how grlc maps GitHub repositories of SPARQL queries to Swagger API specifications and endpoints to provide RESTful access to Linked Data without having to code and maintain separate APIs. Features like content negotiation, pagination, caching and containerization are described to improve the usability and performance of the generated APIs. The presentation concludes by demonstrating how grlc allows flexible organization of SPARQL queries and separation of query curation from client applications.
Full Stack Scala
This document discusses using Scala for full stack development, with Scala in both the backend and frontend. It provides an overview of using Scala and Scala.js for backend and frontend development, including architectures, frameworks, and techniques. The backend is built with Scala and Spring Boot, using techniques like dependency injection and immutable data structures. The frontend is built with Scala.js and React for the UI, using Flux architecture and immutable data. It also discusses mobile development with Scala and React Native.
Analyse your SEO Data with R and Kibana
Using Screaming Frog to crawl a website
Using R for SEO Analysis
Using PaasLogs to centralize logs
Using Kibana to build fancy dashboards
Tutorial : www.data-seo.com
How we cooked Elasticsearch, Consul, HAproxy and DNS-recursor
This document summarizes how Elasticsearch, Consul, HAProxy and a DNS recursor were configured together for high availability and fault tolerance. Elasticsearch instances were placed behind HAProxy load balancers for fail-over. Consul monitored the health of the balancers and informed the DNS recursor of only healthy balancer IPs. The DNS recursor then provided these IPs to clients, ensuring requests continued even if a balancer failed. This created a three-tier system with node, application and DNS layers for redundancy.
Closing the Loop in Extended Reality with Kafka Streams and Machine Learning ...
We’ve built a real-time streaming platform that enables prediction based on user behavior, with events occurring in virtual and augmented reality environments. The solution enables organizations to train people in an extended reality environment, where real-life training may be costly and dangerous. Kafka Streams enables analyzing spatial and event data to detect gestural feature and analyze user behavior in real-time to be able to predict any future mistake the user might make. Kafka is the backbone of our real-time analytics and extended reality communication platform with our cluster and applications being deployed on Kubernetes.
In this talk, we will mainly focus on the following: 1. Why Extended Reality with Kafka is a step in the right direction. 2. Architecture & Power of Schema Registry in building a generic platform for pluggable XR apps and analytics models 3. How KSQL and Kafka Streams fits in Kafka Ecosystem to help analyze human motion data and detect features for real-time prediction. 4. Demo of a VR application with real-time analytics feedback, which assists people to be trained in how to work with chemical laboratory equipment.
Ground Control to Nomad Job Dispatch
A beginners guide to the unsung Nomad feature, Parameterized Jobs: a great way to represent batch workloads that require additional context. We'll look at Nomad as a whole, how parameterized jobs fit into the bigger picture, and then put the feature (as well as the related nomad job dispatch command) into practice with some example jobs.
You will leave knowing how to create a parameterized job, how to dispatch a parameterized job, and a general understanding of all the behind the scenes machinery that makes your workload run smoothly.
Big Data with BigQuery, presented at DevoxxUK 2014 by Javier Ramirez from teo...
Big data is amazing. You can get insights from your users, find interesting patterns and have lots of geek fun. Problem is big data usually means many servers, a complex set up, intensive monitoring and a steep learning curve. All those things cost money. If you don’t have the money, you are losing all the fun.
In my talk I show you how you can use Google BigQuery to manage big data from your application using a hosted solution. And you can start with less than $1 per month.
A peak at Rails 2.0
Rails 2.0 has reached over 1 million downloads with hundreds of plugins and thousands of people discussing it online. The experiment of Ruby on Rails has been successful by becoming a popular web framework that is actively developed and supported by an engaged community. The new features in Rails 2.0 include improvements to debugging, performance, configuration, migrations and authentication capabilities to continue enhancing the web development experience.
Riak Intro at Munich Node.js
This document discusses using Riak, a distributed key-value database, with Node.js. Riak uses HTTP as its interface and can store JSON data, making it a good fit for Node.js applications. The Riak client library for Node.js allows storing, retrieving, and querying data from Riak directly in JavaScript code. MapReduce queries in Riak can be used to process large datasets in parallel across the distributed cluster, and custom map and reduce functions can be defined in JavaScript.
Rancher最速セットアップ理論 プロジェクトr to the next stage
This document discusses using CloudFormation to automatically set up a minimal Rancher environment on AWS. It describes using a RancherOS AMI, configuring services and scripts via cloud-init, and automating the registration of custom hosts and execution of agents to fully set up Rancher Server within 3-4 minutes on a c4.8xlarge instance or 7-8 minutes on a m4.large instance. The process leverages cloud-init, Docker, and curl/wget commands to minimize manual configuration steps.
Datatypes for the real world
“Make illegal state unrepresentable” - Yaron Minsky
Starting from Yaron’s quote we will see where it traditionally applies: values sanitization (escaping), data structures (NonEmptyList), CS constructs (parsers). Does it still apply to the rest of the day-to-day programming where things look… complicated?
In particular we will develop the example of executing applications which can run on single Amazon EC2 instances (for testing) or on full EMR clusters (for production) and which can take data from S3 (meaning that they need to download it and put it somewhere first) or use local data.
Can we make sure we get the right paths? Can we know when it is possible to download data efficiently (using distcopy to go directly from S3 to the cluster for example)? The answer is: create specific data types to model the different cases and tame the complexity.
The take-away: datatypes are not only for “data” but they can also encapsulate “logic”
Javantura v3 - Develop the right way with S-CASE – Marin Orlić
Javantura v3 - Develop the right way with S-CASE – Marin OrlićHUJAK - Hrvatska udruga Java korisnika / Croatian Java User Association
The document discusses S-CASE, a software development tool that enables modeling requirements, creating prototypes, and generating RESTful code. S-CASE allows developing services from requirements in 3 to 5 steps, and can generate over 2,000 lines of Java code for a review service in 15 minutes with no bugs. The document outlines features of S-CASE including RESTful APIs, authentication, searching, code generation, and integration with external services. It also describes different versions of S-CASE for single developers, teams, and custom installations.2014 spark with elastic search
This document discusses using Apache Spark and Elasticsearch together to index streaming data in real-time and reduce network overhead. It provides an overview of Spark and Elasticsearch, demonstrates how to set up a Spark streaming job to index tweets in Elasticsearch in real-time, and describes a modification made to the Elasticsearch connector to write data directly to shards based on the Spark partition, avoiding unnecessary network hops. The document includes code samples and concludes with links for further information.
Scrapy-101
Scrapy is a fast, open source Python framework for scraping web pages and extracting structured data using XPath selectors. It can build and scale large crawling projects easily, handles requests asynchronously to be fast, and automatically adjusts crawling speed using auto-throttling. Scrapy generates exports in formats like JSON, CSV, and XML and has built-in support for extracting data by XPath or CSS expressions from web pages in an automatic way.
Spark ML Pipeline serving
My talk at Data Science Labs conference in Odessa.
Training a model in Apache Spark while having it automatically available for real-time serving is an essential feature for end-to-end solutions.
There is an option to export the model into PMML and then import it into a separated scoring engine. The idea of interoperability is great but it has multiple challenges, such as code duplication, limited extensibility, inconsistency, extra moving parts. In this talk we discussed an alternative solution that does not introduce custom model formats and new standards, not based on export/import workflow and shares Apache Spark API.
Ams adapters
AMS adapters in Rails 5 are important for building a wonderful RESTful API because they provide hypermedia controls and links in the API response. The JSON API adapter in particular generates responses that follow the JSON API specification by including links, relationships, pagination metadata, and embedded resources. Adapters allow Rails to render different representation formats like JSON API, customize the API structure, and improve the developer experience of the API through conventions like hypermedia controls and links. However, there is still work to be done on adapters, like improving deserialization, documentation, and better supporting JSON API conventions fully.
Introduction to Apache Camel
We start with an introduction to what Apache Camel is, and how you can use Camel to make integration much easier. Allowing you to focus on your business logic, rather than low level messaging protocols, and transports. You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
We look into web console tooling that allows you to get insight into your running Apache Camel applications, which has among others visual route diagrams with tracing/debugging and profiling capabilities. In addition to the web tooling we will also show you other tools in the making.
Machine Learning with H2O, Spark, and Python at Strata 2015
Machine Learning with H2O, Spark, and Python at Strata SJ 2015-by Cliff Click and Michal Malohlava
- Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai
- To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata
More Related Content
What's hot
2014 09 30_sparkling_water_hands_on
How Sparkling Water brings Fast Scalable Machine learning via H2O to Apache Spark.
By Michal Malohlava and H2O.ai
Our 100th Meetup at 0xdata, September 30, 2014
Open Source meets Out Door.
- Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai
- To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata
HTML Flight Scraper
This document summarizes a Python script that scrapes airfare data from Kayak.com. It uses the Selenium library to control a Chrome webdriver and interact with webpage elements. The script opens each flight element to dynamically load data before scraping. It collects data like destination, time, airline from each saved flight. The data is organized into a nested list and identifiers are added before writing rows to an Excel file every 4 hours or a MySQL database daily. A Raspberry Pi was used to run the script continuously without keeping a desktop on. A front-end GUI was created with Tkinter but not connected to the backend database yet.
Side by Side with Elasticsearch & Solr, Part 2
This document compares the performance and scalability of Elasticsearch and Solr for two use cases: product search and log analytics. For product search, both products performed well at high query volumes, but Elasticsearch handled the larger video dataset faster. For logs, Elasticsearch performed better by using time-based indices across hot and cold nodes to isolate newer and older data. In general, configuration was found to impact performance more than differences between the products. Proper testing with one's own data is recommended before making conclusions.
R and Athena … there is another way!?
When setting up JDBC or ODBC drivers to AWS Athena proves to be too difficult, is there another way? Well yes! with the new RAthena and noctua packages, R users can now connect to AWS Athena by using AWS SDK's.
grlc: Bridging the Gap Between RESTful APIs and Linked Data
This document summarizes a presentation about bridging the gap between RESTful APIs and Linked Data using GitHub and SPARQL queries. It discusses how grlc maps GitHub repositories of SPARQL queries to Swagger API specifications and endpoints to provide RESTful access to Linked Data without having to code and maintain separate APIs. Features like content negotiation, pagination, caching and containerization are described to improve the usability and performance of the generated APIs. The presentation concludes by demonstrating how grlc allows flexible organization of SPARQL queries and separation of query curation from client applications.
Full Stack Scala
This document discusses using Scala for full stack development, with Scala in both the backend and frontend. It provides an overview of using Scala and Scala.js for backend and frontend development, including architectures, frameworks, and techniques. The backend is built with Scala and Spring Boot, using techniques like dependency injection and immutable data structures. The frontend is built with Scala.js and React for the UI, using Flux architecture and immutable data. It also discusses mobile development with Scala and React Native.
Analyse your SEO Data with R and Kibana
Using Screaming Frog to crawl a website
Using R for SEO Analysis
Using PaasLogs to centralize logs
Using Kibana to build fancy dashboards
Tutorial : www.data-seo.com
How we cooked Elasticsearch, Consul, HAproxy and DNS-recursor
This document summarizes how Elasticsearch, Consul, HAProxy and a DNS recursor were configured together for high availability and fault tolerance. Elasticsearch instances were placed behind HAProxy load balancers for fail-over. Consul monitored the health of the balancers and informed the DNS recursor of only healthy balancer IPs. The DNS recursor then provided these IPs to clients, ensuring requests continued even if a balancer failed. This created a three-tier system with node, application and DNS layers for redundancy.
Closing the Loop in Extended Reality with Kafka Streams and Machine Learning ...
We’ve built a real-time streaming platform that enables prediction based on user behavior, with events occurring in virtual and augmented reality environments. The solution enables organizations to train people in an extended reality environment, where real-life training may be costly and dangerous. Kafka Streams enables analyzing spatial and event data to detect gestural feature and analyze user behavior in real-time to be able to predict any future mistake the user might make. Kafka is the backbone of our real-time analytics and extended reality communication platform with our cluster and applications being deployed on Kubernetes.
In this talk, we will mainly focus on the following: 1. Why Extended Reality with Kafka is a step in the right direction. 2. Architecture & Power of Schema Registry in building a generic platform for pluggable XR apps and analytics models 3. How KSQL and Kafka Streams fits in Kafka Ecosystem to help analyze human motion data and detect features for real-time prediction. 4. Demo of a VR application with real-time analytics feedback, which assists people to be trained in how to work with chemical laboratory equipment.
Ground Control to Nomad Job Dispatch
A beginners guide to the unsung Nomad feature, Parameterized Jobs: a great way to represent batch workloads that require additional context. We'll look at Nomad as a whole, how parameterized jobs fit into the bigger picture, and then put the feature (as well as the related nomad job dispatch command) into practice with some example jobs.
You will leave knowing how to create a parameterized job, how to dispatch a parameterized job, and a general understanding of all the behind the scenes machinery that makes your workload run smoothly.
Big Data with BigQuery, presented at DevoxxUK 2014 by Javier Ramirez from teo...
Big data is amazing. You can get insights from your users, find interesting patterns and have lots of geek fun. Problem is big data usually means many servers, a complex set up, intensive monitoring and a steep learning curve. All those things cost money. If you don’t have the money, you are losing all the fun.
In my talk I show you how you can use Google BigQuery to manage big data from your application using a hosted solution. And you can start with less than $1 per month.
A peak at Rails 2.0
Rails 2.0 has reached over 1 million downloads with hundreds of plugins and thousands of people discussing it online. The experiment of Ruby on Rails has been successful by becoming a popular web framework that is actively developed and supported by an engaged community. The new features in Rails 2.0 include improvements to debugging, performance, configuration, migrations and authentication capabilities to continue enhancing the web development experience.
Riak Intro at Munich Node.js
This document discusses using Riak, a distributed key-value database, with Node.js. Riak uses HTTP as its interface and can store JSON data, making it a good fit for Node.js applications. The Riak client library for Node.js allows storing, retrieving, and querying data from Riak directly in JavaScript code. MapReduce queries in Riak can be used to process large datasets in parallel across the distributed cluster, and custom map and reduce functions can be defined in JavaScript.
Rancher最速セットアップ理論 プロジェクトr to the next stage
This document discusses using CloudFormation to automatically set up a minimal Rancher environment on AWS. It describes using a RancherOS AMI, configuring services and scripts via cloud-init, and automating the registration of custom hosts and execution of agents to fully set up Rancher Server within 3-4 minutes on a c4.8xlarge instance or 7-8 minutes on a m4.large instance. The process leverages cloud-init, Docker, and curl/wget commands to minimize manual configuration steps.
Datatypes for the real world
“Make illegal state unrepresentable” - Yaron Minsky
Starting from Yaron’s quote we will see where it traditionally applies: values sanitization (escaping), data structures (NonEmptyList), CS constructs (parsers). Does it still apply to the rest of the day-to-day programming where things look… complicated?
In particular we will develop the example of executing applications which can run on single Amazon EC2 instances (for testing) or on full EMR clusters (for production) and which can take data from S3 (meaning that they need to download it and put it somewhere first) or use local data.
Can we make sure we get the right paths? Can we know when it is possible to download data efficiently (using distcopy to go directly from S3 to the cluster for example)? The answer is: create specific data types to model the different cases and tame the complexity.
The take-away: datatypes are not only for “data” but they can also encapsulate “logic”
Javantura v3 - Develop the right way with S-CASE – Marin Orlić
Javantura v3 - Develop the right way with S-CASE – Marin OrlićHUJAK - Hrvatska udruga Java korisnika / Croatian Java User Association
The document discusses S-CASE, a software development tool that enables modeling requirements, creating prototypes, and generating RESTful code. S-CASE allows developing services from requirements in 3 to 5 steps, and can generate over 2,000 lines of Java code for a review service in 15 minutes with no bugs. The document outlines features of S-CASE including RESTful APIs, authentication, searching, code generation, and integration with external services. It also describes different versions of S-CASE for single developers, teams, and custom installations.2014 spark with elastic search
This document discusses using Apache Spark and Elasticsearch together to index streaming data in real-time and reduce network overhead. It provides an overview of Spark and Elasticsearch, demonstrates how to set up a Spark streaming job to index tweets in Elasticsearch in real-time, and describes a modification made to the Elasticsearch connector to write data directly to shards based on the Spark partition, avoiding unnecessary network hops. The document includes code samples and concludes with links for further information.
Scrapy-101
Scrapy is a fast, open source Python framework for scraping web pages and extracting structured data using XPath selectors. It can build and scale large crawling projects easily, handles requests asynchronously to be fast, and automatically adjusts crawling speed using auto-throttling. Scrapy generates exports in formats like JSON, CSV, and XML and has built-in support for extracting data by XPath or CSS expressions from web pages in an automatic way.
What's hot (18)
grlc: Bridging the Gap Between RESTful APIs and Linked Data
grlc: Bridging the Gap Between RESTful APIs and Linked Data
How we cooked Elasticsearch, Consul, HAproxy and DNS-recursor
How we cooked Elasticsearch, Consul, HAproxy and DNS-recursor
Closing the Loop in Extended Reality with Kafka Streams and Machine Learning ...
Closing the Loop in Extended Reality with Kafka Streams and Machine Learning ...
Big Data with BigQuery, presented at DevoxxUK 2014 by Javier Ramirez from teo...
Big Data with BigQuery, presented at DevoxxUK 2014 by Javier Ramirez from teo...
Javantura v3 - Develop the right way with S-CASE – Marin Orlić
Javantura v3 - Develop the right way with S-CASE – Marin Orlić
Similar to Document Conversion & Retrieve and Rank 一問一答
Spark ML Pipeline serving
My talk at Data Science Labs conference in Odessa.
Training a model in Apache Spark while having it automatically available for real-time serving is an essential feature for end-to-end solutions.
There is an option to export the model into PMML and then import it into a separated scoring engine. The idea of interoperability is great but it has multiple challenges, such as code duplication, limited extensibility, inconsistency, extra moving parts. In this talk we discussed an alternative solution that does not introduce custom model formats and new standards, not based on export/import workflow and shares Apache Spark API.
Ams adapters
AMS adapters in Rails 5 are important for building a wonderful RESTful API because they provide hypermedia controls and links in the API response. The JSON API adapter in particular generates responses that follow the JSON API specification by including links, relationships, pagination metadata, and embedded resources. Adapters allow Rails to render different representation formats like JSON API, customize the API structure, and improve the developer experience of the API through conventions like hypermedia controls and links. However, there is still work to be done on adapters, like improving deserialization, documentation, and better supporting JSON API conventions fully.
Introduction to Apache Camel
We start with an introduction to what Apache Camel is, and how you can use Camel to make integration much easier. Allowing you to focus on your business logic, rather than low level messaging protocols, and transports. You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
We look into web console tooling that allows you to get insight into your running Apache Camel applications, which has among others visual route diagrams with tracing/debugging and profiling capabilities. In addition to the web tooling we will also show you other tools in the making.
Machine Learning with H2O, Spark, and Python at Strata 2015
Machine Learning with H2O, Spark, and Python at Strata SJ 2015-by Cliff Click and Michal Malohlava
- Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai
- To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata
Introduction to CloudStack API
The document discusses an introduction to the CloudStack API. It covers topics like API documentation, clients that interface with the API, exploring the API by examining HTTP calls from the UI, making authenticated and unauthenticated API calls, asynchronous calls, error handling, and includes an exercise on building a REST interface to CloudStack using Flask.
H2O PySparkling Water
Michal Malohlava talks about the PySparkling Water package for Spark and Python users.
- Powered by the open source machine learning software H2O.ai. Contributors welcome at: https://github.com/h2oai
- To view videos on H2O open source machine learning software, go to: https://www.youtube.com/user/0xdata
StrongLoop Overview
OpenSource API Server based on Node.js API framework built on supported Node.js platform with Tooling and DevOps. Use cases are Omni-channel API Server, Mobile Backend as a Service (mBaaS) or Next Generation Enterprise Service Bus. Key functionality include built in enterprise connectors, ORM, Offline Sync, Mobile and JS SDKs, Isomorphic JavaScript and Graphical API creation tool.
Data / Streaming / Microservices Platform with Devops
This document describes a data/streaming/microservices platform with DevOps capabilities. It includes components for data collection, a unified log store, batch and stream processing, management services, and interactive querying. Typical applications are described along with the platform layers and DevOps perspective. Potential future additions are also outlined.
Solutions for bi-directional integration between Oracle RDBMS & Apache Kafka
Apache Kafka is a popular distributed streaming data platform. A Kafka cluster stores streams of records (messages) in categories called topics. It is the architectural backbone for integrating streaming data with a Data Lake, Microservices and Stream Processing. Data sources flowing into Kafka are often native data streams such as social media streams, telemetry data, financial transactions and many others. But these data stream only contain part of the information. A lot of data necessary in stream processing is stored in traditional systems backed by relational databases. To implement new and modern, real-time solutions, an up-to-date view of that information is needed. So how do we make sure that information can flow between the RDBMS and Kafka, so that changes are available in Kafka as soon as possible in near-real-time? This session will present different approaches for integrating relational databases with Kafka, such as Kafka Connect, Oracle GoldenGate and bridging Kafka with Oracle Advanced Queuing (AQ).
Solutions for bi-directional Integration between Oracle RDMBS & Apache Kafka
A Kafka cluster stores streams of records (messages) in categories called topics. It is the architectural backbone for integrating streaming data with a Data Lake, Microservices and Stream Processing. Today’s enterprises have their core systems often implemented on top of relational databases, such as the Oracle RDBMS. Implementing a new solution supporting the digital strategy using Kafka and the ecosystem can not always be done completely separate from the traditional legacy solutions. Often streaming data has to be enriched with state data which is held in an RDBMS of a legacy application. It’s important to cache this data in the stream processing solution, so that It can be efficiently joined to the data stream. But how do we make sure that the cache is kept up-to-date, if the source data changes? We can either poll for changes from Kafka using Kafka Connect or let the RDBMS push the data changes to Kafka. But what about writing data back to the legacy application, i.e. an anomaly is detected inside the stream processing solution which should trigger an action inside the legacy application. Using Kafka Connect we can write to a database table or view, which could trigger the action. But this not always the best option. If you have an Oracle RDBMS, there are many other ways to integrate the database with Kafka, such as Advanced Queueing (message broker in the database), CDC through Golden Gate or Debezium, Oracle REST Database Service (ORDS) and more. In this session, we present various blueprints for integrating an Oracle RDBMS with Apache Kafka in both directions and discuss how these blueprints can be implemented using the products mentioned before.
Solutions for bi-directional integration between Oracle RDBMS and Apache Kafk...
A Kafka cluster stores streams of records (messages) in categories called topics. It is the architectural backbone for integrating streaming data with a Data Lake, Microservices and Stream Processing. Today's enterprises have their core systems often implemented on top of relational databases, such as the Oracle RDBMS. Implementing a new solution supporting the digital strategy using Kafka and the ecosystem can not always be done completely separate from the traditional legacy solutions. Often streaming data has to be enriched with state data which is held in an RDBMS of a legacy application. It's important to cache this data in the stream processing solution, so that It can be efficiently joined to the data stream. But how do we make sure that the cache is kept up-to-date, if the source data changes? We can either poll for changes from Kafka using Kafka Connect or let the RDBMS push the data changes to Kafka. But what about writing data back to the legacy application, i.e. an anomaly is detected inside the stream processing solution which should trigger an action inside the legacy application. Using Kafka Connect we can write to a database table or view, which could trigger the action. But this not always the best option. If you have an Oracle RDBMS, there are many other ways to integrate the database with Kafka, such as Advanced Queueing (message broker in the database), CDC through Golden Gate or Debezium, Oracle REST Database Service (ORDS) and more. In this session, we present various blueprints for integrating an Oracle RDBMS with Apache Kafka in both directions and discuss how these blueprints can be implemented using the products mentioned before.
API REST et client Javascript - Nuxeo Tour 2014 - Workshop
This document discusses Nuxeo's APIs, including REST and automation APIs. The REST API provides resources like documents, users, and groups, and uses HTTP methods like GET, POST, PUT, and DELETE. The automation API allows running operations on documents to perform tasks like creation, retrieval, and workflows. Both APIs can be accessed from client libraries in languages like Java, JavaScript, iOS, Android, and more.
Kafka streams - From pub/sub to a complete stream processing platform
Kafka Streams allows developers to build stream processing applications that integrate with Apache Kafka. It provides APIs for processing streams of data in real-time and elastically scaling applications. Typical architectures using Kafka Streams involve ingesting real-time data, processing it with stream processing, and storing or publishing the results.
Austin Data Meetup 092014 - Spark
The Spark Summit was attended by over 1,100 people from 450+ companies and featured keynotes and community presentations. Spark is an active Apache project with over 250 contributors from 50+ companies. It includes subprojects for SQL, streaming, machine learning and graph processing. Popular use cases include real-time recommendations, cancer genomics, and media analytics.
Data Summer Conf 2018, “Mist – Serverless proxy for Apache Spark (RUS)” — Vad...
In this demo based talk with live coding, we’ll present a functional typeful framework for developing Apache Spark applications. We’ll walk through the following key topics: – turning unmanageable Spark scripts into typeful Spark Functions – serverless deployment of Spark functions into the cloud – unit testing Spark functions to save cluster resources and developers time – seamless Spark session management between concurrent Spark jobs in exclusive or share modes
Seattle StrongLoop Node.js Workshop
Slides from the May 20th workshop at the Seattle Node.js Meetup presented by Shubhra Kar titled: "Develop, Deploy, Monitor and Hyper-scale REST APIs Built in Node.js"
presentation
The document discusses a project analyzing Twitter spam and fraudulent websites. It outlines two proposed architectures - one using Hadoop/HDFS/Flume/Hive/Postgres/Spark and the other using Spark/Scala/Streaming for data ingestion from Twitter APIs, analysis using text analysis and machine learning, and storing results in HDFS for retrieval and display in dashboards and browser plugins. It also discusses future work including clustering, error recovery, API development, improved algorithms, and additional applications of the data pipeline.
L’odyssée d’une requête HTTP chez Scaleway
This document provides a summary of the journey a HTTP request takes when interacting with Scaleway's API gateway and backend services. It describes how requests are routed, load balanced, authenticated, rate limited and sent to the appropriate backend service across different regions. The document is presented as a story told over 7 chapters, covering topics like gRPC integration, locality routing, authentication, service discovery and load balancing.
Apache Camel - The integration library
We start with an introduction to what Apache Camel is, and how you can use Camel to make integration much easier. Allowing you to focus on your business logic, rather than low level messaging protocols, and transports.
You will hear how Apache Camel is related Enterprise Integration
Patterns which you can use in your architectural designs and as well in Java or XML code, running on the JVM with Camel.
You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
We also take a moment to look at web console tooling that allows you to get insight into your running Apache Camel applications, which has among others visual route diagrams with tracing/debugging and profiling capabilities. In addition to the web tooling we will also show you other tools in the making.
This talk was presented at JDKIO on September 13th 2016.
Automate your automation with Rudder’s API! \o/
Rudder comes with a complete REST API which provides access to all data available within Rudder so you can automate your configuration automation without using the web interface.
Using it, you can create tools (scripts, UI) adapted to your environment to automate common tasks in Rudder (Change a single setting in a Directive? Enable or disable a Rule according on customer request? Accept new nodes via a third party interface) or integrate existing tools like your CMDB, monitoring or even a KPI-reporting system.
We try to provide lot of documentation and make it as user friendly as possible, but it’s not always easy to realise exactly what the API can do, or figure out to best use it.
In this hands-on session, I will first explain how Rudder API works and is organized. Then, we will practice our knowledge (and our Python) to create a tool over Rudder API.
Similar to Document Conversion & Retrieve and Rank 一問一答 (20)
Machine Learning with H2O, Spark, and Python at Strata 2015
Machine Learning with H2O, Spark, and Python at Strata 2015
Data / Streaming / Microservices Platform with Devops
Data / Streaming / Microservices Platform with Devops
Solutions for bi-directional integration between Oracle RDBMS & Apache Kafka
Solutions for bi-directional integration between Oracle RDBMS & Apache Kafka
Solutions for bi-directional Integration between Oracle RDMBS & Apache Kafka
Solutions for bi-directional Integration between Oracle RDMBS & Apache Kafka
Solutions for bi-directional integration between Oracle RDBMS and Apache Kafk...
Solutions for bi-directional integration between Oracle RDBMS and Apache Kafk...
API REST et client Javascript - Nuxeo Tour 2014 - Workshop
API REST et client Javascript - Nuxeo Tour 2014 - Workshop
Kafka streams - From pub/sub to a complete stream processing platform
Kafka streams - From pub/sub to a complete stream processing platform
Data Summer Conf 2018, “Mist – Serverless proxy for Apache Spark (RUS)” — Vad...
Data Summer Conf 2018, “Mist – Serverless proxy for Apache Spark (RUS)” — Vad...
Recently uploaded
Essentials of Automations: The Art of Triggers and Actions in FME
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Climate Impact of Software Testing at Nordic Testing Days
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
National Security Agency - NSA mobile device best practices
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Microsoft - Power Platform_G.Aspiotis.pdf
Revolutionizing Application Development
with AI-powered low-code, presentation by George Aspiotis, Sr. Partner Development Manager, Microsoft
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
20240609 QFM020 Irresponsible AI Reading List May 2024
Everything I found interesting about the irresponsible use of machine intelligence in May 2024
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Video Streaming: Then, Now, and in the Future
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Full-RAG: A modern architecture for hyper-personalization
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
UiPath Test Automation using UiPath Test Suite series, part 6
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Recently uploaded (20)
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Document Conversion & Retrieve and Rank 一問一答
- 1. Hisashi KOMINE / MNU K. K. Bluemix User Group in Watson Summit 2017 ver. 1.0.0 DOCUMENT CONVERSION & RETRIEVE AND RANK 1
- 2. Q-0 A-0
- 3. Facebook: Twitter: Github: / Qiita: hssh hssh mnu-komine hssh Apache Spark Bluemix Hadoop TUT Vue.js DMM.com reveal.js org-mode PHP MySQL Document ConversionAichi Toyohasi ES2016 iOS Zend Framework A cappella AngularJS GCP Chef Vagrant TNCT neptune.io Azure MongoDB CSS3 Laravel Solr KDDI Cloud Webimpact AWS Scala Retrieve and RankPBOX MapR API ConnectCat IntelliJ IDEA Ruby Tensorflow HTML5 Hokkaido Shiraoi Python Docker MNU Electron Ruby on Rails macOS Yokohama Aobaku Outdoor Hustler Emacs Elasticsearch Golang Cloudn WatsonMariaDB Machine Learning Django Camp node.js Apache Cordova Scrum 2 . 2
- 4. Q-1 Document Conversion (DC) A-1 Word PDF HTML Retrieve and Rank Watson API
- 5. Q-2 Retrieve and Rank (R&R) A-2 Solr
- 6. Q-3 Watson API JS A-3 Watson API CORS Bluemix CORS Proxy API JS API Connect
- 7. Q-4 DC R&R A-4 DC APIIndex a document curl -X POST -u "{username}":"{password}" -F "file=@example.html" "https://gateway.watsonplatform.net/document-conversion/api/v1/index_document" 6 . 1
- 8. Q-5 DC R&R A-5 DC API dry_run true R&R R&R API : id title fileName sourceUrl flags Index a document Index documents 7 . 1
- 9. curl -X POST -u "{username}":"{password}" -F 'config={"retrieve_and_rank": {"dry_run": true}}' -F "file=@example.html" "https://gateway.watsonplatform.net/document-conversion/api/v1/index_document" curl -X POST -H "Content-Type: application/json" -u "{username}":"{password}" --data-binary @your_docs.json "https://gateway.watsonplatform.net/retrieve-and-rank/api/v1/solr_clusters/sc1ca23733_faa8_49ce_ 7 . 2
- 10. Q-6 R&R Solr A-6 R&R APISearch Solr standard query parser curl -X POST -u "{username}":"{password}" "https://gateway.watsonplatform.net/retrieve-and-rank/api/v1/solr_clusters/sc1ca23733_faa8_49ce_b3b6_ ?q=what%20is%20the%20basic%20mechanism%20of%20the%20transonic%20aileron%20buzz &wt=json" 8 . 1
- 11. Q-7 R&R Solr A-7 R&R APISearch Solr standard query parser https://${API_URL}?fl=id,title 9 . 1
- 12. Q-8 R&R Solr A-8 R&R API Solr Search Solr standard query parser https://${API_URL}?q=fileName:example.html 10 . 1
- 13. Q-9 R&R Solr A-9 R&R APIGet configuration curl -u "{username}":"{password}" -o example_config.zip "https://gateway.watsonplatform.net/retrieve-and-rank/api/v1/solr_clusters/sc1ca23733_faa8_49ce_ 11 . 1
- 14. Q-10 R&R Solr A-10 API API Get configuration Upload Solr configuration curl -X POST -H "Content-Type: application/zip" -u "{username}":"{password}" --data-binary @/configs/example_config.zip "https://gateway.watsonplatform.net/retrieve-and-rank/api/v1/solr_clusters/sc1ca23733_faa8_49ce_ 12 . 1
- 15. Q-11 R&R Solr Schema A-11 Solr contentType <field name="contentType" type="string" indexed="true" stored="true" multiValued="false"/>
- 16. Q-12 R&R Solr Schema Collection A-12 R&R APICreate Solr collection curl -X POST -u "{username}":"{password}" -d "action=CREATE&name=example_collection&collection.configName=example_config&wt=json" "https://gateway.watsonplatform.net/retrieve-and-rank/api/v1/solr_clusters/sc1ca23733_faa8_49ce_ 14 . 1
- 17. Q-13 R&R Ranker A-13 R&R APICreate ranker curl -X POST -u "{username}":"{password}" -F training_data=@train.csv -F training_metadata="{"name":"My ranker"}" "https://gateway.watsonplatform.net/retrieve-and-rank/api/v1/rankers" 15 . 1
- 18. Q-14 Ranker A-14 R&R APISearch and rank curl -X POST -u "{username}":"{password}" "https://gateway.watsonplatform.net/retrieve-and-rank/api/v1/solr_clusters/sc1ca23733_faa8_49ce_ ?ranker_id=B2E325-rank-67 &q=what%20is%20the%20basic%20mechanism%20of%20the%20transonic%20aileron%20buzz &wt=json" 16 . 1
- 20. Q-16 A-16 Bad knowhow 1. API 2. API 3. Search and rank 4. ID API Search and rank Search Solr standard query parser Search Solr standard query parser 18 . 1