Pa2 session 7
•Download as PPTX, PDF•
0 likes•70 views
The document provides a recap of different types of plots that can be used for data visualization including histograms, bar plots, scatter plots, and line plots. It also discusses evaluating machine learning models using metrics like confusion matrix, precision, recall, ROC curves, and for regression models RMSE, MSE, R2 score, explained and unexplained variance. Line plots allow specifying both the x and y axis. REST API outputs can be converted to a readable format using json.dumps().
Report
Share
Report
Share
Recommended
Krishankant Sharma Portfolio
i m constantly looking for a job and this this portfolio is to give you a deeper insight into my experience and skills I have gained over my recent history.
Schema Design by Chad Tindel, Solution Architect, 10gen
MongoDB’s basic unit of storage is a document. Documents can represent rich, schema-free data structures, meaning that we have several viable alternatives to the normalized, relational model. In this talk, we’ll discuss the tradeoff of various data modeling strategies in MongoDB using a library as a sample application. You will learn how to work with documents, evolve your schema, and common schema design patterns.
Advanced Crystal Reports: Techniques for compiling Annual Reports & other sta...
This document provides techniques for compiling annual reports and statistics using Crystal Reports. It includes examples of SQL views and stored procedures for creating reports on annual reports, statistics at a glance, eclipse reports tracking virtual and actual records, and exhibition status reports pulling data from a Thesaurus Management System (TMS). Formulas, grouping, sorting, and formatting are demonstrated.
Data recovery using pg_filedump
The document demonstrates how to recover data from PostgreSQL database files using the pg_filedump tool. It shows extracting table data and metadata like the table schema from the heap and system catalog files. Key points extracted include:
- pg_filedump can display formatted contents of PostgreSQL files including tables, indexes, and system catalogs
- Running pg_filedump on the table file extracted the table data including column types
- Further analysis of system catalog files using pg_filedump provided the table and column names and types to fully recover the table schema
R forecasting Example
This document describes using time series analysis in R to model and forecast tractor sales data. The sales data is transformed using logarithms and differencing to make it stationary. An ARIMA(0,1,1)(0,1,1)[12] model is fitted to the data and produces forecasts for 36 months ahead. The forecasts are plotted along with the original sales data and 95% prediction intervals.
Aileen heal postgis osmm cou
PostGIS is a spatial database extender for PostgreSQL that allows geographic queries. OS MasterMap is a UK database with 450 million mapped features. Updates are distributed as Change Only Updates (CoU) containing 6 million changed features rather than full datasets. AstunLoader loads CoU into PostGIS. PostgreSQL audit triggers and hstore record changes to tables, enabling creation of snapshots to view past data states. Snapshots combine audit data with current data excluding changed records.
pg_filedump
The document summarizes how to use the pg_filedump tool to recover data from PostgreSQL database files. It provides an example command to dump data from blocks containing integer, boolean, text and timestamp values. The output shows the recovered data includes two items - a text value and Russian text, with metadata on the block offsets, lengths and timestamps. Additional references are provided for more detailed articles on data recovery in Russian.
Header files of c++ unit 3 -topic 3
Header files contain function and variable definitions that are imported into C++ programs using the #include statement. Header files have a ".h" extension and declare functions and define macros. When a function is used in a C++ program, its definition must be imported from the library by including the appropriate header file. Common header files provide input/output operations (iostream.h), console input/output (conio.h), formatted I/O (iomanip.h), strings (string.h), mathematics functions (math.h), general purpose functions like memory management (stdlib.h), and random number generation (stdlib.h).
Recommended
Krishankant Sharma Portfolio
i m constantly looking for a job and this this portfolio is to give you a deeper insight into my experience and skills I have gained over my recent history.
Schema Design by Chad Tindel, Solution Architect, 10gen
MongoDB’s basic unit of storage is a document. Documents can represent rich, schema-free data structures, meaning that we have several viable alternatives to the normalized, relational model. In this talk, we’ll discuss the tradeoff of various data modeling strategies in MongoDB using a library as a sample application. You will learn how to work with documents, evolve your schema, and common schema design patterns.
Advanced Crystal Reports: Techniques for compiling Annual Reports & other sta...
This document provides techniques for compiling annual reports and statistics using Crystal Reports. It includes examples of SQL views and stored procedures for creating reports on annual reports, statistics at a glance, eclipse reports tracking virtual and actual records, and exhibition status reports pulling data from a Thesaurus Management System (TMS). Formulas, grouping, sorting, and formatting are demonstrated.
Data recovery using pg_filedump
The document demonstrates how to recover data from PostgreSQL database files using the pg_filedump tool. It shows extracting table data and metadata like the table schema from the heap and system catalog files. Key points extracted include:
- pg_filedump can display formatted contents of PostgreSQL files including tables, indexes, and system catalogs
- Running pg_filedump on the table file extracted the table data including column types
- Further analysis of system catalog files using pg_filedump provided the table and column names and types to fully recover the table schema
R forecasting Example
This document describes using time series analysis in R to model and forecast tractor sales data. The sales data is transformed using logarithms and differencing to make it stationary. An ARIMA(0,1,1)(0,1,1)[12] model is fitted to the data and produces forecasts for 36 months ahead. The forecasts are plotted along with the original sales data and 95% prediction intervals.
Aileen heal postgis osmm cou
PostGIS is a spatial database extender for PostgreSQL that allows geographic queries. OS MasterMap is a UK database with 450 million mapped features. Updates are distributed as Change Only Updates (CoU) containing 6 million changed features rather than full datasets. AstunLoader loads CoU into PostGIS. PostgreSQL audit triggers and hstore record changes to tables, enabling creation of snapshots to view past data states. Snapshots combine audit data with current data excluding changed records.
pg_filedump
The document summarizes how to use the pg_filedump tool to recover data from PostgreSQL database files. It provides an example command to dump data from blocks containing integer, boolean, text and timestamp values. The output shows the recovered data includes two items - a text value and Russian text, with metadata on the block offsets, lengths and timestamps. Additional references are provided for more detailed articles on data recovery in Russian.
Header files of c++ unit 3 -topic 3
Header files contain function and variable definitions that are imported into C++ programs using the #include statement. Header files have a ".h" extension and declare functions and define macros. When a function is used in a C++ program, its definition must be imported from the library by including the appropriate header file. Common header files provide input/output operations (iostream.h), console input/output (conio.h), formatted I/O (iomanip.h), strings (string.h), mathematics functions (math.h), general purpose functions like memory management (stdlib.h), and random number generation (stdlib.h).
Calculation Package
This document outlines a calculation package that will calculate totals and averages by product from a database source to a flat file destination. The target SQL code will select product IDs, sum quantities, sum total costs, and average cost from the TransactionHistoryArchive table, grouping by product ID and ordering by product ID. The data flow will calculate line item totals, sum quantities and totals by product, derive average costs, sort by product ID, and output to a flat file destination.
高速・省メモリにlibsvm形式で ダンプする方法を研究してみた
The document discusses using xgboost for machine learning and summarizes steps to prepare data for xgboost models. It recommends binding feature data together and writing it out in the libsvm format for efficient reading into an xgboost DMatrix object. It also suggests using the data.table package to write out libsvm files in parallel for improved performance on large datasets.
Endofday: A Container Workflow Engine for Scalable, Reproducible Computation
Slides for the lab journal club presenting the titled paper.
The paper is available here: http://ceur-ws.org/Vol-1871/paper6.pdf
Write a program that calculate the no of prime no,even and odd no.
This C++ program calculates the number of prime numbers, even numbers, and odd numbers in a linked list. It creates a linked list by prompting the user to input data nodes. It then traverses the list, counting the numbers of each type by checking each node's value. It outputs the final counts of prime, even, and odd numbers in the list.
Scraping in 60 minutes
The document discusses various tools that can be used for web scraping, including WYSIWYG tools like Import.io and Outwit Hub, Google Sheets import functions, and dedicated scraping tools like ScraperWiki and Morph.io. It also mentions Chrome extensions and using functions in Google Sheets like SUM, AVERAGE, and COUNTIF to scrape and analyze data. The document provides an overview of common terminology used for scraping like functions, arguments, parameters, strings, indexes, variables, and documentation.
Array using recursion
This program uses recursion to print the elements of an array. It takes in the array, number of elements, and initial index as parameters for the recursive function. The function prints the element at the current index, increments the index, and calls itself until the index equals the number of elements, at which point it returns without printing or recursing further.
A Shiny Example-- R
shiny Example in R.
source:https://plot.ly/r/shiny-coupled-hover-events/
prepared by Volkan OBAN
2 19-2018-mean of all runs
To calculate the arithmetic mean number of runs scored in cricket matches in 2016, the document describes using GNU coreutils and awk to: 1) sum the total runs scored by each team in each match from a data file; 2) divide the total runs by the number of matches to get the average runs per match; and 3) execute a command that outputs the result as 4.47776, which is the mean number of runs scored per game.
Quick 入門 | iOS RDD テストフレームワーク for Swift/Objective-C
The document discusses testing a counter class using the Quick and Nimble testing frameworks. It includes code for a Counter class with methods to count up, get the count, and reset. It also includes test code using the describe and context functions to define a test suite for the Counter class, with an example test to check that getCount() returns 0 initially.
Queue oop
The document discusses queues and their implementation. It defines a queue as a FIFO data structure where new items are added to the rear and removed from the front. Key queue operations are described like add, remove, isEmpty and isFull. The document then provides examples of implementing a queue using arrays and pointers in C++. It includes functions for initialization, insertion, removal, checking if empty, and printing all elements.
Altitude San Francisco 2018: WebAssembly Tools & Applications
This document provides a brief history of WebAssembly, including its origins in asm.js and progression through various compiler tools to the current WebAssembly standard. It discusses early implementations using asm.js for structured control flow and linear memory with isolated stacks. It also summarizes key compiler and tooling projects that have contributed to WebAssembly, such as Emscripten, Binaryen, Cranelift, Rust and WebAssembly, Pyodide, and WebAssembly Studio.
2 18-2018-all teams total runs
This document provides instructions to use GNU coreutils and command line tools to get a sorted list of the total runs scored for each team in 2016 from a data file. The user is instructed to use awk to add runs scored columns by team, then sort the output in descending order by total runs using sort.
Deep into Prometheus
This "Deep Into Prometheus" talk is the second part of our Prometheus & Monitoring series that is heavily built on the content from the Part I "Dip into Prometheus" webinar. It's strongly recommended to watch the Part I recording first is you missed it: https://youtu.be/lvogDmRN-Hs
In the "Deep Into Prometheus" meetup, I'm going deep into the Prometheus metrics data model. He will delve into how to design high-quality monitoring metrics and consume that data using PromQL while outlining how to avoid common "gotchas" while doing so.
Pratik Bakane C++
Pratik Bakane C++ programs...............This are programs desingedby sy diploma student from Governement Polytecnic Thane.....programsare very easy alongwith coding andscreen shot of the output
Bubble in link list
This document provides code to sort a linked list in ascending order using bubble sort. It defines a Node class with data and pointer properties. It then prompts the user to enter nodes, stores them in a linked list, and displays the unsorted list. The code implements bubble sort to iterate through the list, compare adjacent nodes, and swap values if out of order. Finally, it displays the sorted linked list.
Odoo Technical Concepts Summary
Odoo Technical Concepts Summary that helps new developers to summarize the needed concepts like fields types and their attributes and some other notes.
V8 javascript engine for フロントエンドデベロッパー
V8 is Google's open source JavaScript engine that is used in Chrome and Node.js. It uses several optimization techniques like hidden classes, inline caching, and TurboFan to improve JavaScript performance. V8 first parses JavaScript into an AST, then compiles it into bytecode which is executed by the Ignition bytecode interpreter or optimized by TurboFan into machine code using techniques like hidden classes to optimize property access and inline caching to optimize function calls.
R and cpp
R and C++ presentation given at the first RLyon meeting. Topics include Rcpp, Rcpp11, C++11 and dplyr.
JCConf 2020 - New Java Features Released in 2020
The document discusses new features in Java releases from JDK 13 to JDK 15, including syntax changes like switch expressions and text blocks, API changes like helpful NullPointerExceptions and reimplementing sockets, and improvements to garbage collectors like ZGC and NUMA-aware memory allocation for G1. It provides code examples to demonstrate the new features and explains their motivations and impacts.
34. Cam is a mechanical device that transforms rotary motion into lin.pdf
34. Cam is a mechanical device that transforms rotary motion into linear motion. The shape of
the disc is designed to produce a specified displacement pro- file. A displacement profile is a plot
of the dis- placement of the follower as a function of the angle of rotation of the cam The motion
of a cer- tain cam is given by the following equations: y 6120-0.5 sinej for 0s es y 6 for 1/2 se
s21 /3 for 2R/3ses 6-3 1-0.5cos 3 6-2 3 for 4R/3 so s /2 for 31 /2s0s7R/4 1/4 for 71e KAS les 2T
y 0.75 0.75 1
Solution
the following matlab program is developed globally for any cam profile with changable
parameters as output in matlab interface- function cams(varargin) global S %{ Cam Simulator
To launch, simply type cams in the MATLAB command window with this in the current
directory. Alternatively, you can choose Debug -> Run from this editor window, or press F5.
Helpful Notes: - The first edit box column is to contain the motion type(s). Each row of it
should have one of the preset motions written inside it (SHM, CYC, etc...). - The second edit
box is to specify the duration of each of the motion types. Each row should contain a duration
in degrees for the corresponding respective motion type. - The third edit box contains the
respective displacemens for the motion types. - The durations (second box) have to add up to
360 degrees. Also, while not necessary in the typical sense, the displacements should generally
add up to 0. - To understand more, see one of the pre-set examples found at File -> Load. - As
for the axis limits, the first is offline at the current time. The second changes the axis for the
second plot (Velocity) and the third for the third plot (Acceleration). - The number under
\'Res\' changes the number of points for drawing the cam profile. It is the top critereon for the
load time above it. - You can change the speed of rotation (Fast, Slow, Pause) during animation.
- Any comments should be sent to . Don\'t hesitate to send! - Recommended resolution is 1280
by 800 pixels. - Works only on MATLAB 7.4 (R2007a) and above. %} %% Main Figure and
Menus figure(\'units\',\'normalized\',... \'position\',[.1 .1 .8 .75],... \'color\',\'w\',...
\'numbertitle\',\'off\',... \'menubar\',\'none\',... \'name\',\'Cam Simulator\')
m1=uimenu(\'Label\',\'File\'); m2=uimenu(\'Label\',\'More\'); % when you click on a menu the
code go to its corresponding callback function uimenu(m1,\'Label\',\'Save
Model\',\'Callback\',@savv); uimenu(m1,\'Label\',\'Load
Model\',\'Callback\',@ladd,\'Separator\',\'on\');
uimenu(m1,\'Label\',\'Quit\',\'Callback\',@xq,\'Separator\',\'on\');
uimenu(m2,\'Label\',\'About\',\'Callback\',@bott); %% File -> quit function xq(varargin)
close(gcf) end %% File -> Save function savv(varargin) % make a
small figure with a button, text and edit figure(\'units\',\'normalized\',\'position\',[0.1 .6
.2 .2],\'color\',\'w\',\'numbertitle\',\'off\',\'menubar\',\'none\',\'name\',\'Save\')
uicontrol(\'style\',\'text\',\'units\',\'normalized\',\'positi.
Jackson beyond JSON: XML, CSV
While known for its first-class JSON handling for Java, Jackson is not limited to JSON: with no fewer than 9 supported data formats it can be used for reading and writing data in almost any data format. This talk offers introduction to reading and writing XML and CSV using Jackson.
SVGo: a Go Library for SVG generation
The document introduces SVGo, a Go library for generating SVG drawings programmatically. It demonstrates how to use SVGo to create basic shapes like rectangles and lines, add attributes, apply transformations, and script interactions. The goal of SVGo is to allow generating consistent SVG views from standardized data.
More Related Content
What's hot
Calculation Package
This document outlines a calculation package that will calculate totals and averages by product from a database source to a flat file destination. The target SQL code will select product IDs, sum quantities, sum total costs, and average cost from the TransactionHistoryArchive table, grouping by product ID and ordering by product ID. The data flow will calculate line item totals, sum quantities and totals by product, derive average costs, sort by product ID, and output to a flat file destination.
高速・省メモリにlibsvm形式で ダンプする方法を研究してみた
The document discusses using xgboost for machine learning and summarizes steps to prepare data for xgboost models. It recommends binding feature data together and writing it out in the libsvm format for efficient reading into an xgboost DMatrix object. It also suggests using the data.table package to write out libsvm files in parallel for improved performance on large datasets.
Endofday: A Container Workflow Engine for Scalable, Reproducible Computation
Slides for the lab journal club presenting the titled paper.
The paper is available here: http://ceur-ws.org/Vol-1871/paper6.pdf
Write a program that calculate the no of prime no,even and odd no.
This C++ program calculates the number of prime numbers, even numbers, and odd numbers in a linked list. It creates a linked list by prompting the user to input data nodes. It then traverses the list, counting the numbers of each type by checking each node's value. It outputs the final counts of prime, even, and odd numbers in the list.
Scraping in 60 minutes
The document discusses various tools that can be used for web scraping, including WYSIWYG tools like Import.io and Outwit Hub, Google Sheets import functions, and dedicated scraping tools like ScraperWiki and Morph.io. It also mentions Chrome extensions and using functions in Google Sheets like SUM, AVERAGE, and COUNTIF to scrape and analyze data. The document provides an overview of common terminology used for scraping like functions, arguments, parameters, strings, indexes, variables, and documentation.
Array using recursion
This program uses recursion to print the elements of an array. It takes in the array, number of elements, and initial index as parameters for the recursive function. The function prints the element at the current index, increments the index, and calls itself until the index equals the number of elements, at which point it returns without printing or recursing further.
A Shiny Example-- R
shiny Example in R.
source:https://plot.ly/r/shiny-coupled-hover-events/
prepared by Volkan OBAN
2 19-2018-mean of all runs
To calculate the arithmetic mean number of runs scored in cricket matches in 2016, the document describes using GNU coreutils and awk to: 1) sum the total runs scored by each team in each match from a data file; 2) divide the total runs by the number of matches to get the average runs per match; and 3) execute a command that outputs the result as 4.47776, which is the mean number of runs scored per game.
Quick 入門 | iOS RDD テストフレームワーク for Swift/Objective-C
The document discusses testing a counter class using the Quick and Nimble testing frameworks. It includes code for a Counter class with methods to count up, get the count, and reset. It also includes test code using the describe and context functions to define a test suite for the Counter class, with an example test to check that getCount() returns 0 initially.
Queue oop
The document discusses queues and their implementation. It defines a queue as a FIFO data structure where new items are added to the rear and removed from the front. Key queue operations are described like add, remove, isEmpty and isFull. The document then provides examples of implementing a queue using arrays and pointers in C++. It includes functions for initialization, insertion, removal, checking if empty, and printing all elements.
Altitude San Francisco 2018: WebAssembly Tools & Applications
This document provides a brief history of WebAssembly, including its origins in asm.js and progression through various compiler tools to the current WebAssembly standard. It discusses early implementations using asm.js for structured control flow and linear memory with isolated stacks. It also summarizes key compiler and tooling projects that have contributed to WebAssembly, such as Emscripten, Binaryen, Cranelift, Rust and WebAssembly, Pyodide, and WebAssembly Studio.
2 18-2018-all teams total runs
This document provides instructions to use GNU coreutils and command line tools to get a sorted list of the total runs scored for each team in 2016 from a data file. The user is instructed to use awk to add runs scored columns by team, then sort the output in descending order by total runs using sort.
Deep into Prometheus
This "Deep Into Prometheus" talk is the second part of our Prometheus & Monitoring series that is heavily built on the content from the Part I "Dip into Prometheus" webinar. It's strongly recommended to watch the Part I recording first is you missed it: https://youtu.be/lvogDmRN-Hs
In the "Deep Into Prometheus" meetup, I'm going deep into the Prometheus metrics data model. He will delve into how to design high-quality monitoring metrics and consume that data using PromQL while outlining how to avoid common "gotchas" while doing so.
Pratik Bakane C++
Pratik Bakane C++ programs...............This are programs desingedby sy diploma student from Governement Polytecnic Thane.....programsare very easy alongwith coding andscreen shot of the output
Bubble in link list
This document provides code to sort a linked list in ascending order using bubble sort. It defines a Node class with data and pointer properties. It then prompts the user to enter nodes, stores them in a linked list, and displays the unsorted list. The code implements bubble sort to iterate through the list, compare adjacent nodes, and swap values if out of order. Finally, it displays the sorted linked list.
Odoo Technical Concepts Summary
Odoo Technical Concepts Summary that helps new developers to summarize the needed concepts like fields types and their attributes and some other notes.
What's hot (16)
Endofday: A Container Workflow Engine for Scalable, Reproducible Computation
Endofday: A Container Workflow Engine for Scalable, Reproducible Computation
Write a program that calculate the no of prime no,even and odd no.
Write a program that calculate the no of prime no,even and odd no.
Quick 入門 | iOS RDD テストフレームワーク for Swift/Objective-C
Quick 入門 | iOS RDD テストフレームワーク for Swift/Objective-C
Altitude San Francisco 2018: WebAssembly Tools & Applications
Altitude San Francisco 2018: WebAssembly Tools & Applications
Similar to Pa2 session 7
V8 javascript engine for フロントエンドデベロッパー
V8 is Google's open source JavaScript engine that is used in Chrome and Node.js. It uses several optimization techniques like hidden classes, inline caching, and TurboFan to improve JavaScript performance. V8 first parses JavaScript into an AST, then compiles it into bytecode which is executed by the Ignition bytecode interpreter or optimized by TurboFan into machine code using techniques like hidden classes to optimize property access and inline caching to optimize function calls.
R and cpp
R and C++ presentation given at the first RLyon meeting. Topics include Rcpp, Rcpp11, C++11 and dplyr.
JCConf 2020 - New Java Features Released in 2020
The document discusses new features in Java releases from JDK 13 to JDK 15, including syntax changes like switch expressions and text blocks, API changes like helpful NullPointerExceptions and reimplementing sockets, and improvements to garbage collectors like ZGC and NUMA-aware memory allocation for G1. It provides code examples to demonstrate the new features and explains their motivations and impacts.
34. Cam is a mechanical device that transforms rotary motion into lin.pdf
34. Cam is a mechanical device that transforms rotary motion into linear motion. The shape of
the disc is designed to produce a specified displacement pro- file. A displacement profile is a plot
of the dis- placement of the follower as a function of the angle of rotation of the cam The motion
of a cer- tain cam is given by the following equations: y 6120-0.5 sinej for 0s es y 6 for 1/2 se
s21 /3 for 2R/3ses 6-3 1-0.5cos 3 6-2 3 for 4R/3 so s /2 for 31 /2s0s7R/4 1/4 for 71e KAS les 2T
y 0.75 0.75 1
Solution
the following matlab program is developed globally for any cam profile with changable
parameters as output in matlab interface- function cams(varargin) global S %{ Cam Simulator
To launch, simply type cams in the MATLAB command window with this in the current
directory. Alternatively, you can choose Debug -> Run from this editor window, or press F5.
Helpful Notes: - The first edit box column is to contain the motion type(s). Each row of it
should have one of the preset motions written inside it (SHM, CYC, etc...). - The second edit
box is to specify the duration of each of the motion types. Each row should contain a duration
in degrees for the corresponding respective motion type. - The third edit box contains the
respective displacemens for the motion types. - The durations (second box) have to add up to
360 degrees. Also, while not necessary in the typical sense, the displacements should generally
add up to 0. - To understand more, see one of the pre-set examples found at File -> Load. - As
for the axis limits, the first is offline at the current time. The second changes the axis for the
second plot (Velocity) and the third for the third plot (Acceleration). - The number under
\'Res\' changes the number of points for drawing the cam profile. It is the top critereon for the
load time above it. - You can change the speed of rotation (Fast, Slow, Pause) during animation.
- Any comments should be sent to . Don\'t hesitate to send! - Recommended resolution is 1280
by 800 pixels. - Works only on MATLAB 7.4 (R2007a) and above. %} %% Main Figure and
Menus figure(\'units\',\'normalized\',... \'position\',[.1 .1 .8 .75],... \'color\',\'w\',...
\'numbertitle\',\'off\',... \'menubar\',\'none\',... \'name\',\'Cam Simulator\')
m1=uimenu(\'Label\',\'File\'); m2=uimenu(\'Label\',\'More\'); % when you click on a menu the
code go to its corresponding callback function uimenu(m1,\'Label\',\'Save
Model\',\'Callback\',@savv); uimenu(m1,\'Label\',\'Load
Model\',\'Callback\',@ladd,\'Separator\',\'on\');
uimenu(m1,\'Label\',\'Quit\',\'Callback\',@xq,\'Separator\',\'on\');
uimenu(m2,\'Label\',\'About\',\'Callback\',@bott); %% File -> quit function xq(varargin)
close(gcf) end %% File -> Save function savv(varargin) % make a
small figure with a button, text and edit figure(\'units\',\'normalized\',\'position\',[0.1 .6
.2 .2],\'color\',\'w\',\'numbertitle\',\'off\',\'menubar\',\'none\',\'name\',\'Save\')
uicontrol(\'style\',\'text\',\'units\',\'normalized\',\'positi.
Jackson beyond JSON: XML, CSV
While known for its first-class JSON handling for Java, Jackson is not limited to JSON: with no fewer than 9 supported data formats it can be used for reading and writing data in almost any data format. This talk offers introduction to reading and writing XML and CSV using Jackson.
SVGo: a Go Library for SVG generation
The document introduces SVGo, a Go library for generating SVG drawings programmatically. It demonstrates how to use SVGo to create basic shapes like rectangles and lines, add attributes, apply transformations, and script interactions. The goal of SVGo is to allow generating consistent SVG views from standardized data.
Introduction to MongoDB
- MongoDB is a document-oriented, non-relational database that scales horizontally and uses JSON-like documents with dynamic schemas.
- It offers features like embedded documents, indexing, replication, and sharding.
- Documents are stored and queried using simple statements in a JavaScript-like syntax interface.
2011 Mongo FR - MongoDB introduction
- MongoDB is a non-relational, document-oriented database that scales horizontally and uses JSON-like documents with dynamic schemas.
- It supports complex queries, embedded documents and arrays, and aggregation and MapReduce for querying and transforming data.
- MongoDB is used by many large companies for operational databases and analytics due to its scalability, flexibility, and performance.
RSROC 2015 - AutoHotKey
This document discusses using the AutoHotKey utility to improve radiology reporting workflow. AutoHotKey allows automating repetitive tasks in Windows. Examples provided include autocompleting common phrases and strings, manipulating text, sending mouse clicks and movements, accessing the COM model to control Internet Explorer, and controlling webpages using JavaScript and the HTML DOM. The document provides code samples for these tasks and discusses how AutoHotKey can be used to copy prior reports, inject JavaScript, access window objects, and calculate window positions. Limitations include being Windows only and a learning curve, but benefits include being free, increasing reporting efficiency, and having basic programming capabilities.
Webinar: Index Tuning and Evaluation
I inherited a MongoDB database server with 60 collections and 100 or so indexes.
The business users are complaining about slow report completion times. What can I do to improve performance?
R and C++
- Rcpp is a package that facilitates interoperability between R and C++ by providing data structures and functions that make it easy to write C++ code that integrates with R. It has been released 54 times since 2008 with over 170 CRAN packages depending on it.
- Rcpp allows users to source C++ code from R using sourceCpp() and export C++ functions to R using attributes like // [[Rcpp::export]]. This improves performance over pure R code by leveraging fast C++ implementations.
- dplyr is a popular R package for data manipulation that achieves great performance through its use of Rcpp. Functions like arrange(), filter(), and summarise() are much faster when
Pwning in c++ (basic)
The document discusses C++ exploitation techniques including name mangling, virtual function tables, vtable hijacking, vectors, strings, and memory allocation/deallocation functions like new and delete. It provides details on how virtual function tables are used to implement polymorphism in C++ and how vtable hijacking can be used to exploit vulnerabilities by forcing a vtable and hijacking the virtual function pointer to call shellcode. It also explains how vectors and strings are implemented dynamically in memory and their memory layout.
Introduction to Structured Streaming
Structured Streaming is a scalable and fault-tolerant stream processing engine built on the Spark SQL engine.
Streaming Operational Data with MariaDB MaxScale
MariaDB experts explain how to stream data using MariaDB MaxScale, a database proxy that can vastly improve your server's transactional data processing without sacrificing scalability, security or speed. In this webinar, learn how to use MaxScale to convert data to JSON documents or AVRO objects, and watch as MariaDB's senior software engineers do a live demo of how to use the Kafka producer.
Watch the webinar here: https://mariadb.com/resources/webinars/streaming-operational-data-mariadb-maxscale
ログ収集プラットフォーム開発におけるElasticsearchの運用
齋藤 智之 (LINE株式会社 開発3室)
ログ収集プラットフォーム開発におけるElasticsearchの運用
LINE Developer Meetup in Tokyo #27 -Elastic-の発表資料です
https://line.connpass.com/event/76226/
A Replay Approach to Software Validation
The document discusses a replay approach to software validation using regular expressions in C++11 and Python. It describes replaying log files to recreate events and find bugs faster. It also explains how regular expressions can be used to parse log files and validate replayed logs by comparing them to the originals. Regular expressions in C++11 and Python are compatible, which is useful for cross-language validation tools.
Finding Xori: Malware Analysis Triage with Automated Disassembly
In a world of high volume malware and limited researchers, we need a dramatic improvement in our ability to process and analyze new and old malware at scale. Unfortunately, what is currently available to the community is incredibly cost prohibitive or does not rise to the challenge. As malware authors and distributors share code and prepackaged tool kits, the white hat community is dominated by solutions aimed at profit as opposed to augmenting capabilities available to the broader community. With that in mind, we are introducing our library for malware disassembly called Xori as an open source project. Xori is focused on helping reverse engineers analyze binaries, optimizing for time and effort spent per sample.
Xori is an automation-ready disassembly and static analysis library that consumes shellcode or PE binaries and provides triage analysis data. This Rust library emulates the stack, register states, and reference tables to identify suspicious functionality for manual analysis. Xori extracts structured data from binaries to use in machine learning and data science pipelines.
We will go over the pain-points of conventional open source disassemblers that Xori solves, examples of identifying suspicious functionality, and some of the interesting things we've done with the library. We invite everyone in the community to use it, help contribute and make it an increasingly valuable tool in this arms race.
Building a SIMD Supported Vectorized Native Engine for Spark SQL
Spark SQL works very well with structured row-based data. Vectorized reader and writer for parquet/orc can make I/O much faster. It also used WholeStageCodeGen to improve the performance by Java JIT code. However Java JIT is usually not working very well on utilizing latest SIMD instructions under complicated queries. Apache Arrow provides columnar in-memory layout and SIMD optimized kernels as well as a LLVM based SQL engine Gandiva. These native based libraries can accelerate Spark SQL by reduce the CPU usage for both I/O and execution.
Ge aviation spark application experience porting analytics into py spark ml p...
GE is a world leader in the manufacture of commercial jet engines, offering products for many of the best-selling commercial airframes. With more than 33,000 engines in service, GE Aviation has a history of developing analytics for monitoring its commercial engines fleets. In recent years, GE Aviation Digital has developed advanced analytic solutions for engine monitoring, with the target of improving detection and reducing false alerts, when compared to conventional analytic approaches. The advanced analytics are implemented in a real-time monitoring system which notifies GE’s Fleet Support team on a per flight basis. These analytics are developed and validated using large, historical datasets.
Analytic tools such as SQL Server and MATLAB were used until recently, when GE’s data was moved to an Apache Spark environment. Consequently, our advanced analytics are now being migrated to Spark, where there should also be performance gains with bigger data sets. In this talk we will share experiences of converting our advanced algorithms to custom Spark ML pipelines, as well as outlining various case studies.
With Honor Powrie and Peter Knight
Finding Xori: Malware Analysis Triage with Automated Disassembly
"In a world of high volume malware and limited researchers we need a dramatic improvement in our ability to process and analyze new and old malware at scale. Unfortunately what is currently available to the community is incredibly cost prohibitive or does not rise to the challenge. As malware authors and distributors share code and prepackaged tool kits, the corporate sponsored research community is dominated by solutions aimed at profit as opposed to augmenting capabilities available to the broader community. With that in mind, we are introducing our library for malware disassembly called Xori as an open source project. Xori is focused on helping reverse engineers analyze binaries, optimizing for time and effort spent per sample.
Xori is an automation-ready disassembly and static analysis library that consumes shellcode or PE binaries and provides triage analysis data. This Rust library emulates the stack, register states, and reference tables to identify suspicious functionality for manual analysis. Xori extracts structured data from binaries to use in machine learning and data science pipelines.
We will go over the pain-points of conventional open source disassemblers that Xori solves, examples of identifying suspicious functionality, and some of the interesting things we've done with the library. We invite everyone in the community to use it, help contribute and make it an increasingly valuable tool for researchers alike."
Similar to Pa2 session 7 (20)
34. Cam is a mechanical device that transforms rotary motion into lin.pdf
34. Cam is a mechanical device that transforms rotary motion into lin.pdf
Finding Xori: Malware Analysis Triage with Automated Disassembly
Finding Xori: Malware Analysis Triage with Automated Disassembly
Building a SIMD Supported Vectorized Native Engine for Spark SQL
Building a SIMD Supported Vectorized Native Engine for Spark SQL
Ge aviation spark application experience porting analytics into py spark ml p...
Ge aviation spark application experience porting analytics into py spark ml p...
Finding Xori: Malware Analysis Triage with Automated Disassembly
Finding Xori: Malware Analysis Triage with Automated Disassembly
More from aiclub_slides
Linear regression middleschool
The document discusses linear regression, a type of supervised machine learning algorithm. It can be used to predict a numeric label given input features. The document provides examples of using linear regression to model relationships between features like square footage and home price. It also explains that calculating an average is a simple form of linear regression, with weights of 1/n for each input value.
Pa2 project template
The document provides guidance for students to describe an AI application they created. It prompts them to provide information such as the name of the app and student, an overview of the app's architecture and how the AI interacts with it, descriptions and plots of their labeled data distribution and important features, how they trained their AI including metrics and analysis of different feature engineering steps, plans for improving the app, and a demo.
Knn intro advanced_middleschool
This document discusses the K-Nearest Neighbors (KNN) classification algorithm. It provides an example dataset classifying individuals as "adult" or "child" based on their years in school and height. It then demonstrates how KNN would classify a new data point based on different values of K. The document also discusses a regression dataset to predict house prices based on square footage and age. It explains how to evaluate different values of K through hyperparameter tuning and applies KNN to predict the price of a new house. In the end, it notes a drawback of KNN related to scaling of different features.
M1 regression metrics_middleschool
This document discusses metrics for evaluating predictive performance in regression models. It explains that accuracy is used for classification models, while regression models are evaluated based on the errors between predicted versus true values. Specifically, mean absolute error, mean squared error, and root mean square error are introduced as common metrics, where errors are calculated as the absolute or squared differences between predictions and true values, and then averaged. Examples are provided to demonstrate calculating these error metrics.
Pa1 json requests
The document discusses using Python modules like JSON and Requests to interact with APIs and AI models. It explains that JSON is commonly used to transmit data over the web and can be dumped and loaded from Python dictionaries and strings. The Requests module allows sending HTTP requests in Python to APIs and AI services. It provides an example of sending a request to a mood analysis AI with a payload containing sentence data and converting the response. The document also outlines steps for connecting an AI model in Navigator to a Python application using the integration code snippet.
Mnist images
The document introduces the MNIST dataset which contains images of handwritten digits with a black background at a very low resolution of 28x28 pixels. The MNIST dataset contains 10 categories of numbers from 0 to 9 that are used for machine learning tasks involving image classification.
Mnist images
The document introduces the MNIST dataset which contains images of handwritten digits with a black background at a very low resolution of 28x28 pixels. The MNIST dataset contains 10 categories of numbers from 0 to 9 which are used to train machine learning models to recognize handwritten digits.
Ai in real life face detection
The document discusses facial recognition AI and its applications in daily life. It explains how facial recognition AI can find people in crowds and identify emotions. It also raises some privacy concerns, asking if people would be upset if their picture was tracked in public or if shops identified customers by their face without permission. The document promotes an AI club and provides contact information.
Cnn
This document discusses convolutional neural networks (CNNs) and how they process images without flattening the image into a single vector like multilayer perceptrons (MLPs) do. It provides examples of CNN weight matrices and explains that CNNs apply weights to nodes in local regions of the image rather than a single node. The document also notes that many types of CNNs exist that differ in their architecture, layers, connections, and other attributes.
Res net high level intro
This document provides a high-level introduction to Residual Neural Networks (ResNets). ResNets allow for very deep neural networks with many layers by introducing shortcut connections that skip layers, enabling the flow of gradients across many layers. This architecture has enabled the creation of neural networks with over 100 layers that were able to achieve state-of-the-art results on image recognition tasks. ResNets demonstrate that very deep neural networks can be effectively trained if they contain shortcuts for the gradients to flow across many layers.
Neural networks and flattened images
The document discusses how images are used as inputs for neural networks. It explains that images need to be flattened into individual numbers before being input into the first layer. This flattening process takes a multi-dimensional array and converts it into a one-dimensional vector. An example is provided of a 2D array being flattened into a single list of numbers that can then be input to the neural network.
What is a_neural_network
Neural networks and deep learning use networks of neurons that can learn from large amounts of data. A basic neuron receives multiple inputs which it multiplies by weights and combines to produce an output. Neural networks contain many interconnected neurons arranged in layers that can learn increasingly complex patterns from data. Deep learning uses neural networks with many hidden layers to perform tasks like image recognition by learning from large datasets.
How neural networks learn part iii
The document discusses key concepts in neural network training including weights, stochastic gradient descent, learning rate, mini-batch size, and epochs. Weights in a neural network are adjusted during training to minimize loss, using stochastic gradient descent. The learning rate determines how much weights are adjusted with each pass of data. Mini-batch size refers to the number of samples used to calculate weight updates in each iteration. Epochs refer to the number of times the full training data is passed through the network. The optimal values for these hyperparameters depend on factors like the dataset and model architecture.
Introduction to deep learning image classification
The document provides an introduction to image classification and deep learning. It defines AI, machine learning, and deep learning, with deep learning using neural networks to be well-suited for tasks like image, sound, and video recognition. Image classification is described as using deep learning to categorize images into categories like cats versus dogs, and can involve more than two categories. Performance of deep learning image classification models is measured using classification accuracy metrics.
Accuracy middleschool
The document discusses how to measure the accuracy of a machine learning model. It explains that a validation or test dataset should be created from a portion of the training data and held aside for testing. The model makes predictions on the validation data and its predictions are compared to the actual labels to calculate accuracy. Accuracy is determined by taking the number of correct predictions divided by the total number of predictions. A higher accuracy percentage indicates the model is better at making correct predictions. The example shown calculates an accuracy of 75% for a model that made 3 correct predictions out of 4 total in the validation dataset.
Introduction to classification_middleschool
Classification is a type of supervised machine learning that predicts categorical output variables. It involves using labeled examples to train a model to classify new examples. Some key points:
- Classification predicts categories like good/bad, cat/dog rather than continuous values
- It requires labeled training data that maps features to categories
- Features can be any data type like numbers, text, categories
- Models are trained to learn patterns in features to classify new unlabeled examples
- Common applications include image recognition, sentiment analysis, medical diagnosis
Introduction to the cloud
The document provides an introduction to cloud computing, data centers, and neural networks and their relationship to artificial intelligence. It defines the cloud as computers, storage, and apps accessed over the internet, and data centers as large facilities housing hundreds of thousands of computers that power the cloud. Neural networks are also introduced as relevant to AI, with the key point being that artificial intelligence applications often run in the cloud using powerful hardware like GPUs in data centers.
Basics of data
The document discusses the basics of data and AI. It explains that data contains rows and columns, with each row representing an example for the AI to train on. Features describe the examples, while labels categorize them. It provides an example of using text data describing feelings as features to train a model to predict if a feeling is happy or sad. The document also defines an AI service as a program that takes new questions or data as input and uses a pre-trained model to generate predictions or answers that can be used by an application.
Ai basics
The document discusses artificial intelligence and machine learning. It defines AI as how computers mimic human brains, and provides examples like Google Translate, Alexa, and Siri. Machine learning is described as a subset of AI where machines learn from data, and can be supervised by providing examples, unsupervised with no information given, or reinforcement using a reward system. Deep learning is presented as a sophisticated version of machine learning.
Ai lifecycle and navigator
The document discusses the AI workflow and different software options that can be used. The typical AI workflow involves identifying a problem, preparing data, developing and training models, testing models, deploying models, connecting to applications, and monitoring and optimizing models in an iterative process. It then shows diagrams of different software flows using Amazon SageMaker and Scikit-Learn Serverless for AWS, Google Cloud AI Platform for Google Cloud, and using AWS services like S3, SageMaker, and Lambda. It promotes the company's own AI Navigator software for building, deploying, and managing AI applications on AWS at scale.
More from aiclub_slides (20)
Introduction to deep learning image classification
Introduction to deep learning image classification
Recently uploaded
Benner "Expanding Pathways to Publishing Careers"
This presentation was provided by Rebecca Benner, Ph.D., of the American Society of Anesthesiologists, for the second session of NISO's 2024 Training Series "DEIA in the Scholarly Landscape." Session Two: 'Expanding Pathways to Publishing Careers,' was held June 13, 2024.
A Visual Guide to 1 Samuel | A Tale of Two Hearts
These slides walk through the story of 1 Samuel. Samuel is the last judge of Israel. The people reject God and want a king. Saul is anointed as the first king, but he is not a good king. David, the shepherd boy is anointed and Saul is envious of him. David shows honor while Saul continues to self destruct.
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
Physical pharmaceutics notes for B.pharm students
skeleton System.pdf (skeleton system wow)
🔥🔥🔥🔥🔥🔥🔥🔥🔥
إضغ بين إيديكم من أقوى الملازم التي صممتها
ملزمة تشريح الجهاز الهيكلي (نظري 3)
💀💀💀💀💀💀💀💀💀💀
تتميز هذهِ الملزمة بعِدة مُميزات :
1- مُترجمة ترجمة تُناسب جميع المستويات
2- تحتوي على 78 رسم توضيحي لكل كلمة موجودة بالملزمة (لكل كلمة !!!!)
#فهم_ماكو_درخ
3- دقة الكتابة والصور عالية جداً جداً جداً
4- هُنالك بعض المعلومات تم توضيحها بشكل تفصيلي جداً (تُعتبر لدى الطالب أو الطالبة بإنها معلومات مُبهمة ومع ذلك تم توضيح هذهِ المعلومات المُبهمة بشكل تفصيلي جداً
5- الملزمة تشرح نفسها ب نفسها بس تكلك تعال اقراني
6- تحتوي الملزمة في اول سلايد على خارطة تتضمن جميع تفرُعات معلومات الجهاز الهيكلي المذكورة في هذهِ الملزمة
واخيراً هذهِ الملزمة حلالٌ عليكم وإتمنى منكم إن تدعولي بالخير والصحة والعافية فقط
كل التوفيق زملائي وزميلاتي ، زميلكم محمد الذهبي 💊💊
🔥🔥🔥🔥🔥🔥🔥🔥🔥
Stack Memory Organization of 8086 Microprocessor
The stack memory organization of 8086 microprocessor.
How to Predict Vendor Bill Product in Odoo 17
This slide will guide us through the process of predicting vendor bill products based on previous purchases from the vendor in Odoo 17.
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
Practical manual for National Examination Council, Nigeria.
Contains guides on answering questions on the specimens provided
Gender and Mental Health - Counselling and Family Therapy Applications and In...
A proprietary approach developed by bringing together the best of learning theories from Psychology, design principles from the world of visualization, and pedagogical methods from over a decade of training experience, that enables you to: Learn better, faster!
How to deliver Powerpoint Presentations.pptx
"How to make and deliver dynamic presentations by making it more interactive to captivate your audience attention"
Educational Technology in the Health Sciences
Plenary presentation at the NTTC Inter-university Workshop, 18 June 2024, Manila Prince Hotel.
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...Nguyen Thanh Tu Collection
https://app.box.com/s/qhtvq32h4ybf9t49ku85x0n3xl4jhr15Leveraging Generative AI to Drive Nonprofit Innovation
In this webinar, participants learned how to utilize Generative AI to streamline operations and elevate member engagement. Amazon Web Service experts provided a customer specific use cases and dived into low/no-code tools that are quick and easy to deploy through Amazon Web Service (AWS.)
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
Andreas Schleicher, Director of Education and Skills at the OECD presents at the launch of PISA 2022 Volume III - Creative Minds, Creative Schools on 18 June 2024.
Walmart Business+ and Spark Good for Nonprofits.pdf
"Learn about all the ways Walmart supports nonprofit organizations.
You will hear from Liz Willett, the Head of Nonprofits, and hear about what Walmart is doing to help nonprofits, including Walmart Business and Spark Good. Walmart Business+ is a new offer for nonprofits that offers discounts and also streamlines nonprofits order and expense tracking, saving time and money.
The webinar may also give some examples on how nonprofits can best leverage Walmart Business+.
The event will cover the following::
Walmart Business + (https://business.walmart.com/plus) is a new shopping experience for nonprofits, schools, and local business customers that connects an exclusive online shopping experience to stores. Benefits include free delivery and shipping, a 'Spend Analytics” feature, special discounts, deals and tax-exempt shopping.
Special TechSoup offer for a free 180 days membership, and up to $150 in discounts on eligible orders.
Spark Good (walmart.com/sparkgood) is a charitable platform that enables nonprofits to receive donations directly from customers and associates.
Answers about how you can do more with Walmart!"
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
(𝐓𝐋𝐄 𝟏𝟎𝟎) (𝐋𝐞𝐬𝐬𝐨𝐧 𝟏)-𝐏𝐫𝐞𝐥𝐢𝐦𝐬
𝐃𝐢𝐬𝐜𝐮𝐬𝐬 𝐭𝐡𝐞 𝐄𝐏𝐏 𝐂𝐮𝐫𝐫𝐢𝐜𝐮𝐥𝐮𝐦 𝐢𝐧 𝐭𝐡𝐞 𝐏𝐡𝐢𝐥𝐢𝐩𝐩𝐢𝐧𝐞𝐬:
- Understand the goals and objectives of the Edukasyong Pantahanan at Pangkabuhayan (EPP) curriculum, recognizing its importance in fostering practical life skills and values among students. Students will also be able to identify the key components and subjects covered, such as agriculture, home economics, industrial arts, and information and communication technology.
𝐄𝐱𝐩𝐥𝐚𝐢𝐧 𝐭𝐡𝐞 𝐍𝐚𝐭𝐮𝐫𝐞 𝐚𝐧𝐝 𝐒𝐜𝐨𝐩𝐞 𝐨𝐟 𝐚𝐧 𝐄𝐧𝐭𝐫𝐞𝐩𝐫𝐞𝐧𝐞𝐮𝐫:
-Define entrepreneurship, distinguishing it from general business activities by emphasizing its focus on innovation, risk-taking, and value creation. Students will describe the characteristics and traits of successful entrepreneurs, including their roles and responsibilities, and discuss the broader economic and social impacts of entrepreneurial activities on both local and global scales.
Recently uploaded (20)
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
BIOLOGY NATIONAL EXAMINATION COUNCIL (NECO) 2024 PRACTICAL MANUAL.pptx
Gender and Mental Health - Counselling and Family Therapy Applications and In...
Gender and Mental Health - Counselling and Family Therapy Applications and In...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...
Leveraging Generative AI to Drive Nonprofit Innovation
Leveraging Generative AI to Drive Nonprofit Innovation
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
Andreas Schleicher presents PISA 2022 Volume III - Creative Thinking - 18 Jun...
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Philippine Edukasyong Pantahanan at Pangkabuhayan (EPP) Curriculum
Pa2 session 7
- 1. Python with AI – 2 Session 7
- 3. Plots recap • Histograms • Bar Plot
- 4. Plots recap • Histograms • Bar Plots • Scatter Plots
- 5. Plots recap • Histograms • Bar Plots • Scatter Plots • Line Plots – Another type of plot that we will use today
- 6. Line Plots
- 7. Line Plots
- 8. Line Plots
- 9. Line Plots • Specify both x and y axis
- 10. REST API recap json.dumps() converts dictionary to striing Convert the output you receive into readable format
- 11. REST API output {"statusCode": 200, "body": "{"predicted_label": "sad", "Insight": {}, "score": [[0.004525359954210217, 0.9954746400457898]], "Message": "Predictions were made on the column: feeling", "Model": "MLPClassifier-91bcae7b-9b40-4cfa-b9cc-905d377cf12b"}", "headers": {"Content-Type": "application/json", "Access-Control-Allow-Origin": "*"}}
- 12. Model - analysis • Confusion Matrix • Precision • Recall • False Positive Rate • True positive rate = Recall = Sensitivity
- 13. ROC curve
- 14. ROC curve Threshold False Positive Rate True Positive Rate 0.2 0.4 0.6 0.8 0.9
- 15. ROC analysis • ROC curves are graphical representations of the results from testing an AI • They are used to determine trade-off between sensitivity and specificity • Area under the curve of the ROC tells us how good the performance of the AI is.
- 16. Regression • Root Mean Square Error (RMSE) • Take the difference (Prediction – Right answer) • Square it so that it is always positive (Prediction – Right Answer) * (Prediction – Right Answer) • Take the average (Mean) • Take the square root
- 17. Regression • Root Mean Square Error (RMSE) • Mean Square Error (MSE) • R2 score ?
- 18. Regression • Root Mean Square Error (RMSE) • Mean Square Error (MSE) • R2 score • Unexplained variance =sum(SE) • Average value of label = A • Total variance = sum( square (prediction – A) )
- 19. Regression • Note that sum here is the sum over all errors over all predictions (where a single error is calculated form a single predictions)
- 20. Regression • What is the best value of R2 score you can hope for?
- 21. Regression •