1. The document discusses using reinforcement learning to create an AI that can learn to play and solve the 1987 8-bit role playing game "The Abbey of Crime".
2. The game was recreated in C++ using a video game framework to make it playable on modern systems.
3. Training an AI to master the game is an immense challenge due to the enormous number of possible game states and moves, far exceeding the number of atoms in the universe or moves in Go.
The process of building an AI looks like it is so glamorous but is a long process, and at the end of the day, the tasks related to the AI model are just 5% or less of the project.
We will see how to start an AI project from zero: defining the objectives, creating the architecture, building the game interfaces, massive data pipelines, defining model strategies, how to parallelize everything, etc.
The "the abbey of crime" is an adamant 8-bit game. This game is more complicated than Montezuma Revenge and is a perfect challenge for an AI. Its complexity is about 10^1000 legal moves to solve it.
As AI technology, we will use Reinforcement Learning using Deep Neural Networks and Monte Carlo Tree Search.
The takeaways of this talk will be: understanding all the processes involved to create an AI and learning the basics of Reinforcement Learning.
How we use Reinforcement Learning to solve the abbey of the crime
Do you know the Abbey of the Crime?
The abbey is an 8-bit game (for spectrum and CPC) that became the first RPG game in 3D (2.5D) in 1987.
This game is a marvel from a technological point of view: in only less than 120k it is capable of storing the sound, the images, all the logic of the program and the data.
Did you manage to finish the game without help?
I do not know any human being who has passed it without help. It is one of the most complicated games that have been developed, like a 1000x compared to the revenge of Montezuma from Atari. The complexity is around (10 ** 10000)
In the talk, we will tell how we design and build an AI capable of playing alone and learn to complete the game.
The document discusses using reinforcement learning to create an AI that can learn to play and solve the 1987 8-bit role playing game "La Abadía del Crimen". It notes that the game is considered a legend in video game history. The plan is outlined to make an AI that can learn to play and solve the full game. Challenges are discussed around the enormous number of possible moves. Tools and collaboration methods are presented for creating the AI, including interacting with the game code and saving game information.
The document discusses using reinforcement learning to create an AI that can learn to play and solve the 1987 8-bit role playing game "La Abadía del Crimen". It notes that the game is considered a legend in video game history. The plan is outlined to make an AI that can learn to play and solve the full game. Challenges are discussed around the enormous number of possible moves. Tools and collaboration methods are presented for creating the AI, including interacting with the game code and saving game information.
About INFINITYgames
Founded in 2004 by Laszlo Opris, the company developed an outstanding concept for multi player gaming systems. Based close to Linz in Upper Austria, INFINITYgames develops, manufactures, supplies and services electronic multi player gaming systems such as its Multi Player Roulette and the automated Texas Hold’em Poker Table. INFINITYgames prides itself to be one of the most flexible supplier of multi player gaming systems. Being a relatively small company, the strength of INFINITYgames lays in its passion for uncompromising quality and customer satisfaction. Flexibility, modularity and profitability are the key words that characterize INFINITYgames, its products and services.
The Brand for Player Satisfaction
Specialties
INFINITYgames, the Austrian manufacturer of multi player gaming systems, is strengthening its sales activities and is actively looking for distributors and sales agents world-wide.
Juantomás García gave a talk on machine learning pipelines for developing AI that can learn to play and solve the 1980s video game "The Abbey of the Crime". He discussed gathering game data, exploring different reinforcement learning strategies, and developing a simple neural network model with policy and value networks to determine moves and rewards. He described his current pipeline that moves raw game data through processing steps using technologies like Kubernetes, PubSub, training jobs, and model storage. The talk encouraged attendees to collaborate on the open source project on GitHub and join the AbadIA Slack channel.
Game developers are able to create better video games than what the limitations of computers allow by understanding how things truly work at a detailed level. They discovered tricks to get around limitations, such as updating colors rapidly to display more than the limited palette or changing sounds quickly to generate new voices. Understanding the underlying systems allows developers to creatively solve problems like drawing huge animated monsters that surpass the small allowed object sizes. This knowledge of how things really function provides advantages beyond initial restrictions.
The process of building an AI looks like it is so glamorous but is a long process, and at the end of the day, the tasks related to the AI model are just 5% or less of the project.
We will see how to start an AI project from zero: defining the objectives, creating the architecture, building the game interfaces, massive data pipelines, defining model strategies, how to parallelize everything, etc.
The "the abbey of crime" is an adamant 8-bit game. This game is more complicated than Montezuma Revenge and is a perfect challenge for an AI. Its complexity is about 10^1000 legal moves to solve it.
As AI technology, we will use Reinforcement Learning using Deep Neural Networks and Monte Carlo Tree Search.
The takeaways of this talk will be: understanding all the processes involved to create an AI and learning the basics of Reinforcement Learning.
How we use Reinforcement Learning to solve the abbey of the crime
Do you know the Abbey of the Crime?
The abbey is an 8-bit game (for spectrum and CPC) that became the first RPG game in 3D (2.5D) in 1987.
This game is a marvel from a technological point of view: in only less than 120k it is capable of storing the sound, the images, all the logic of the program and the data.
Did you manage to finish the game without help?
I do not know any human being who has passed it without help. It is one of the most complicated games that have been developed, like a 1000x compared to the revenge of Montezuma from Atari. The complexity is around (10 ** 10000)
In the talk, we will tell how we design and build an AI capable of playing alone and learn to complete the game.
The document discusses using reinforcement learning to create an AI that can learn to play and solve the 1987 8-bit role playing game "La Abadía del Crimen". It notes that the game is considered a legend in video game history. The plan is outlined to make an AI that can learn to play and solve the full game. Challenges are discussed around the enormous number of possible moves. Tools and collaboration methods are presented for creating the AI, including interacting with the game code and saving game information.
The document discusses using reinforcement learning to create an AI that can learn to play and solve the 1987 8-bit role playing game "La Abadía del Crimen". It notes that the game is considered a legend in video game history. The plan is outlined to make an AI that can learn to play and solve the full game. Challenges are discussed around the enormous number of possible moves. Tools and collaboration methods are presented for creating the AI, including interacting with the game code and saving game information.
About INFINITYgames
Founded in 2004 by Laszlo Opris, the company developed an outstanding concept for multi player gaming systems. Based close to Linz in Upper Austria, INFINITYgames develops, manufactures, supplies and services electronic multi player gaming systems such as its Multi Player Roulette and the automated Texas Hold’em Poker Table. INFINITYgames prides itself to be one of the most flexible supplier of multi player gaming systems. Being a relatively small company, the strength of INFINITYgames lays in its passion for uncompromising quality and customer satisfaction. Flexibility, modularity and profitability are the key words that characterize INFINITYgames, its products and services.
The Brand for Player Satisfaction
Specialties
INFINITYgames, the Austrian manufacturer of multi player gaming systems, is strengthening its sales activities and is actively looking for distributors and sales agents world-wide.
Juantomás García gave a talk on machine learning pipelines for developing AI that can learn to play and solve the 1980s video game "The Abbey of the Crime". He discussed gathering game data, exploring different reinforcement learning strategies, and developing a simple neural network model with policy and value networks to determine moves and rewards. He described his current pipeline that moves raw game data through processing steps using technologies like Kubernetes, PubSub, training jobs, and model storage. The talk encouraged attendees to collaborate on the open source project on GitHub and join the AbadIA Slack channel.
Game developers are able to create better video games than what the limitations of computers allow by understanding how things truly work at a detailed level. They discovered tricks to get around limitations, such as updating colors rapidly to display more than the limited palette or changing sounds quickly to generate new voices. Understanding the underlying systems allows developers to creatively solve problems like drawing huge animated monsters that surpass the small allowed object sizes. This knowledge of how things really function provides advantages beyond initial restrictions.
Arcade games have evolved significantly since their debut in the 1970s. Originally featuring simple joystick controls, modern arcade games offer HD graphics and multi-button controllers. Consoles also have advanced greatly over time, becoming more affordable and offering larger storage capacities with each new generation. PC gaming allows for customizable high-end experiences but at higher prices. Finally, handheld devices now provide portable gaming with Bluetooth, WiFi, large storage, and high-resolution graphics.
iOS Game Development: When Cocoa Met Cocos...Joseph Ku
This document provides an overview of iOS game development using the cocos2d game engine. It introduces cocos2d and explains why it is a good option for iOS games. It covers various game design concepts and the core elements that make up cocos2d, such as directors, scenes, layers, and nodes. It also discusses other game engines for iOS and tools provided by Apple, such as Game Kit, OpenGL ES, and external display support. The document concludes by providing references for further reading.
322 / 5,000
Translation results
.NET is better every year for a developer who still dreams of developing a video game. Without pretensions and without talking about Unity or any other framework, just "barebones" .NET code, we will try to write a game (or parts of it) in the 80's style (because I was a kid in those years). In Christmas style.
video https://www.youtube.com/watch?v=vg7LPcFUxg8
audio / HD video download http://media.ccc.de/browse/congress/2014/31c3_-_5997_-_en_-_saal_6_-_201412282030_-_preserving_arcade_games_-_ange_albertini.html
complete animated presentation + extras (~1Gb):
https://archive.org/details/arcade31c3
more infos @ https://code.google.com/p/corkami/wiki/Arcade
All About Gaming - By Sai Krishna A & Roopsai NSai Krishna A
Gaming Consoles & Its Emerging Technology, a presentation prepared by two students Sai Krishna A and Roopsai N of the under-grad college GRIET, Hyderabad. This presentation was initially prepared for a technical event called Pragnya 2018 in the section "Paper Presentations" and will further be used by the owners in the future.
*for educational & informative purposes only, any signs of copying/recreating/manipulating of this media is legally punishable.
Unit 14 pr1 (development of gaming platforms) (paul)Arron96
The document covers the evolution of home video game consoles from the earliest prototype in 1967 to modern systems. It discusses the first publicly available console, the Magnavox Odyssey, and how consoles became more popular and advanced starting in the 1990s with systems like the PlayStation and Nintendo 64 that helped gaming surpass arcades.
[SUMMARY
Sperimentazioni di tecnologie e comunicazioni Multimediali: Lezione 2Salvatore Iaconesi
This document provides a history of video game and technology companies from the late 1800s to present day. Some of the key events summarized are:
- In the late 1800s and early 1900s, several companies are formed that will later become leaders in consumer electronics and video games, such as Nintendo, Sony, and SEGA.
- In the 1970s, the first arcade video games are created by Nutting Associates and Atari. The Magnavox Odyssey console is also released.
- The 1980s see the rise of the Atari VCS/2600 and introduction of popular games like Space Invaders. Nintendo enters the market with the NES in 1985.
- The 1990s
Christopher Strachey programmed the first computer game, a draughts program, in the early 1950s. Tennis for Two, created in 1958, was one of the earliest electronic games. In 1961, Spacewar! was created on the PDP-1, one of the earliest mainframe computer games. The Magnavox Odyssey, released in 1972, was the first home video game console. Pong, released as an arcade game in 1972 and as a home console in 1975, was hugely popular and helped drive the success of the emerging video game industry. Space Invaders, released in 1978, was one of the most successful and influential arcade games, helping to spark the golden age of arcade video games.
Presentasi dari Aditia Dwiperdana, Crew dari Agate Studio dalam event Talent Development Saturday Agate Studio. http://agatestudio.com
Talent Development Saturday adalah acara Agate Studio crew sharing berbagai topik. Mulai dari Art, Programming, Game Production dan General Business/Management. TDS ini dilakukan tanggal 8 Februari 2014 di Bandung Digital Valley.
Barcamp Derry (Side A) - A Brief History of Video GamesJames Burke
Part 1 of a presentation I put together for the informal "unconference" Barcamp Derry. Unfortunately I've had to change the fonts so its not quite as good looking as it was when I presented it. I've included some videos as hyperlinks and some as Youtube inserts.
This document discusses the history and types of gaming. It begins with definitions of games and gaming genres like action, puzzle, and role-playing games. It then covers the origins of gaming in the 1940s and early electronic games in the 1950s and 1960s. The document also describes the origins and evolution of gaming consoles starting in the 1970s with the Magnavox Odyssey and continuing to modern consoles like the PlayStation, Xbox, and mobile gaming devices. Both advantages like improved problem solving skills and disadvantages like potential for addiction or isolation are noted.
The document provides a history of several important video game systems and games from the 1970s to the 1990s. It describes the Sega Master System and Sega Mega Drive/Genesis consoles from the 1980s, including their specifications. It also summarizes the Super Nintendo Entertainment System from 1990 and key games that helped establish genres like platformers, fighting games, first-person shooters, real-time strategy games, and rhythm games. Maze War from 1974 is highlighted as one of the earliest multiplayer 3D games and a precursor to first-person shooters.
The document provides an overview of past, present, and future technology. It discusses early video game consoles like the Atari 2600 and Magnavox Odyssey in the past section. In the present section, it examines the iPod and rise of HDTVs, as well as Blu-ray discs and modern video game consoles like the PlayStation and Xbox. The future section briefly mentions looking at upcoming gadgets.
This document describes the process used to create an animated children's story video called "Grandpa's Dream" using free and low-cost software. Key steps included writing an original story, hiring an artist to illustrate each page and a narrator to record the audio. Images were scanned and imported into video editing software along with the narration and animated mouth/eye footage from other programs. The final video was exported and uploaded to YouTube. Overall it shows how animation can be created in a cost-effective manner.
The document discusses the history and current state of independent game development. It traces the evolution from early "hacker culture" and bedroom coders in the 1960s-1980s to today's independent games scene, which has grown thanks to new digital distribution methods and communities like festivals and game jams that support independent developers. However, economic challenges remain, as independent developers have to balance artistic vision with commercial viability without the resources of major publishers. The document examines the roles of technology, economics, culture and aesthetics in shaping independent games.
Museum of Computing Newsletter May 2013Donald Jones
The document discusses an upcoming exhibition called "Robots Revealed" at the Museum of Computing that will run from July to January. The exhibition aims to showcase the progression of robotics from science fiction to modern applications. It will feature robots from the museum's collection and companies. Alongside the exhibition, there will be talks and learning activities to promote robotics and encourage future programmers. The museum is calling on supporters to participate in robot-themed events to mark the start of the exhibition in July.
This document contains summaries of various video games, comments about gaming platforms like PlayStation 3, and discussions around gaming. Some key games mentioned include Civilization 3, Age of Empires 2, Max Payne, Killzone 3, Battlefield 3, Resident Evil 5, God of War 3, Gran Turismo 5, World of Warcraft, Dead Island, Aliens: Colonial Marines, and Minecraft. Comments discuss gameplay experiences, tips for achievements, system requirements, and enjoying games online or with others. Platforms like PlayStation 3 are praised for their multimedia capabilities and library of exclusive titles.
1) The document discusses the evolution of AlphaGo and related AI projects from Deep Blue, to AlphaGo, AlphaGo Zero, and AlphaZero.
2) It explains the key concepts behind AlphaGo including the policy and value neural networks, and how it was initially trained via supervised learning and then improved with reinforcement learning by playing against itself.
3) It summarizes the differences between AlphaGo Zero which was trained solely via reinforcement learning without human data, and AlphaZero which aims to solve games without specific tuning or data augmentation.
Arcade games have evolved significantly since their debut in the 1970s. Originally featuring simple joystick controls, modern arcade games offer HD graphics and multi-button controllers. Consoles also have advanced greatly over time, becoming more affordable and offering larger storage capacities with each new generation. PC gaming allows for customizable high-end experiences but at higher prices. Finally, handheld devices now provide portable gaming with Bluetooth, WiFi, large storage, and high-resolution graphics.
iOS Game Development: When Cocoa Met Cocos...Joseph Ku
This document provides an overview of iOS game development using the cocos2d game engine. It introduces cocos2d and explains why it is a good option for iOS games. It covers various game design concepts and the core elements that make up cocos2d, such as directors, scenes, layers, and nodes. It also discusses other game engines for iOS and tools provided by Apple, such as Game Kit, OpenGL ES, and external display support. The document concludes by providing references for further reading.
322 / 5,000
Translation results
.NET is better every year for a developer who still dreams of developing a video game. Without pretensions and without talking about Unity or any other framework, just "barebones" .NET code, we will try to write a game (or parts of it) in the 80's style (because I was a kid in those years). In Christmas style.
video https://www.youtube.com/watch?v=vg7LPcFUxg8
audio / HD video download http://media.ccc.de/browse/congress/2014/31c3_-_5997_-_en_-_saal_6_-_201412282030_-_preserving_arcade_games_-_ange_albertini.html
complete animated presentation + extras (~1Gb):
https://archive.org/details/arcade31c3
more infos @ https://code.google.com/p/corkami/wiki/Arcade
All About Gaming - By Sai Krishna A & Roopsai NSai Krishna A
Gaming Consoles & Its Emerging Technology, a presentation prepared by two students Sai Krishna A and Roopsai N of the under-grad college GRIET, Hyderabad. This presentation was initially prepared for a technical event called Pragnya 2018 in the section "Paper Presentations" and will further be used by the owners in the future.
*for educational & informative purposes only, any signs of copying/recreating/manipulating of this media is legally punishable.
Unit 14 pr1 (development of gaming platforms) (paul)Arron96
The document covers the evolution of home video game consoles from the earliest prototype in 1967 to modern systems. It discusses the first publicly available console, the Magnavox Odyssey, and how consoles became more popular and advanced starting in the 1990s with systems like the PlayStation and Nintendo 64 that helped gaming surpass arcades.
[SUMMARY
Sperimentazioni di tecnologie e comunicazioni Multimediali: Lezione 2Salvatore Iaconesi
This document provides a history of video game and technology companies from the late 1800s to present day. Some of the key events summarized are:
- In the late 1800s and early 1900s, several companies are formed that will later become leaders in consumer electronics and video games, such as Nintendo, Sony, and SEGA.
- In the 1970s, the first arcade video games are created by Nutting Associates and Atari. The Magnavox Odyssey console is also released.
- The 1980s see the rise of the Atari VCS/2600 and introduction of popular games like Space Invaders. Nintendo enters the market with the NES in 1985.
- The 1990s
Christopher Strachey programmed the first computer game, a draughts program, in the early 1950s. Tennis for Two, created in 1958, was one of the earliest electronic games. In 1961, Spacewar! was created on the PDP-1, one of the earliest mainframe computer games. The Magnavox Odyssey, released in 1972, was the first home video game console. Pong, released as an arcade game in 1972 and as a home console in 1975, was hugely popular and helped drive the success of the emerging video game industry. Space Invaders, released in 1978, was one of the most successful and influential arcade games, helping to spark the golden age of arcade video games.
Presentasi dari Aditia Dwiperdana, Crew dari Agate Studio dalam event Talent Development Saturday Agate Studio. http://agatestudio.com
Talent Development Saturday adalah acara Agate Studio crew sharing berbagai topik. Mulai dari Art, Programming, Game Production dan General Business/Management. TDS ini dilakukan tanggal 8 Februari 2014 di Bandung Digital Valley.
Barcamp Derry (Side A) - A Brief History of Video GamesJames Burke
Part 1 of a presentation I put together for the informal "unconference" Barcamp Derry. Unfortunately I've had to change the fonts so its not quite as good looking as it was when I presented it. I've included some videos as hyperlinks and some as Youtube inserts.
This document discusses the history and types of gaming. It begins with definitions of games and gaming genres like action, puzzle, and role-playing games. It then covers the origins of gaming in the 1940s and early electronic games in the 1950s and 1960s. The document also describes the origins and evolution of gaming consoles starting in the 1970s with the Magnavox Odyssey and continuing to modern consoles like the PlayStation, Xbox, and mobile gaming devices. Both advantages like improved problem solving skills and disadvantages like potential for addiction or isolation are noted.
The document provides a history of several important video game systems and games from the 1970s to the 1990s. It describes the Sega Master System and Sega Mega Drive/Genesis consoles from the 1980s, including their specifications. It also summarizes the Super Nintendo Entertainment System from 1990 and key games that helped establish genres like platformers, fighting games, first-person shooters, real-time strategy games, and rhythm games. Maze War from 1974 is highlighted as one of the earliest multiplayer 3D games and a precursor to first-person shooters.
The document provides an overview of past, present, and future technology. It discusses early video game consoles like the Atari 2600 and Magnavox Odyssey in the past section. In the present section, it examines the iPod and rise of HDTVs, as well as Blu-ray discs and modern video game consoles like the PlayStation and Xbox. The future section briefly mentions looking at upcoming gadgets.
This document describes the process used to create an animated children's story video called "Grandpa's Dream" using free and low-cost software. Key steps included writing an original story, hiring an artist to illustrate each page and a narrator to record the audio. Images were scanned and imported into video editing software along with the narration and animated mouth/eye footage from other programs. The final video was exported and uploaded to YouTube. Overall it shows how animation can be created in a cost-effective manner.
The document discusses the history and current state of independent game development. It traces the evolution from early "hacker culture" and bedroom coders in the 1960s-1980s to today's independent games scene, which has grown thanks to new digital distribution methods and communities like festivals and game jams that support independent developers. However, economic challenges remain, as independent developers have to balance artistic vision with commercial viability without the resources of major publishers. The document examines the roles of technology, economics, culture and aesthetics in shaping independent games.
Museum of Computing Newsletter May 2013Donald Jones
The document discusses an upcoming exhibition called "Robots Revealed" at the Museum of Computing that will run from July to January. The exhibition aims to showcase the progression of robotics from science fiction to modern applications. It will feature robots from the museum's collection and companies. Alongside the exhibition, there will be talks and learning activities to promote robotics and encourage future programmers. The museum is calling on supporters to participate in robot-themed events to mark the start of the exhibition in July.
This document contains summaries of various video games, comments about gaming platforms like PlayStation 3, and discussions around gaming. Some key games mentioned include Civilization 3, Age of Empires 2, Max Payne, Killzone 3, Battlefield 3, Resident Evil 5, God of War 3, Gran Turismo 5, World of Warcraft, Dead Island, Aliens: Colonial Marines, and Minecraft. Comments discuss gameplay experiences, tips for achievements, system requirements, and enjoying games online or with others. Platforms like PlayStation 3 are praised for their multimedia capabilities and library of exclusive titles.
1) The document discusses the evolution of AlphaGo and related AI projects from Deep Blue, to AlphaGo, AlphaGo Zero, and AlphaZero.
2) It explains the key concepts behind AlphaGo including the policy and value neural networks, and how it was initially trained via supervised learning and then improved with reinforcement learning by playing against itself.
3) It summarizes the differences between AlphaGo Zero which was trained solely via reinforcement learning without human data, and AlphaZero which aims to solve games without specific tuning or data augmentation.
1) Alpha Zero was an AI developed by DeepMind that achieved master level play in the games of chess, shogi, and Go without relying on human data or prior knowledge.
2) It was able to achieve this by using a new form of deep reinforcement learning that allowed it to learn to play solely from games of self-play, starting from random play.
3) Alpha Zero demonstrated superhuman performance in chess, shogi, and Go by defeating previous champion programs in these games, despite being provided no domain knowledge except the game rules.
In the last 3 years kappa architecture has evolved too much. From the Classic kafka+spark and now many options and new players like apache beam/google dataflow. Will show how a real use case has evolved and how important is think big and different.
This document provides an overview of Kappa Architecture presented by Juantomás García. It includes:
1) A brief history of Kappa Architecture, which was coined in 2014 by Jay Kreps to describe an architecture using real-time streaming data and batch processing.
2) An explanation of how Kappa Architecture works, using streaming data pipelines to continuously update real-time views and batch jobs to rebuild views from historical data.
3) A real use case example of how OpenSistemas used Kappa Architecture to monitor vehicle data from many cars in real-time and perform analytics.
This document discusses Spark real use cases and the Kappa architecture. It introduces Juantomás García and provides background on Jay Kreps who coined the term "Kappa Architecture". The document then describes the usual data flow versus the Kappa Architecture approach. It provides examples of tools that can be used and highlights some favorite Spark features. The document also discusses some real use cases including monitoring car data and scaling REST interfaces and queries. It emphasizes thinking big, using lightweight technologies, and mixing tools from different sources.
El documento anuncia una presentación el 31 de mayo de 2017 en el Campus Madrid sobre Google Developer Group Cloud (GDG Cloud), un grupo creado para compartir conocimientos sobre tecnologías en la nube. La presentación incluirá información sobre la misión de GDG Cloud, quienes lo crearon y son parte del equipo de GDG Cloud Madrid, así como detalles sobre los meetups, hackatones y otras actividades que organizarán para promover el aprendizaje sobre tecnologías en la nube.
This document discusses Kappa Architecture 2.0 and tools for real-time data processing. It introduces Jay Kreps, who coined the term "Kappa Architecture" and has worked on several related projects. The document then contrasts the usual batch processing data flow with the Kappa Architecture approach of combining real-time and batch processing. It provides examples of using Spark and Kafka for real-time analytics and discusses taking the Kappa Architecture to version 3.0 with additional tools like Apache Druid, Kafka Streams, and Google Cloud.
Juantomás García is a data solutions manager at OpenSistemas and Google Developer Expert for cloud computing. He has authored books on free software and leads groups on machine learning and cloud computing. In his presentation, he discusses considerations around AI versus machine learning, implicit versus explicit data, Target's pregnancy product advertising controversy, Google's diversity study findings, evaluating feedback in real-time, contextual information, and Google's Jobs API. He welcomes questions by email or Twitter.
This document summarizes a presentation by Juantomás García on Kappa Architecture 2.0. It introduces Kappa Architecture, which was coined in 2014 as a way to handle both batch and real-time processing of streaming data. The presentation describes the traditional data flow, and how Kappa Architecture uses tools like Apache Kafka, Apache Spark, and Apache Samza to allow for real-time and batch processing of data. It also provides examples of how Kappa Architecture has been applied to use cases involving monitoring vehicle data in real-time and scaling APIs to handle many requests.
This document summarizes a presentation about Kappa Architecture 2.0 given by Juantomás García. It discusses the origins of Kappa Architecture as coined by Jay Kreps in 2014 for handling real-time data. It then outlines how Kappa Architecture uses tools like Apache Kafka, Apache Spark, and Apache Samza to handle real-time and batch data processing. The presentation also provides examples of how Kappa Architecture has been applied to a use case of monitoring car data in real-time and scaling REST APIs. It concludes by discussing future improvements and variations of Kappa Architecture.
Juantomás García gave a presentation on PaaS (Platform as a Service) using pigeons at Databeers Madrid. He proposed training pigeons to detect cancer tumors as an unconventional method for machine learning. Some key points included that pigeon clusters can achieve 99% accuracy after a month of training and discussing how to identify individual pigeons, design an API, and scale the pigeon cluster. The presentation maintained a lighthearted and humorous tone about using pigeons for complex data solutions.
How to create a personal knowledge graph IBM Meetup Big Data Madrid 2017Juantomás García Molina
This document discusses how to create a personal knowledge graph. It begins by explaining why a knowledge graph is needed, as the speaker manages a lot of information from different sources and needs a way to organize and query it. It then discusses how to build a knowledge graph using concepts like explicit and implicit information, graph databases, and collective intelligence. The speaker advocates using cloud services, containers, notebooks and machine learning to build the knowledge graph. The first steps proposed are to name the project "Boosterme" and start a GitHub repository.
This document discusses Kappa Architecture, which is a data processing architecture using Apache Kafka as the centralized data backbone. It summarizes Jay Kreps' original definition of Kappa Architecture and describes how it provides a more flexible way to do real-time and batch processing compared to the traditional Lambda Architecture. The document also provides an example of how a company implemented Kappa Architecture using Kafka and Spark Streaming to monitor car telemetry data from many vehicles and support flexible real-time queries over that data.
Este documento presenta tres ejemplos de clasificación utilizando TensorFlow. El autor instaló TensorFlow a través de un contenedor Docker para ganar tiempo y eficiencia. Los tres ejemplos utilizan diferentes conjuntos de datos sintéticos y algoritmos de aprendizaje automático, incluida una regresión logística para datos lineales y RNN para datos no lineales. El documento también introduce el uso de TensorBoard para el desarrollo con TensorFlow.
Kappa Architecture is an alternative to Lambda Architecture that simplifies real-time data processing. It uses a distributed log like Kafka to store all input data immutably to allow reprocessing from the beginning if the processing code changes. This avoids having to maintain separate batch and real-time processing systems. The ASPgems team has implemented Kappa Architecture for several clients using Kafka, Spark Streaming, and Cassandra to provide real-time analytics and metrics in sectors like telecommunications, IoT, insurance, and energy.
Este documento describe los conceptos y aplicaciones de Big Data. Explica que Big Data implica el análisis de grandes cantidades de datos estructurados y no estructurados para identificar patrones que permitan tomar mejores decisiones empresariales. También describe cómo las nuevas tecnologías permiten procesar y analizar datos en tiempo real para lograr agilidad operativa, conocer mejor a los clientes, prevenir fraudes y fomentar la innovación. Finalmente, presenta algunas soluciones de análisis de datos como Hadoop, Spark y streaming.
This document provides an overview of Spark, including:
- Spark was developed in 2009 at UC Berkeley and open sourced in 2010, with over 200 contributors.
- Spark Core is the general execution engine that other Spark functionality is built on, providing in-memory computing and supporting various programming languages.
- Spark Streaming allows data to be ingested from sources like Kafka and Flume and integrated with Spark for advanced analytics on streaming data.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!SOFTTECHHUB
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfMalak Abu Hammad
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...Zilliz
Join us to introduce Milvus Lite, a vector database that can run on notebooks and laptops, share the same API with Milvus, and integrate with every popular GenAI framework. This webinar is perfect for developers seeking easy-to-use, well-integrated vector databases for their GenAI apps.
UiPath Test Automation using UiPath Test Suite series, part 6DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
3. Who I am
Juantomás García ( 0-)
•Chief Envisioning Officer @ Sngular
•GDEx2 (Google Developer Expert) for cloud and Machine Learning
•#AbadIA Cheer Leader
Others
•Co-Author of the first Spanish free software book “La Pastilla Roja”
•Former President of Hispalinux (Spanish Linux User Group)
•Organizer of the Machine Learning Spain and GDG Cloud Madrid.
6. ?
My buddy Sebas told me:
Is it possible to create an AI that can learn to play
and solve the game?
It’s a really crazy idea with an insane cult 8-bit
game, but I like it
“
”
8. First 8-bit RPG in pseudo 3D (2.5D)
It was at 1987 and this game is a kind
of legend in the video games world.
Based in Umberto Eco book “In the
name of the rose”
Do you know the game?
THE GAME
9. Size of the program: 87 Kb
That include:
• Code
• Graphics
• Music
• Maps
Do you know the game?
THE GAME
10. The size of this avatar is: 87Kb
Do you know the game?
THE GAME
11. It was programmed using Z80
assembler for Amstrad CPC and
Sinclair Spectrum
ABOUT THE GAME
Was programmed by Paco Menéndez
Graphics was designed by Juan Delcán
16. Manuel Abadía disassembled the
original Amstrad CPC game rom.
He documented all the code,
marked the graphics, sounds, etc.
GitHub page: https://bit.ly/2I9TMZk
Original Code
18. Manuel Abadía make a port to C++ of the game using his
special video games framework: Vigasoco
Sebastian Blanes fork the project to use SDL. VigasocoSDL
was born. Now the abbey can be played in chrome, PS3, CC,
linux, MacOS, Windows, etc.
VigasocoSDL
GitHub page: https://github.com/luzbel/VigasocoSDL/wiki
GAME EVOLUTION
21. 10^80
Number of
atoms in our
universe
(Hawking said
there are more
than one
universe!!)
HOW DIFFICULT IS THE CHALLENGE?
22. 10^80
Number of
atoms in our
universe
(Hawking said
there are more
than one
universe!!)
Number of
chess legal
moves?
HOW DIFFICULT IS THE CHALLENGE?
23. 10^12010^80
Number of
atoms in our
universe
(Hawking said
there are more
than one
universe!!)
Number of
chess legal
moves
HOW DIFFICULT IS THE CHALLENGE?
24. 10^12010^80
Number of
atoms in our
universe
(Hawking said
there are more
than one
universe!!)
Number of
chess legal
moves
Number of GO
legal moves?
HOW DIFFICULT IS THE CHALLENGE?
25. 10^12010^80 10^761
Number of
atoms in our
universe
(Hawking said
there are more
than one
universe!!)
Number of
chess legal
moves
Number of GO
legal moves
HOW DIFFICULT IS THE CHALLENGE?
26. 10^12010^80 10^761
Number of
atoms in our
universe
(Hawking said
there are more
than one
universe!!)
Number of
chess legal
moves
Number of GO
legal moves
AbadIA moves
needs to solve
the game?
HOW DIFFICULT IS THE CHALLENGE?
27. 10^12010^80 10^761 10^10k
Number of
atoms in our
universe
(Hawking said
there are more
than one
universe!!)
Number of
chess legal
moves
Number of GO
legal moves
AbadIA legal
moves where N
is the depth of
the game you
wish to check.
For N= 10000 is
10^10000
HOW DIFFICULT IS THE CHALLENGE?
28. Universe
100000000000000000000000000000000000000000000000000000000000000000000000000000000
Chess
1000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
GO
100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000
The Abbey of Crime
10000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
00000000000000000000000000000000000000000000000000
Just for the guys that not attended enought math classes.
29. The AI & Human Players only know if
the game is solved after 10.000 actions.
36. How to interact with the
game.
You will need lots of tools
before starting to create
the AI
1
2
3
How you get and save the
game information.
How to play millions of
games.
AI TOOLS
37. You will need send actions, get
game info, reset it, etc.
How to interact with the game??
HOW TO INTERACT
41. Now we have a REST based API.
Two way communication.
We send actions
- Moves
- Resets
- Save/Load
states
We got information
- State dumps
- Actions
- Checkpoints
HOW TO INTERACT WITH THE GAME
42. curl -X POST http:!//localhost:4477/abadIA/game/current/actions/RIGHT
or
curl -X GET http:!//localhost:4477/abadIA/game/current —H 'accept:
application/json’
or
Use python request library
AS EASY AS
45. At the beginning a laptop was enough.
But very soon you need more CPU/
GPU.
Then product like Google Cloud is
your best ally.
We had created a few Dockers, so
now we can execute lots of instances
of the game in parallel.
note: If we use Google Cloud services
like GKE, we can launch hundred of
games in parallel.
HOW TO SCALE IT
46. We recollect a lot of information
- Game Info (timestamps, rewards, bonus, obsequium)
- Games moves (state, action, reward, new_state)
- Checkpoints (to restore the game at an interesting time)
- ML Models (for recovering good models o just make a benchmark)
GATHERING INFORMATION
47. It takes a lot of time to get all the
parts working all together.
Building tools, testing every piece,
every option.
Sometimes I feel like I was Mario
Bros.
GATHERING INFORMATION
49. Github Repo: https://www.github.com/LaAbadIAdelCrimen/ abadia-gym
One the
most
frequently
used tool is
OpenAI
Gym
So we
design an
AbadIA gym
The gym is a
standard place
to train and
interact with
Reinforcement
Learning
agents.
In our project
the gym is
framework to
wrap the
game engine.
PLAYGROUND FOR PLAYING
50. A game
server with
REST API
An openAI
Gym
Enought
hardware
resources
So what’s the next step
SO WE HAVE
52. A RL agent is a program that interacts with an environment, in our
case a OpenAI gym for AbadIA, and learn from observations and
rewards.
CREATE A RL AGENT
80. Questions?
This talk have a free questions lifetime warranty: If you have any questions or concerns
about this talk, feel free to contact me anytime.
Selfie Time: If you like the talk just smile while I take
the selfie ;-)
We’re Hiring, Sngular People
twitter: @juantomas
juantomas.garcia@sngular.com