Presentation for the first Bucharest Big data meetup
•
0 likes•139 views
RT Analytics provides real-time analytics and insights for their mobile payment and SMS aggregation businesses in Romania. They use a data streaming platform with Storm for scalable stream processing, RabbitMQ for queuing transaction data, and Redis for fast in-memory storage. This allows them to aggregate transaction details in real-time by merchant, status, error, currency and time interval. The setup provides operational insights, transaction monitoring, and business dashboards to gain better understanding of queries, insights, and predictions to improve their services.
Report
Share
Report
Share
Download to read offline
![RT Analytics
with Data
Streaming
Felix Crisan / Co-Founder & CTO NETOPIA
[mobilPay, web2sms, kartela.ro]](https://image.slidesharecdn.com/bigdatameetup-160722124812/85/Presentation-for-the-first-Bucharest-Big-data-meetup-1-320.jpg)
Recommended
Gaenovium - Open data in the Netherlands
This document discusses open data from archives in the Netherlands. It provides examples of open data projects including the Rijksmuseum and www.openarch.nl. It outlines various data formats and standards used for open data. While technical hurdles are minor, cultural and organizational barriers remain, including concerns about loss of control and lack of benefit. The document advocates for more open data from archives and innovative uses of open data to drive new tools and applications.
Give Dairy Farmers A Market
Small dairy farmers in developing countries face challenges participating in the formal dairy market due to lack of infrastructure and distrust with dairy companies. The document proposes focusing on medium sized farmers of 10 or more cows and professionalizing the dairy production system with technologies, services, quality standards and cool chain infrastructure in order to improve livelihoods and sustainability of the dairy industry. Partnerships between supply chain actors and farmers are needed to support innovative solutions that can give dairy farmers access to markets.
Game sense
Game Sense is an approach to teaching games and sports that focuses on participation, enjoyment, and developing tactical skills rather than competition and winning. It encourages modifying rules and using small-sided games to maximize participation and skill development. The goal is to develop positive attitudes towards physical activity and teamwork. Game Sense has been shown to be an effective way to engage all students in physical education classes regardless of skill level.
2015-OBDC-Organizational-Report
This document provides an organizational report for OBDC as of May 2015. It summarizes OBDC's mission to create economic opportunity by empowering entrepreneurs through loans and business support. It highlights some of OBDC's impact statistics over the past 5-10 years, including providing over $23 million in loans to 323 businesses, creating and sustaining over 2,600 jobs. It also profiles some of OBDC's borrowers and programs in Oakland, San Francisco, and for veterans. The report concludes with an overview of OBDC's staff and supporters.
Power poin programacion
Es una presentación donde explicamos principales funciones que podemos encontrar en el lenguaje de programacion de C++.
lookbook 3
Et Al Designs is a company based in Oakland, California that produces candles and candle holders. The document lists over 30 different candle and holder product lines that are available for US distribution from Et Al Designs. It provides contact information for the company including the website, names of the founder and creative directors, phone number, email, and address.
Brochure (1)
The document discusses the benefits of exercise for mental health. Regular physical activity can help reduce anxiety and depression and improve mood and cognitive function. Exercise causes chemical changes in the brain that may help protect against mental illness and improve symptoms.
lookbook 1
This document lists various candle, holder, and diffuser collections from Dr. Vranjes for US distribution. It includes collections made of beeswax, ivory, gold, ceramic flowers, palm wax, and petrified wood. The document also provides contact information for the design company Et Al Designs located in Oakland, California.
Recommended
Gaenovium - Open data in the Netherlands
This document discusses open data from archives in the Netherlands. It provides examples of open data projects including the Rijksmuseum and www.openarch.nl. It outlines various data formats and standards used for open data. While technical hurdles are minor, cultural and organizational barriers remain, including concerns about loss of control and lack of benefit. The document advocates for more open data from archives and innovative uses of open data to drive new tools and applications.
Give Dairy Farmers A Market
Small dairy farmers in developing countries face challenges participating in the formal dairy market due to lack of infrastructure and distrust with dairy companies. The document proposes focusing on medium sized farmers of 10 or more cows and professionalizing the dairy production system with technologies, services, quality standards and cool chain infrastructure in order to improve livelihoods and sustainability of the dairy industry. Partnerships between supply chain actors and farmers are needed to support innovative solutions that can give dairy farmers access to markets.
Game sense
Game Sense is an approach to teaching games and sports that focuses on participation, enjoyment, and developing tactical skills rather than competition and winning. It encourages modifying rules and using small-sided games to maximize participation and skill development. The goal is to develop positive attitudes towards physical activity and teamwork. Game Sense has been shown to be an effective way to engage all students in physical education classes regardless of skill level.
2015-OBDC-Organizational-Report
This document provides an organizational report for OBDC as of May 2015. It summarizes OBDC's mission to create economic opportunity by empowering entrepreneurs through loans and business support. It highlights some of OBDC's impact statistics over the past 5-10 years, including providing over $23 million in loans to 323 businesses, creating and sustaining over 2,600 jobs. It also profiles some of OBDC's borrowers and programs in Oakland, San Francisco, and for veterans. The report concludes with an overview of OBDC's staff and supporters.
Power poin programacion
Es una presentación donde explicamos principales funciones que podemos encontrar en el lenguaje de programacion de C++.
lookbook 3
Et Al Designs is a company based in Oakland, California that produces candles and candle holders. The document lists over 30 different candle and holder product lines that are available for US distribution from Et Al Designs. It provides contact information for the company including the website, names of the founder and creative directors, phone number, email, and address.
Brochure (1)
The document discusses the benefits of exercise for mental health. Regular physical activity can help reduce anxiety and depression and improve mood and cognitive function. Exercise causes chemical changes in the brain that may help protect against mental illness and improve symptoms.
lookbook 1
This document lists various candle, holder, and diffuser collections from Dr. Vranjes for US distribution. It includes collections made of beeswax, ivory, gold, ceramic flowers, palm wax, and petrified wood. The document also provides contact information for the design company Et Al Designs located in Oakland, California.
society and Daily Life in Mogul India
This document contains credits for the photos used in a Haiku Deck presentation on SlideShare, listing the photographers and number of views for one photo. It encourages the reader to create their own Haiku Deck presentation and provides a link to get started.
Deconstructing Lambda architectures
The document discusses the lambda architecture, which is designed to handle large volumes of data and queries over that data. It describes the three main layers - batch, speed, and serving layers - that make up the lambda architecture. The batch layer handles batch processing and generates a master dataset. The speed layer handles real-time queries and compensates for latency in the batch layer. The serving layer indexes and exposes views of the data to support ad-hoc queries.
Mashing the data
A proposal for replicating relational databases to non-relational ones. We choose Google Cloud Datastore, but could as well use MongoDB
NoSQL solutions
MongoDB and Redis are popular NoSQL alternatives to SQL databases. MongoDB is a document-oriented database that does not require a predefined schema and allows embedding documents. It supports features like sharding, replication, and indexing. Redis is an in-memory key-value store that persists data to disk. It supports data structures like strings, hashes, lists and sets. Both databases are commonly used for caching, queues, and other use cases where flexibility and performance are important.
PGB HR Zaawansowane Wyszukiwanie
Zaawansowane wyszukiwanie, x ray search, boolean search, flip search
Double Offset High Performance Butterfly Valves
Soft Seated, metal seated and fire safe.
Free floating seat design. API 609, API 598, API 607, MSS-SP-68.
Underneath Drawn Gland Packing.
Wafer, Lugged, Double Flanged, Butt-welded in double and triple offset design.
Direct mount operation.
Hardware Acceleration of Computional Fluid Dynamics Simulations in an Oxygena...
Update @30.05 of our project's application in the biomedical field: CFD simulations in an oxygenator for ECC !!
Marketing de afiliación
El documento presenta una propuesta de marketing de afiliación para un almacén de calzado utilizando un blog. Explica cómo funciona el marketing de afiliación colocando publicidad del almacén en el blog a través de una plataforma de afiliación. El blog cobraría solo un 8% de las ventas generadas por la publicidad. También recomienda usar anuncios de Facebook y Google AdWords para llegar a más clientes de manera rentable.
Building Scalable IoT Apps (QCon S-F)
This document discusses building scalable IoT applications using open source technologies. It begins by providing an overview of the growth of the IoT market and connected devices. It then discusses challenges with traditional "data lake" architectures for IoT data due to the high volume, velocity, and variety of IoT data. The document proposes an architecture combining stream processing for real-time data with analytics on both real-time and stored data. It discusses data access patterns and storage requirements for different types of IoT data. Finally, it provides an overview of open source technologies that can be used to build scalable IoT applications.
Big data at United Airlines
United Airlines is leveraging big data at the enterprise level to help drive revenue, improve the customer experience, optimize operations, and support our employees in their day-to-day activities. At the center of our big data stack is Apache Hadoop, supported by many other emerging open source frameworks that must be integrated with the myriad of operational systems that support a 90-year-old transportation company with worldwide operations. In addition, learn how streaming data and streaming data analytics are helping to drive operational decisions in real time and how this is being architected to scale horizontally to take advantage of high availability and parallel processing. With the rapidly evolving Hadoop ecosystem, and so many new open source technologies at our disposal, the options for solving long-standing industry problems such as modeling how customers make decisions, making timely and meaningful real-time offers, and optimizing logistical operations have never been better. JOE OLSON, Senior Manager, Big Data Analytics, United Airlines and JONATHAN INGALLS, Sr. Solutions Engineer, Hortonworks
Softwares on Large Scale Internet Services
This document summarizes a talk given by Satoshi Tagomori from LINE Corp about software for large-scale internet services. It discusses how service scale can be small, middle, large, or huge. It also outlines common server-side architectures for different scales, from small single-server architectures to huge distributed systems. The document then discusses case studies from LINE Corp and how they scaled various services and addressed performance, stability, and other issues.
Lane Summers - Resume 2015-01-22
Lane Summers has over 18 years of experience in systems analysis, design, development, testing and applications management. He has extensive experience with SQL Server, Oracle, .NET, and asset management/trading platforms like Charles River IMS and SimCorp Dimension. Some of his responsibilities include developing reporting solutions, testing interfaces, liaising with business teams, and database administration. He has a proven track record of successfully managing complex projects from inception to completion.
VoltDB 소개
- In-Memory 기반 초고성능 관계형 데이터베이스
- Scale-Out, Shared Nothing 구조의 Cluster 기능
- 초당 수백만건의 Streaming 데이터 분석 처리
- Global 고객사 다수 - 삼성반도체, LG, Huawei, Intel, Nokia, Mitsubishi 등 고객사 보유
- 국내 중견 IT 기업 성능/기능 검증 진행 중
Paris FOD Meetup #5 Hortonworks Presentation
This document discusses scalable data warehousing solutions on Hadoop. It introduces Hive LLAP for high performance SQL queries, Druid for dynamic OLAP cubes, and how they integrate with Hadoop for both real-time and batch analytics. The roadmap aims to provide a unified SQL and MDX layer for business intelligence tools on top of these technologies.
Distributed Data Systems
The document discusses distributed data systems for handling large amounts of sensor data. It describes the architecture of PressureNET, a system that gathers sensor data from smartphones. PressureNET faced scaling issues with its initial MySQL database. The document then proposes an architecture using ingestors to receive data, a queue for temporary storage, and an aggregator to process the data in batches and write it to durable storage like S3 and DynamoDB. This architecture leverages common patterns for scalably handling large and growing data streams.
ExtraHop Splunk datasheet
Combine your wire data with machine data for complete IT Operational Intelligence.
Learn more at https://www.extrahop.com.
SNCF-Reseau-6th GIS Rail Summitv3
SNCF Réseau is moving towards an enterprise-wide GIS to improve information sharing across the French railway organization. Key aspects of this transition include developing GIS projects and services, adopting a service-oriented architecture, and establishing shared data repositories and models. The goals are to rationalize costs, improve data quality and availability, and support new applications through reusable and standardized services and components built upon the Ariane reference model. This enterprise GIS approach aims to provide a unified view of railway business objects and processes to enhance operational piloting, analysis, and cross-domain collaboration.
More Related Content
Viewers also liked
society and Daily Life in Mogul India
This document contains credits for the photos used in a Haiku Deck presentation on SlideShare, listing the photographers and number of views for one photo. It encourages the reader to create their own Haiku Deck presentation and provides a link to get started.
Deconstructing Lambda architectures
The document discusses the lambda architecture, which is designed to handle large volumes of data and queries over that data. It describes the three main layers - batch, speed, and serving layers - that make up the lambda architecture. The batch layer handles batch processing and generates a master dataset. The speed layer handles real-time queries and compensates for latency in the batch layer. The serving layer indexes and exposes views of the data to support ad-hoc queries.
Mashing the data
A proposal for replicating relational databases to non-relational ones. We choose Google Cloud Datastore, but could as well use MongoDB
NoSQL solutions
MongoDB and Redis are popular NoSQL alternatives to SQL databases. MongoDB is a document-oriented database that does not require a predefined schema and allows embedding documents. It supports features like sharding, replication, and indexing. Redis is an in-memory key-value store that persists data to disk. It supports data structures like strings, hashes, lists and sets. Both databases are commonly used for caching, queues, and other use cases where flexibility and performance are important.
PGB HR Zaawansowane Wyszukiwanie
Zaawansowane wyszukiwanie, x ray search, boolean search, flip search
Double Offset High Performance Butterfly Valves
Soft Seated, metal seated and fire safe.
Free floating seat design. API 609, API 598, API 607, MSS-SP-68.
Underneath Drawn Gland Packing.
Wafer, Lugged, Double Flanged, Butt-welded in double and triple offset design.
Direct mount operation.
Hardware Acceleration of Computional Fluid Dynamics Simulations in an Oxygena...
Update @30.05 of our project's application in the biomedical field: CFD simulations in an oxygenator for ECC !!
Marketing de afiliación
El documento presenta una propuesta de marketing de afiliación para un almacén de calzado utilizando un blog. Explica cómo funciona el marketing de afiliación colocando publicidad del almacén en el blog a través de una plataforma de afiliación. El blog cobraría solo un 8% de las ventas generadas por la publicidad. También recomienda usar anuncios de Facebook y Google AdWords para llegar a más clientes de manera rentable.
Viewers also liked (13)
Hardware Acceleration of Computional Fluid Dynamics Simulations in an Oxygena...
Hardware Acceleration of Computional Fluid Dynamics Simulations in an Oxygena...
Similar to Presentation for the first Bucharest Big data meetup
Building Scalable IoT Apps (QCon S-F)
This document discusses building scalable IoT applications using open source technologies. It begins by providing an overview of the growth of the IoT market and connected devices. It then discusses challenges with traditional "data lake" architectures for IoT data due to the high volume, velocity, and variety of IoT data. The document proposes an architecture combining stream processing for real-time data with analytics on both real-time and stored data. It discusses data access patterns and storage requirements for different types of IoT data. Finally, it provides an overview of open source technologies that can be used to build scalable IoT applications.
Big data at United Airlines
United Airlines is leveraging big data at the enterprise level to help drive revenue, improve the customer experience, optimize operations, and support our employees in their day-to-day activities. At the center of our big data stack is Apache Hadoop, supported by many other emerging open source frameworks that must be integrated with the myriad of operational systems that support a 90-year-old transportation company with worldwide operations. In addition, learn how streaming data and streaming data analytics are helping to drive operational decisions in real time and how this is being architected to scale horizontally to take advantage of high availability and parallel processing. With the rapidly evolving Hadoop ecosystem, and so many new open source technologies at our disposal, the options for solving long-standing industry problems such as modeling how customers make decisions, making timely and meaningful real-time offers, and optimizing logistical operations have never been better. JOE OLSON, Senior Manager, Big Data Analytics, United Airlines and JONATHAN INGALLS, Sr. Solutions Engineer, Hortonworks
Softwares on Large Scale Internet Services
This document summarizes a talk given by Satoshi Tagomori from LINE Corp about software for large-scale internet services. It discusses how service scale can be small, middle, large, or huge. It also outlines common server-side architectures for different scales, from small single-server architectures to huge distributed systems. The document then discusses case studies from LINE Corp and how they scaled various services and addressed performance, stability, and other issues.
Lane Summers - Resume 2015-01-22
Lane Summers has over 18 years of experience in systems analysis, design, development, testing and applications management. He has extensive experience with SQL Server, Oracle, .NET, and asset management/trading platforms like Charles River IMS and SimCorp Dimension. Some of his responsibilities include developing reporting solutions, testing interfaces, liaising with business teams, and database administration. He has a proven track record of successfully managing complex projects from inception to completion.
VoltDB 소개
- In-Memory 기반 초고성능 관계형 데이터베이스
- Scale-Out, Shared Nothing 구조의 Cluster 기능
- 초당 수백만건의 Streaming 데이터 분석 처리
- Global 고객사 다수 - 삼성반도체, LG, Huawei, Intel, Nokia, Mitsubishi 등 고객사 보유
- 국내 중견 IT 기업 성능/기능 검증 진행 중
Paris FOD Meetup #5 Hortonworks Presentation
This document discusses scalable data warehousing solutions on Hadoop. It introduces Hive LLAP for high performance SQL queries, Druid for dynamic OLAP cubes, and how they integrate with Hadoop for both real-time and batch analytics. The roadmap aims to provide a unified SQL and MDX layer for business intelligence tools on top of these technologies.
Distributed Data Systems
The document discusses distributed data systems for handling large amounts of sensor data. It describes the architecture of PressureNET, a system that gathers sensor data from smartphones. PressureNET faced scaling issues with its initial MySQL database. The document then proposes an architecture using ingestors to receive data, a queue for temporary storage, and an aggregator to process the data in batches and write it to durable storage like S3 and DynamoDB. This architecture leverages common patterns for scalably handling large and growing data streams.
ExtraHop Splunk datasheet
Combine your wire data with machine data for complete IT Operational Intelligence.
Learn more at https://www.extrahop.com.
SNCF-Reseau-6th GIS Rail Summitv3
SNCF Réseau is moving towards an enterprise-wide GIS to improve information sharing across the French railway organization. Key aspects of this transition include developing GIS projects and services, adopting a service-oriented architecture, and establishing shared data repositories and models. The goals are to rationalize costs, improve data quality and availability, and support new applications through reusable and standardized services and components built upon the Ariane reference model. This enterprise GIS approach aims to provide a unified view of railway business objects and processes to enhance operational piloting, analysis, and cross-domain collaboration.
Venturing into-datomic
Datomic is a distributed database that uses a Datalog query language and ACID transactions. It stores data as triples of entity-attribute-value and supports various data types and cardinality. Transactions are serialized and update indices in the background. The architecture includes Peer, Transactor, and Storage components. Queries are performed directly on indices using the query and entity APIs.
Using Spark and Riak for IoT Apps—Patterns and Anti-Patterns: Spark Summit Ea...
Everybody agrees that IoT is changing the world… and creates new challenges for software developers, architects and DevOps. How can we build efficient and highly scalable distributed applications using open-source technologies? What are characteristics of data generated by IoT devices and how it differs from traditional enterprise or Big Data problems? Which architectural patterns are beneficial for IoT use cases and why some trusted methods eventually turn out to be “anti-patterns”? This talk will show how to combine best-of-breed open-source technologies, like Apache Spark, Riak and Mesos to build scalable IoT pipelines to ingest, store and analyze huge amounts of data, while keeping operational complexity and costs under control. We will discuss cons and pros of using relational, NoSQL and object storage products for storing and archiving IoT data. Then we cover best practices how to use Spark with Riak NoSQL database. Will describe how Apache Spark advanced modules (Spark SQL, Spark Streaming and MLlib) can solve the problems common to IoT apps, while using Riak for fast and scalable persistence. At the end, will explain why Structured Spark Streaming is a godsend for IoT data and make a case for Time Series databases deserving a separate category in NoSQL classification.
S'étendre à l'international
Après-midi - Track 1 - S3 - S'étendre à l'international
Cette session vous a plû ? Si c'est le cas, n'hésitez pas à vous inscrire à notre Summit !
Inroduction to Big Data
This document provides an introduction to big data and related technologies. It defines big data as datasets that are too large to be processed by traditional methods. The motivation for big data is the massive growth in data volume and variety. Technologies like Hadoop and Spark were developed to process this data across clusters of commodity servers. Hadoop uses HDFS for storage and MapReduce for processing. Spark improves on MapReduce with its use of resilient distributed datasets (RDDs) and lazy evaluation. The document outlines several big data use cases and projects involving areas like radio astronomy, particle physics, and engine sensor data. It also discusses when Hadoop and Spark are suitable technologies.
تحليل النظم المحاضرة الأولى
The document discusses different types of information systems including transaction processing systems, online analytical processing systems, data warehouse systems, data mining systems, enterprise information systems, and enterprise resource planning systems. It also mentions key components of information systems like hardware, software, data, and information technology. Different databases, programming languages, and software that can be used to build these systems are listed as well.
Day 1: Legislative document management, Mr. János Tóth, Head of IT Department...
Digital technologies and their underlying processes now allow parliaments to create systems that underpin the legislative, representative and oversight work of parliaments. This session looks at recent innovations in the field of legislative document management, including developments on open standards, and both XML- and non-XML based systems
Real-time Analytics for Data-Driven Applications
Real-time analytics is important for data-driven applications. Ampool provides an active data store (ADS) that can ingest data in real-time, analyze it using various engines, and serve the results concurrently. This eliminates "data blackout periods" and enables applications to use up-to-date information. Ampool's ADS is powered by Apache Geode and has connectors for ingesting and processing data. It supports both transactional and analytical workloads in memory for low-latency.
Network Flow Analysis
This document discusses network flow analysis of traffic data from the Internet2 Abilene network. It provides an overview of Netflow data collection and analysis techniques, along with some preliminary results. Future work is proposed to further examine the dynamics, structure, and anomalies within the large-scale network flow data.
Network Flow Analysis
This document discusses network flow analysis of traffic data from the Internet2 Abilene network. It provides an overview of Netflow data collection and analysis techniques, along with some preliminary results. Future work is proposed to further analyze the dynamics, structure, and anomalies within the large-scale network flow data.
Webinar: The Modern Streaming Data Stack with Kinetica & StreamSets
Enterprises are now faced with wrangling massive volumes of complex, streaming data from a variety of different sources, a new paradigm known as extreme data. However, the traditional data integration model that’s based on structured batch data and stable data movement patterns makes it difficult to analyze extreme data in real-time. Join Matt Hawkins, Principal Solutions Architect at Kinetica and Mark Brooks, Solution Engineer at StreamSets as they share how innovative organizations are modernizing their data stacks with StreamSets and Kinetica to enable faster data movement and analysis.In this webinar we’ll explore:
The modern data architecture required for dealing with extreme data
How StreamSets enables continuous data movement and transformation across the enterprise
How Kinetica harnesses the power of GPUs to accelerate analytics on streaming data
A live demo of StreamSets and Kinetica connector to enable high speed data ingestion, queries and data visualization
ExtraHop Product Overview Datasheet
The ExtraHop platform enables organizations to perform multidimensional analysis and visualizations on their streaming wire data.
Similar to Presentation for the first Bucharest Big data meetup (20)
Using Spark and Riak for IoT Apps—Patterns and Anti-Patterns: Spark Summit Ea...
Using Spark and Riak for IoT Apps—Patterns and Anti-Patterns: Spark Summit Ea...
Day 1: Legislative document management, Mr. János Tóth, Head of IT Department...
Day 1: Legislative document management, Mr. János Tóth, Head of IT Department...
Webinar: The Modern Streaming Data Stack with Kinetica & StreamSets
Webinar: The Modern Streaming Data Stack with Kinetica & StreamSets
More from Felix Crisan
Big data uservices
This document discusses trends in computing and data architectures. It notes that hardware is becoming more virtualized through containers and functions, bringing code closer to storage. Meanwhile, data structures are becoming more distributed through databases, distributed databases, and distributed ledgers. Computing scopes are decreasing while storage scopes are increasing. This is because data is inert but code can be more tightly controlled at smaller scopes. The document also discusses challenges of integrating microservices with data, including consistency, and notes the importance of people and processes ("metadata") alongside technology.
Bitcoin:Next
What are the next changes that we might see in the near future coming to Bitcoin? Improvement in the signature algorithms and scripts leading to better privacy and size optimizations
BigData in BlockChains
Blockchains provide a fertile ground for storing and managing big data in a decentralized manner. Some examples of using blockchains for big data include Numer.ai for storing machine learning data shapes, IPFS and FileCoin for distributed storage, and BigchainDB as a distributed database with blockchain characteristics. Blockchains allow users to store and control their own data while granting view rights to interested and trusted parties, making it even GDPR compliant by keeping users as the data controllers.
Lightning Network
The document discusses the Lightning Network, which aims to scale bitcoin transactions by enabling instant, low-cost payments through off-chain payment channels. It describes key concepts like payment channels, routing payments across multiple nodes, and implementations. The Lightning Network allows for near-instant micropayments, smart contracts, and cross-chain atomic swaps by using timelocks and hashed timelock contracts to securely transfer bitcoin off the main blockchain.
Smart contracts using web3.js
Smart contracts can be deployed and executed on the Ethereum blockchain using web3.js. Web3.js is a JavaScript API that allows interaction with Ethereum clients like Geth to deploy contracts, call contract functions, and get information from the blockchain. Contracts are written in languages like Solidity and deployed through transactions that store the compiled code at an address. Once deployed, the contract code and data resides on the blockchain and can be interacted with through web3.js by calling functions or accessing public variables.
Smart contracts in Solidity
Smart contracts are computer protocols that facilitate, verify, or enforce the negotiation or performance of a contract. On Ethereum, a smart contract is code and data that resides at a specific address on the blockchain. The Ethereum Virtual Machine is the runtime for smart contracts, which can call other contracts, have storage to store data, and can remove themselves from the blockchain. Smart contracts are defined through transactions and deployed to the blockchain, then users can interact with them through their ABI interface. Developers use languages like Solidity to code smart contracts and tools like Truffle to test contracts locally before deployment.
Big(data) in block(chains)
This document provides an overview of Bitcoin and blockchain technology. It describes how Bitcoin was created in 2008, functioning as a transmission protocol, distributed ledger, and stored value account without the need for settlement. Transactions are recorded on a blockchain, with a new block added every 10 minutes. The blockchain records transaction hashes in blocks linked by cryptographic hashes. Analyzing Bitcoin transaction data can provide useful statistics about usage trends, price movements, and detect spam attacks.
Enablers for o commerce
oCommerce is omniCommerce. If we talk about omni channel why do we keep talking about mCommerce and eCommerce?
mcommad
MCOMMAD discusses blending advertising and mobile commerce (m-commerce). It provides an overview of NETOPIA, the largest SMS aggregator and payment gateway in Romania, and their mobilPay mobile wallet. The document notes that while mobile advertising currently makes up around 5% of global ad spend, mobile purchases account for 35-40% of all purchases. It introduces the mobilPay wallet as not just a payment tool but a marketing platform, allowing clear tracking of transactions resulting from marketing actions. Features mentioned include Push2Pay notifications, offline in-store functionality, and QR/BLE/NFC codes to enable online and offline interactions.
402 @ Mobile next
This document discusses the history and current state of Bitcoin and blockchain technology. It provides an overview of Bitcoin's origins with Satoshi Nakamoto's 2008 whitepaper, the genesis block from 2009 referencing the financial crisis, and prior related work. Benefits of Bitcoin include anonymity, transparency, security, and speed of value transfer. Use cases mentioned include escrow, smart contracts, issuing securities, and digital notaries. Challenges integrating with traditional finance are noted. The document concludes with background on the author's payments company in Romania.
Data analysis with Pandas and Spark
This document discusses using Jupyter notebooks, Pandas, and Spark for analytics pipelines on both small and large datasets. It summarizes the challenges of working with different data volumes and timeframes. For small mobile transaction data, notebooks with Pandas and R are used, while larger retail data is analyzed with Spark ML and scikit-learn in notebooks running in Docker containers. Future work includes applying Spark to additional domains and building forecasting and streaming capabilities.
TCP/IP of money
This document discusses the history and potential of blockchain technology. It traces the origins of TCP/IP and Bitcoin, comparing Bitcoin to TCP/IP for the internet. Blockchain is described as a transmission protocol, distributed ledger, and stored value account. The document outlines increasing corporate investment and experimentation in blockchain applications across banking, exchanges, infrastructure, and other areas. It argues that blockchain will fundamentally change the financial industry in the same way TCP/IP transformed communication, and that "blockchain is the TCP/IP of money."
More from Felix Crisan (12)
Recently uploaded
Removing Uninteresting Bytes in Software Fuzzing
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
“I’m still / I’m still / Chaining from the Block”
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Communications Mining Series - Zero to Hero - Session 1
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
HCL Notes and Domino License Cost Reduction in the World of DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Mind map of terminologies used in context of Generative AI
Mind map of common terms used in context of Generative AI.
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
20240605 QFM017 Machine Intelligence Reading List May 2024
Everything I found interesting about machines behaving intelligently during May 2024
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Pushing the limits of ePRTC: 100ns holdover for 100 days
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
UiPath Test Automation using UiPath Test Suite series, part 6
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Recently uploaded (20)
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Presentation for the first Bucharest Big data meetup
- 1. RT Analytics with Data Streaming Felix Crisan / Co-Founder & CTO NETOPIA [mobilPay, web2sms, kartela.ro]
- 2. About Us - Largest SMS Aggregator in RO (+100MM/year) - Largest mobile payments processor in RO (own wallet and SMS) - Second largest online card processing gateway in RO (+2M trx / year)
- 5. What do we use it for - Operational Insights - Transaction Monitoring - Health Checks - Business Dashboards (internal for now, GA later this year)
- 6. Storm one-pager - Streaming processor, Apache Incubator (http://storm.incubator.apache.org/) - Zookeeper/Nimbus(+ZeroMQ/Netty) - Scalable / No Data Loss (guaranteed) - Fault - Tolerant - Topologies (~ MR job) / Streams / Spouts (data sources) / Bolts (data processors)
- 7. Redis one-pager - In-Memory (disk persistent) KV Store (http: //redis.io) - Values can be complex types (strings, hashes, lists, sets, sorted sets) - Single-threaded (!) but high-performance (500k req/s) - Atomic operations
- 9. Our Data Streaming setup
- 10. What Happens - Transaction details are put in a RabbitMQ queue (state, errors, values etc) - A Storm Topology reads the details and aggregates - per Merchant / Service - per Status / Error / Currency - per time interval (5min, H, D, M)
- 11. Why did we choose this setup?
- 14. Better insights
- 15. Clear(er) views
- 17. KYC
- 18. Summary