Society is currently going through a phase of having an adversarial relationship with personal data. Our data is gathered by third parties ranging from companies like Facebook and Google to governments and their agencies and although in theory we ourselves own our data, we don’t manage, get value from it, or use it ourselves. The only times we encounter our own data is when we read about abuses of it, or we get confused when we try to understand what GDPR means. One day we will live in a world where we actually own our own data and it will be managed for us, with our interests at heart, by trusted third parties analogous to how banks manage our wealth. Those third parties may increase the value of our data by pooling it, equivalent to banks lending money, and by sharing it with organisations like social media companies, educational institutions, entertainment companies, etc. In such a world we would be delighted rather than afraid, to gather data and to have data gathered about ourselves and used for our benefit. In such a world, what are the data points that can be gathered, what is our digital footprint ? In this talk I will present an overview of what data can, and is gathered by people about themselves. I will cover off-the-self and popular sensors as well as the more unusual and uncommon and as a focus I will give an overview of sleep, how it can be measured and what use that can be. Gathering data about oneself is also known as lifelogging or the quantified self and I will draw inspiration and case studies from the work we have done in the area of lifelogging over the last 15 years. (thanks to Cathal Gurrin for some of the slides).
Hpai class 5 - reality and occurrences - 021020melendez321
This document summarizes a class on human perspective in artificial intelligence taught by Professor José Meléndez. It discusses homework assignments, modeling reality, occurrences, and augmented and virtual reality. Key concepts covered include the McGurk effect, that all reality is virtual, direct, internal, derived, remote, and other types of occurrences.
Technology and cognition situated cognition2013Lex Pit
The document discusses the relationship between technology, cognition, and human behavior. It explores whether just because humans can create a technology means they should, and whether technology is truly neutral or can influence human actions. While some argue technology simply augments existing human capacities, the document argues that technology integrates with human cognition in complex ways. It can change how humans process information, perceive, act, and make decisions. Therefore, technologies may not be neutral and require careful consideration regarding their impacts on humanity.
Hpai class 20 - influence & emotions - 042920melendez321
This document provides an overview of a class on human perspective in artificial intelligence. It discusses topics like emotions, influence tactics, and intercellular communication. The professor reviews the last homework assignment and upcoming exam. Required reading materials are listed on how the brain makes emotions and how emotions are a social reality. The document also discusses examples of how a brain cell may communicate with other cells and influence tactics that can be used knowingly or unknowingly.
This document discusses modelling rich human-computer interaction. It covers status-event analysis, which analyzes both events (things that happen) and statuses (things that are). It also discusses supporting a rich set of phenomena including different types of events and statuses. The document notes that most notations only support a subset of possible phenomena. It provides examples of different types of events, statuses, behaviours, and their properties. It discusses implications for system design, including timescales and interruptions. It also covers naive psychology concepts like user attention and closure. The document proposes that sensor-based, low intention interaction could support richer contexts and incidental interactions.
This document summarizes a class on human perspective in artificial intelligence. It discusses how emotions are constructed and play an important role in influence. Emotions signal what we care about and are part of how our minds constantly predict the world. The class covered how the brain and its components collaborate to produce feelings and thoughts without being intelligent on their own. It discussed myths about emotions and asked how emotional abilities develop through interactions with others. The last part summarized required reading on emotions and influence tactics.
This class focuses on predicting how emerging technologies will change media. It will explore wearable technologies like Google Glass and activity trackers, gesture interfaces, virtual and augmented reality, drones, and sensors for journalism. Students will write blog posts, conduct a field test of a technology, and submit a final vision paper. The grade is based on blog posts, field tests, participation, and the final paper. The class will provide devices like Oculus Rift and drones for student projects. Students are assigned to research technologies for a potential field test to write about by the next class.
This lecture discusses presence in virtual reality. It defines presence as the subjective experience of being in a virtual environment rather than the physical one. Presence is influenced by how immersive a VR system is at stimulating the senses through sights, sounds etc. to generate realistic sensations. High presence leads to greater engagement from users and more natural reactions. The lecture compares presence to immersion and outlines different dimensions and methods of measuring presence, highlighting the importance of multi-sensory stimulation for creating strong feelings of presence.
Hpai class 5 - reality and occurrences - 021020melendez321
This document summarizes a class on human perspective in artificial intelligence taught by Professor José Meléndez. It discusses homework assignments, modeling reality, occurrences, and augmented and virtual reality. Key concepts covered include the McGurk effect, that all reality is virtual, direct, internal, derived, remote, and other types of occurrences.
Technology and cognition situated cognition2013Lex Pit
The document discusses the relationship between technology, cognition, and human behavior. It explores whether just because humans can create a technology means they should, and whether technology is truly neutral or can influence human actions. While some argue technology simply augments existing human capacities, the document argues that technology integrates with human cognition in complex ways. It can change how humans process information, perceive, act, and make decisions. Therefore, technologies may not be neutral and require careful consideration regarding their impacts on humanity.
Hpai class 20 - influence & emotions - 042920melendez321
This document provides an overview of a class on human perspective in artificial intelligence. It discusses topics like emotions, influence tactics, and intercellular communication. The professor reviews the last homework assignment and upcoming exam. Required reading materials are listed on how the brain makes emotions and how emotions are a social reality. The document also discusses examples of how a brain cell may communicate with other cells and influence tactics that can be used knowingly or unknowingly.
This document discusses modelling rich human-computer interaction. It covers status-event analysis, which analyzes both events (things that happen) and statuses (things that are). It also discusses supporting a rich set of phenomena including different types of events and statuses. The document notes that most notations only support a subset of possible phenomena. It provides examples of different types of events, statuses, behaviours, and their properties. It discusses implications for system design, including timescales and interruptions. It also covers naive psychology concepts like user attention and closure. The document proposes that sensor-based, low intention interaction could support richer contexts and incidental interactions.
This document summarizes a class on human perspective in artificial intelligence. It discusses how emotions are constructed and play an important role in influence. Emotions signal what we care about and are part of how our minds constantly predict the world. The class covered how the brain and its components collaborate to produce feelings and thoughts without being intelligent on their own. It discussed myths about emotions and asked how emotional abilities develop through interactions with others. The last part summarized required reading on emotions and influence tactics.
This class focuses on predicting how emerging technologies will change media. It will explore wearable technologies like Google Glass and activity trackers, gesture interfaces, virtual and augmented reality, drones, and sensors for journalism. Students will write blog posts, conduct a field test of a technology, and submit a final vision paper. The grade is based on blog posts, field tests, participation, and the final paper. The class will provide devices like Oculus Rift and drones for student projects. Students are assigned to research technologies for a potential field test to write about by the next class.
This lecture discusses presence in virtual reality. It defines presence as the subjective experience of being in a virtual environment rather than the physical one. Presence is influenced by how immersive a VR system is at stimulating the senses through sights, sounds etc. to generate realistic sensations. High presence leads to greater engagement from users and more natural reactions. The lecture compares presence to immersion and outlines different dimensions and methods of measuring presence, highlighting the importance of multi-sensory stimulation for creating strong feelings of presence.
Quantified Self: The what, the why and the brave new futureAlja Isakovic
Slides from a lecture on the quantified self trend, prepared for communications students in May 2016. The lecture is based on a series of blog posts I wrote on the topic: https://medium.com/exploring-the-quantified-self
1) The document outlines an "Immortality Roadmap" with various approaches and methods for achieving "Digital Immortality" through comprehensively reconstructing a person based on collected information traces.
2) It details many specific techniques for information collection including constant video/audio recording, archiving documents and photos, DNA sequencing, medical scans, psychological tests, and more.
3) The goal is to gather enough identifiable information to allow reconstruction of the individual's personality and thought processes through an AI assistant or virtual avatar even after biological death. This could help solve problems like information loss during reconstruction.
We will all have in Human Ledgers in the FutureCathal Gurrin
Cathal Gurrin argues that human ledgers, which comprehensively capture an individual's life experiences through sensors and data, will become common in the future. Early examples of human ledgers include lifelogging projects from the 2000s that captured photos, locations, and biometrics. Future human ledgers may incorporate richer data sources like vision, speech, health metrics, and social media to benefit areas like health monitoring, memory augmentation, and education. While promising benefits, human ledgers also raise privacy and data ownership issues that require consideration.
The document provides an overview of a Quantified Self club meeting at USC. It discusses what self-quantification is, examples of data that can be tracked, and expectations for the club. Members are expected to do presentations on self-tracking projects or apps. Suggested topics include reviewing a tracking device, sharing an analytics tool, or explaining a quantified self project done by someone else. Common areas of interest to track include health, productivity, and psychological states. The club aims to help members learn data and presentation skills through sharing self-tracking experiences.
1. People have long been fascinated with understanding themselves through objective analysis of their surroundings and tracking tools help provide insights into activities, behaviors, and improvements.
2. Tracking technologies have evolved from simple devices like pedometers to more advanced sensors in devices that can track a variety of daily activities both active and inactive.
3. Emerging areas of focus include location-based tracking and combining multiple sensory data streams to gain a more holistic view of behaviors.
This document summarizes an interview study of 22 people who use fitness tracking technologies like apps and devices. The following key points are made:
- People track a variety of health metrics like walking, exercise, eating, weight, and sleep, often using multiple trackers for different purposes like training, weight loss, and sleep.
- Tracking is usually not long-term, but rather focused on specific events or daily goals. Data is rarely shared on social media due to perceptions of egotism.
- Tracking is often a social activity done with families, partners, or coworkers to compare data and progress together.
- Future tracker design should support co-emergence of activities and tracking over time,
Perception is the process by which we become aware of objects, events, and people around us through our senses. Our perceptions are influenced by physical, environmental, internal, and learned elements. We actively select certain stimuli to focus on based on various factors and then organize this information using cognitive schemas like prototypes, personal constructs, stereotypes, and scripts. Finally, we interpret the meaning of what we perceive by making attributions about its locus, stability, specificity, and our responsibility. However, our perceptions do not necessarily reflect an ultimate reality and are subject to errors and biases.
Machine Learning for Non-technical Peopleindico data
Machine learning is one of the most promising and most difficult to understand fields of the modern age. Here are the slides from Slater Victoroff's (CEO of indico) talk at General Assembly Boston for non-technical folks on how to separate the signal from the noise -- stay tuned for the next time he speaks:
https://generalassemb.ly/education/machine-learning-for-non-technical-people
Acm achievement award acceptance 20101026Ramesh Jain
Ramesh Jain summarizes his career and life experiences in a presentation to his professional family at UCI. He discusses his research in computer vision, multimedia, and experiential computing. Jain expresses his vision for personalized experiences centered around the user, not just content, and technologies that can improve lives globally by connecting people through situations. He dreams of ACM Multimedia leading media innovation to benefit the "middle of the pyramid" - the world's middle class.
Play, Pause, Rewind - The Era of Archived LifetimesCathal Gurrin
Play, Pause, Rewind - The Era of Archived Lifetimes.
From mobile devices to pervasive computing. When we store our data, we enter the era of archived lifetimes and lifelogging.
Lifelogging, egocentric vision and health: how a small wearable camera can he...Petia Radeva
Petia Radeva discusses how lifelogging and wearable cameras can help improve health. Computer vision and deep learning techniques can be applied to extract useful information from large amounts of egocentric image data. Key information that can be derived includes what a person eats, where and with whom they eat, and how active they are. This type of quantified self-data has the potential to help manage health conditions like obesity, diabetes and migraines by identifying triggers and monitoring lifestyle factors and habits over time. Lifelogging also shows promise for cognitive treatment of patients with amnesia or mild cognitive impairment.
This document discusses using big image/multimodal data and computer vision techniques to gain insights from large amounts of visual data on the internet. It first discusses how image data is the largest form of big data and presents challenges to analyze due to its unstructured nature. It then describes several applications of big image/multimodal data analytics like medical image analysis, social media summarization, and sentiment analysis. Next, it outlines experiments on predicting mental health from webcam and social media data using multimodal signals and pattern classification. Finally, it discusses broader opportunities in using social multimedia to understand societal trends and solve social problems.
This document discusses personal informatics tools for self-tracking health behaviors and the potential for these tools to facilitate behavior change. It provides an overview of self-tracking apps and devices, as well as models for understanding persuasive technologies and behavior design. A mid-long term research study is described that tracked participants using self-monitoring devices in the fall, winter with a silent period, and spring. The findings showed that most participants stopped tracking in the winter and some had negative reactions in the spring due to data frustrations or social factors. The conclusion discusses designing self-tracking tools for simplicity and focusing on abilities rather than motivation to better facilitate positive behavior changes.
This document provides information on various qualitative data collection methods, with a focus on observation and interview techniques. It discusses three broad categories of data collection: indirect observation, direct observation, and elicitation. For observation, it describes different types of observers and challenges of observation. It emphasizes the importance of practicing observational skills. For interviews, it outlines types of interviews, issues to consider, and describes the in-depth interview process from planning to conducting the interview. Key functions of communication in interviews are also summarized.
Applications of Behavioural Economics to consumer insightErica van Lieven
Shown at the AMSRS National Conference 2013 this presentation on Behavioural economics by Ben Wright highlights the very interesting findings from a small exploratory study that could serve as the basis to the beginnings of a revolutionary measure in the market research industry.
Forever Cyborgs – a long view on physical-digital interactionAlan Dix
Keynote at the European Conference on Cognitive Ergonomics (ECCE 2022), Kaiserslautern, Germany, 7th Oct 2022.
https://alandix.com/academic/talks/ECCE2022-keynote/
From prehistory to the internet age, humans have always lived as part of a technologically mediated world. Knapped flints have given way to touch-screens, cuneiform to CSS, but in both rapid hand-eye coordination and long-term social interactions, our experiences and actions in the world are embedded in a physical, mechanical, symbolic and digital nexus. After far too long in the writing, my co-authors and I are delighted that "TouchIT: Understanding Design in a Physical-Digital World" is finally published – symbolic words, recorded in digital media and printed on physical paper. This book covers established and emergent digital technology, but repeatedly the continuity of current and past technology, physical and digital worlds is evident. The fundamental cognitive resources that enable our digital existence in an age of constant flux are the result of aeons of development in a physical world that we remake and reimagine. In this talk I will explore multiple scales of digital interaction from seconds to years, informed by and illuminating what it means to be a fully embodied and richly reflective human.
Effective Presenting with ‘Think, Feel, Do!’Ray Poynter
Effective research needs to result in outcomes, and changes that are beneficial to the organisation commissioning the research.
The ability of the research to help bring about change depends on how it is communicated. In many cases, the only part of the research that has any impact or visibility is the presentation, i.e. the actual presentation and any report / ‘leave behind’/ or 'take-aways'.
In this webinar, Ray Poynter, focuses on how to use the ‘Think, Feel, Do!’ approach to create effective communications, i.e. communications that result in actions.
Digital Marketing Trends in 2024 | Guide for Staying AheadWask
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
Quantified Self: The what, the why and the brave new futureAlja Isakovic
Slides from a lecture on the quantified self trend, prepared for communications students in May 2016. The lecture is based on a series of blog posts I wrote on the topic: https://medium.com/exploring-the-quantified-self
1) The document outlines an "Immortality Roadmap" with various approaches and methods for achieving "Digital Immortality" through comprehensively reconstructing a person based on collected information traces.
2) It details many specific techniques for information collection including constant video/audio recording, archiving documents and photos, DNA sequencing, medical scans, psychological tests, and more.
3) The goal is to gather enough identifiable information to allow reconstruction of the individual's personality and thought processes through an AI assistant or virtual avatar even after biological death. This could help solve problems like information loss during reconstruction.
We will all have in Human Ledgers in the FutureCathal Gurrin
Cathal Gurrin argues that human ledgers, which comprehensively capture an individual's life experiences through sensors and data, will become common in the future. Early examples of human ledgers include lifelogging projects from the 2000s that captured photos, locations, and biometrics. Future human ledgers may incorporate richer data sources like vision, speech, health metrics, and social media to benefit areas like health monitoring, memory augmentation, and education. While promising benefits, human ledgers also raise privacy and data ownership issues that require consideration.
The document provides an overview of a Quantified Self club meeting at USC. It discusses what self-quantification is, examples of data that can be tracked, and expectations for the club. Members are expected to do presentations on self-tracking projects or apps. Suggested topics include reviewing a tracking device, sharing an analytics tool, or explaining a quantified self project done by someone else. Common areas of interest to track include health, productivity, and psychological states. The club aims to help members learn data and presentation skills through sharing self-tracking experiences.
1. People have long been fascinated with understanding themselves through objective analysis of their surroundings and tracking tools help provide insights into activities, behaviors, and improvements.
2. Tracking technologies have evolved from simple devices like pedometers to more advanced sensors in devices that can track a variety of daily activities both active and inactive.
3. Emerging areas of focus include location-based tracking and combining multiple sensory data streams to gain a more holistic view of behaviors.
This document summarizes an interview study of 22 people who use fitness tracking technologies like apps and devices. The following key points are made:
- People track a variety of health metrics like walking, exercise, eating, weight, and sleep, often using multiple trackers for different purposes like training, weight loss, and sleep.
- Tracking is usually not long-term, but rather focused on specific events or daily goals. Data is rarely shared on social media due to perceptions of egotism.
- Tracking is often a social activity done with families, partners, or coworkers to compare data and progress together.
- Future tracker design should support co-emergence of activities and tracking over time,
Perception is the process by which we become aware of objects, events, and people around us through our senses. Our perceptions are influenced by physical, environmental, internal, and learned elements. We actively select certain stimuli to focus on based on various factors and then organize this information using cognitive schemas like prototypes, personal constructs, stereotypes, and scripts. Finally, we interpret the meaning of what we perceive by making attributions about its locus, stability, specificity, and our responsibility. However, our perceptions do not necessarily reflect an ultimate reality and are subject to errors and biases.
Machine Learning for Non-technical Peopleindico data
Machine learning is one of the most promising and most difficult to understand fields of the modern age. Here are the slides from Slater Victoroff's (CEO of indico) talk at General Assembly Boston for non-technical folks on how to separate the signal from the noise -- stay tuned for the next time he speaks:
https://generalassemb.ly/education/machine-learning-for-non-technical-people
Acm achievement award acceptance 20101026Ramesh Jain
Ramesh Jain summarizes his career and life experiences in a presentation to his professional family at UCI. He discusses his research in computer vision, multimedia, and experiential computing. Jain expresses his vision for personalized experiences centered around the user, not just content, and technologies that can improve lives globally by connecting people through situations. He dreams of ACM Multimedia leading media innovation to benefit the "middle of the pyramid" - the world's middle class.
Play, Pause, Rewind - The Era of Archived LifetimesCathal Gurrin
Play, Pause, Rewind - The Era of Archived Lifetimes.
From mobile devices to pervasive computing. When we store our data, we enter the era of archived lifetimes and lifelogging.
Lifelogging, egocentric vision and health: how a small wearable camera can he...Petia Radeva
Petia Radeva discusses how lifelogging and wearable cameras can help improve health. Computer vision and deep learning techniques can be applied to extract useful information from large amounts of egocentric image data. Key information that can be derived includes what a person eats, where and with whom they eat, and how active they are. This type of quantified self-data has the potential to help manage health conditions like obesity, diabetes and migraines by identifying triggers and monitoring lifestyle factors and habits over time. Lifelogging also shows promise for cognitive treatment of patients with amnesia or mild cognitive impairment.
This document discusses using big image/multimodal data and computer vision techniques to gain insights from large amounts of visual data on the internet. It first discusses how image data is the largest form of big data and presents challenges to analyze due to its unstructured nature. It then describes several applications of big image/multimodal data analytics like medical image analysis, social media summarization, and sentiment analysis. Next, it outlines experiments on predicting mental health from webcam and social media data using multimodal signals and pattern classification. Finally, it discusses broader opportunities in using social multimedia to understand societal trends and solve social problems.
This document discusses personal informatics tools for self-tracking health behaviors and the potential for these tools to facilitate behavior change. It provides an overview of self-tracking apps and devices, as well as models for understanding persuasive technologies and behavior design. A mid-long term research study is described that tracked participants using self-monitoring devices in the fall, winter with a silent period, and spring. The findings showed that most participants stopped tracking in the winter and some had negative reactions in the spring due to data frustrations or social factors. The conclusion discusses designing self-tracking tools for simplicity and focusing on abilities rather than motivation to better facilitate positive behavior changes.
This document provides information on various qualitative data collection methods, with a focus on observation and interview techniques. It discusses three broad categories of data collection: indirect observation, direct observation, and elicitation. For observation, it describes different types of observers and challenges of observation. It emphasizes the importance of practicing observational skills. For interviews, it outlines types of interviews, issues to consider, and describes the in-depth interview process from planning to conducting the interview. Key functions of communication in interviews are also summarized.
Applications of Behavioural Economics to consumer insightErica van Lieven
Shown at the AMSRS National Conference 2013 this presentation on Behavioural economics by Ben Wright highlights the very interesting findings from a small exploratory study that could serve as the basis to the beginnings of a revolutionary measure in the market research industry.
Forever Cyborgs – a long view on physical-digital interactionAlan Dix
Keynote at the European Conference on Cognitive Ergonomics (ECCE 2022), Kaiserslautern, Germany, 7th Oct 2022.
https://alandix.com/academic/talks/ECCE2022-keynote/
From prehistory to the internet age, humans have always lived as part of a technologically mediated world. Knapped flints have given way to touch-screens, cuneiform to CSS, but in both rapid hand-eye coordination and long-term social interactions, our experiences and actions in the world are embedded in a physical, mechanical, symbolic and digital nexus. After far too long in the writing, my co-authors and I are delighted that "TouchIT: Understanding Design in a Physical-Digital World" is finally published – symbolic words, recorded in digital media and printed on physical paper. This book covers established and emergent digital technology, but repeatedly the continuity of current and past technology, physical and digital worlds is evident. The fundamental cognitive resources that enable our digital existence in an age of constant flux are the result of aeons of development in a physical world that we remake and reimagine. In this talk I will explore multiple scales of digital interaction from seconds to years, informed by and illuminating what it means to be a fully embodied and richly reflective human.
Effective Presenting with ‘Think, Feel, Do!’Ray Poynter
Effective research needs to result in outcomes, and changes that are beneficial to the organisation commissioning the research.
The ability of the research to help bring about change depends on how it is communicated. In many cases, the only part of the research that has any impact or visibility is the presentation, i.e. the actual presentation and any report / ‘leave behind’/ or 'take-aways'.
In this webinar, Ray Poynter, focuses on how to use the ‘Think, Feel, Do!’ approach to create effective communications, i.e. communications that result in actions.
Similar to When My Data Actually Becomes My Data (20)
Digital Marketing Trends in 2024 | Guide for Staying AheadWask
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
Fueling AI with Great Data with Airbyte WebinarZilliz
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframePrecisely
Inconsistent user experience and siloed data, high costs, and changing customer expectations – Citizens Bank was experiencing these challenges while it was attempting to deliver a superior digital banking experience for its clients. Its core banking applications run on the mainframe and Citizens was using legacy utilities to get the critical mainframe data to feed customer-facing channels, like call centers, web, and mobile. Ultimately, this led to higher operating costs (MIPS), delayed response times, and longer time to market.
Ever-changing customer expectations demand more modern digital experiences, and the bank needed to find a solution that could provide real-time data to its customer channels with low latency and operating costs. Join this session to learn how Citizens is leveraging Precisely to replicate mainframe data to its customer channels and deliver on their “modern digital bank” experiences.
Best 20 SEO Techniques To Improve Website Visibility In SERPPixlogix Infotech
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/temporal-event-neural-networks-a-more-efficient-alternative-to-the-transformer-a-presentation-from-brainchip/
Chris Jones, Director of Product Management at BrainChip , presents the “Temporal Event Neural Networks: A More Efficient Alternative to the Transformer” tutorial at the May 2024 Embedded Vision Summit.
The expansion of AI services necessitates enhanced computational capabilities on edge devices. Temporal Event Neural Networks (TENNs), developed by BrainChip, represent a novel and highly efficient state-space network. TENNs demonstrate exceptional proficiency in handling multi-dimensional streaming data, facilitating advancements in object detection, action recognition, speech enhancement and language model/sequence generation. Through the utilization of polynomial-based continuous convolutions, TENNs streamline models, expedite training processes and significantly diminish memory requirements, achieving notable reductions of up to 50x in parameters and 5,000x in energy consumption compared to prevailing methodologies like transformers.
Integration with BrainChip’s Akida neuromorphic hardware IP further enhances TENNs’ capabilities, enabling the realization of highly capable, portable and passively cooled edge devices. This presentation delves into the technical innovations underlying TENNs, presents real-world benchmarks, and elucidates how this cutting-edge approach is positioned to revolutionize edge AI across diverse applications.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfChart Kalyan
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...Alex Pruden
Folding is a recent technique for building efficient recursive SNARKs. Several elegant folding protocols have been proposed, such as Nova, Supernova, Hypernova, Protostar, and others. However, all of them rely on an additively homomorphic commitment scheme based on discrete log, and are therefore not post-quantum secure. In this work we present LatticeFold, the first lattice-based folding protocol based on the Module SIS problem. This folding protocol naturally leads to an efficient recursive lattice-based SNARK and an efficient PCD scheme. LatticeFold supports folding low-degree relations, such as R1CS, as well as high-degree relations, such as CCS. The key challenge is to construct a secure folding protocol that works with the Ajtai commitment scheme. The difficulty, is ensuring that extracted witnesses are low norm through many rounds of folding. We present a novel technique using the sumcheck protocol to ensure that extracted witnesses are always low norm no matter how many rounds of folding are used. Our evaluation of the final proof system suggests that it is as performant as Hypernova, while providing post-quantum security.
Paper Link: https://eprint.iacr.org/2024/257
Trusted Execution Environment for Decentralized Process MiningLucaBarbaro3
Presentation of the paper "Trusted Execution Environment for Decentralized Process Mining" given during the CAiSE 2024 Conference in Cyprus on June 7, 2024.
A Comprehensive Guide to DeFi Development Services in 2024Intelisync
DeFi represents a paradigm shift in the financial industry. Instead of relying on traditional, centralized institutions like banks, DeFi leverages blockchain technology to create a decentralized network of financial services. This means that financial transactions can occur directly between parties, without intermediaries, using smart contracts on platforms like Ethereum.
In 2024, we are witnessing an explosion of new DeFi projects and protocols, each pushing the boundaries of what’s possible in finance.
In summary, DeFi in 2024 is not just a trend; it’s a revolution that democratizes finance, enhances security and transparency, and fosters continuous innovation. As we proceed through this presentation, we'll explore the various components and services of DeFi in detail, shedding light on how they are transforming the financial landscape.
At Intelisync, we specialize in providing comprehensive DeFi development services tailored to meet the unique needs of our clients. From smart contract development to dApp creation and security audits, we ensure that your DeFi project is built with innovation, security, and scalability in mind. Trust Intelisync to guide you through the intricate landscape of decentralized finance and unlock the full potential of blockchain technology.
Ready to take your DeFi project to the next level? Partner with Intelisync for expert DeFi development services today!
Building Production Ready Search Pipelines with Spark and MilvusZilliz
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Dandelion Hashtable: beyond billion requests per second on a commodity serverAntonios Katsarakis
This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).
Main news related to the CCS TSI 2023 (2023/1695)Jakub Marek
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
HCL Notes and Domino License Cost Reduction in the World of DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Tatiana Kojar
Skybuffer AI, built on the robust SAP Business Technology Platform (SAP BTP), is the latest and most advanced version of our AI development, reaffirming our commitment to delivering top-tier AI solutions. Skybuffer AI harnesses all the innovative capabilities of the SAP BTP in the AI domain, from Conversational AI to cutting-edge Generative AI and Retrieval-Augmented Generation (RAG). It also helps SAP customers safeguard their investments into SAP Conversational AI and ensure a seamless, one-click transition to SAP Business AI.
With Skybuffer AI, various AI models can be integrated into a single communication channel such as Microsoft Teams. This integration empowers business users with insights drawn from SAP backend systems, enterprise documents, and the expansive knowledge of Generative AI. And the best part of it is that it is all managed through our intuitive no-code Action Server interface, requiring no extensive coding knowledge and making the advanced AI accessible to more users.
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
When My Data Actually Becomes My Data
1. When My Data Actually Becomes My
Data
Alan F. Smeaton
Dublin City University
@asmeaton
2. Who’s Alan Smeaton ?
- DCU Professor for +20 years
- Founding Director of Insight
- Decorated, highly-cited, worked
on 00’s research projects, loads of
PhD graduates
- Background in multimedia
analysis, indexing and search
- Known for his collaborations
3. • We have an adversarial relationship with our personal data
• Usually gathered by third parties and in theory we own our data, but
we don’t manage, get value from, or use it ourselves
• We read about abuses of it
• We can also gather data ourselves, about ourselves, for standalone
niche applications (sleep, steps, energy, screen usage, travel, etc.), or
we can do extreme forms of this called lifelogging
• Lets have a look at that niche application area, and some of the
extreme lifelogging
3
4. Digital Footprints
• Digital Footprints used to be the electronic evidence of a
computer user's activity (online, local, etc.), used for debugging
• Early search engines logged queries/clicks
• Clickthroughs were mined, turned into AdWords, pushed the
boundaries of ML, created Google
• Now a digital footprint is the electronic evidence of your
existence, since everything is now digital and so much is logged
by third parties anyway
5. Digital Footprints
• We’re aware we consciously and unconsciously leave digital
footprints – conscious ones from
• Web searches
• Website visits and cookies
• Internet connections
• Purchases
• Social media check-ins, posts and photos
• These are what we expect Google et al. to know about us …
like all marketing, they use this to segment their market (us) so
we get adverts (like me viewing YouTube videos with fingers
crossed)
• With rich data they segment their market into N=1 by turning
footprints into personality profiles
6. Digital Footprints
• So that’s our digital footprints
• Some we know about, its obvious, and we accept,
we even like it … the Faustian pact
• Some we don’t realise, we’re surprised at, but we’re
OK with
• Some is a bit creepy, maybe crossing a line, intrusive
• Our awareness varies hugely – vast majority don’t
realise, those that do know, don’t actually know it all
7. • Most of the time, 3rd parties gather data about us but
occasionally we gather data about ourselves, we gather it
• That’s called lifelogging
7
8. Depending on what you want
to measure, there is likely to
be a device (or an app)
9. Digitise as much as you
can of life experience…
for many reasons
(memory, health, etc.).
Lifelogging
Sense and analyse
factors of interest
through numbers to gain
knowledge
Using
knowledge for
self-
improvement
through
experimentatio
n
Quantified
Self
Biohackin
g
11. Richard Buckminster Fuller
• Interested in “a very accurate record of a human
being" … so he made himself his own case study ..
put everything in and created a very rigorous
record … the Dymaxion Chronofile…
• He documented his life, philosophy and ideas
scrupulously by a diary every 15 minutes, now on
display at the Stanford Library.
11
Richard Buckminster
"Bucky" Fuller was an
American architect,
systems theorist,
author, designer,
inventor and futurist.
Fuller was the second
World President of
Mensa from 1974 to
1983
12. With more than 140,000 papers and 1,700 hours of audio and video, all stretching to more than
1,400 linear feet of material, Fuller’s life might be the most documented life of all time. From 1917
to his death in 1983 he collected all documentation including (mail, newspaper clippings,
drawings, blueprints, models, and even bills.
The Dymaxion Chronofile has been at the Stanford University Libraries Department of Special
Collections since 1999. There you can pick any day of these years of his life and find out exactly
what he was doing nearly to the hour by flipping through a scrapbook.
13. Vannevar Bush (External Memory)
13
Vannevar Bush was an
American engineer,
inventor and science
administrator, who
during World War II
headed the U.S.
wartime military R&D
including initiation of the
Manhattan Project. "As
We May Think" has
turned out to be a
visionary and influential
essay.
https://www.theatlantic.com/magazine/archive/1945/07/as-we-may-think/303881/
15. Steve Mann’s Wearcam
• Steve Mann (University of Toronto) built a wearable
camera called Wearcam (wearcam.org). Steve would
wear the camera and it uploaded images to the WWW
for others to see.
• Mann has been referred to as the "father of wearable
computing", having created the first general-purpose
wearable computer. Mann has also been described as
"the world's first cyborg”.
15
Steven Mann is a
Canadian researcher
and inventor best
known for his work on
augmented reality,
computational
photography,
particularly wearable
computing and high
dynamic range
imaging.
17. Gordon Bell
An early employee of Digital Equipment
Corporation (DEC), Bell designed several
PDP machines and later became Vice
President of Engineering, for VAX
computers
He is the experiment subject for the
MyLifeBits project, an experiment in life-
logging and an attempt to fulfill Vannevar
Bush's Memex.
17
Gordon Bell is an
American electrical
engineer, pioneer and
investor. He is the
founder of the
MyLifeBits project, an
experiment in life-
logging based on
Vannevar Bush's
Memex.
18. Lifelog
Life
Experience
The individual will have a lifelog / human
ledger for many aspects of life
experience… activities, experiences,
behaviours, information, biometrics… huge
volumes of data captured passively.
Gordon Bell – the lifelog philosophy
19. Cathal Gurrin
In 2006 he put on a wearable camera, he’s still wears one, every day all
day, 12 years and billions of data points later
His interest is in multimodal multimedia analysis, indexing and retrieval
27. Devices
Apple Watch & HealthKit
Wahoo Chest Strap
Fitbit Activity Tracker / Scales
Nokia Activity Tracker / Scales / BP
…
Aggregation Software
HealthKit
Microsoft Health
Gyrosco.pe
We’ll come
back to
this
37. Segmentation of raw data into
units such as events or moments.
These can be enriched
automatically with metadata,
increasing their value.
Events are analogous to our episodic
memory and can be segmented based
on many forms of data.
38. Quantified Self
Personal Insights
Data-driven Health
Augmented
Wellness
Behaviour Change
Enhanced Security
Population-wide
Analytics
Augmented
Community
Augmenting Human
Memory
Nomenclators
Augmented
Memory
Enhanced Productivity
& Education
Enhanced Interactions
Rich Sharing and
Reminiscing
Augmented
Cognition
Some (Individual) Use Cases for Lifelogging
Health & Wellbeing Memory & Cognition
39. Quantified-Self
Analysis
Self-discovery
Reflect
Contextual
Reminders
Remind
Sousveillance.
Protection of me
and bystanders
Protect
Find an item from
the digital self
Validate a memory
Contextual support
Answer
Reminiscence
Therapy
Social applications
Reminisce
Digital Agents
acting on our
behalf, during life
and after
Represent
The most interesting aspect is the potential for memory support,
where the lifelog works in synergy with your own memory.
Adapted from Abigail J. Sellen and Steve Whittaker. 2010. Beyond total capture: a constructive critique
of lifelogging. Communications of the ACM. 53, 5 (May 2010), 70-77.
40. • Back to OTS or regular quantified self rather than
extreme lifelogging
• Lets have a deeper look at one form of lifelogging
… sleep
40
41.
42. • Sleep is “active”, our brains do not shut down and
are almost as active, cataloging memories
• Sleep 5 stages – wake, relaxed wakefulness, light
sleep, deep sleep and REM sleep
• Starts from N1, goes through N2 to N3 (deep) and
then back up towards REM sleep, there is an
ordering
• If you sleep for 8 hours, you have 5 full cycles
Sleep Explained
43. • Each phase has characteristics
– REM – body paralysed, HR, RR increased,
body temperature drops, vivid dreams, brain
active, towards latter end of the night, memory
consolidation
– N1 – conscious of surroundings, hypnic jerks
– N2 – brief arousals, decreased HR, RR
– N3 or deep sleep – slowest HR, RR, difficult to
wake and then groggy
Sleep Explained
44. • Insufficient sleep makes you more
stupid, fatter, unhappier, poorer, sicker,
worse at sex, more grumpy, more likely
to get cancer, Alzheimer’s and to die in
a car crash !
• Recent years have focused on this,
we’re more aware because we
ourselves can now measure it
• [ Orthosomnia — a preoccupation with
perfecting one’s sleep data ]
Why is sleep important ?
45. • Sleep labs record EEG,
body and eye movement,
HR, HRV, RR, Oxygen
saturation, etc.
• They pool all these into a
polysomnograph for an
holistic overview, which
looks like …
Measuring Sleep (Properly)
46.
47. 1. Phone apps
2. Wrist-worn accelerometer devices
3. Movement radar or sonar
4. The Ōuru ring
Each of these uses a subset of sensors
Sensing Sleep – Our Options
49. • How ? They record ..
– Movement (in the bed, under pillow)
– Microphone (listening to your breathing)
– Sonar – inaudible frequency emitted and listened to, just like bats !
• There are many available, some freebies, some
paid … SleepScore, Sleep Cycle, Pillow, etc.
1. Smartphone Apps
50. • FitBit, Jawbone, Withings,
LARK, etc.
• These “just” do movement
but directly, so more
accurately than phone apps
2. Wrist-worn Accelerometers
51. • BiancaMed -> ResMed -> S+ was first to market
• Very low levels of transmitted radio-frequency
power acting as sonar
• Contactless, measures
motion, plus room
temperature, brightness
and noise level (from
phone, yes, phone is
listening as you sleep)
3. Sonar / Radar
52. 4. The Ōura Ring
• Includes accelerometer,
gyroscope, temperature, and
heart rate
• HR sampled using IR spectrum
at 250 Hz so able to do much
more than wrist-worn
• Contactless battery charge lasts
7 days, data capacity 6 weeks
• Low power Bluetooth download
to phone
53. • Consumer grade wearables are not sleep labs,
they use a proxy for an orchestra of sensors !
• Each individual sensor will have errors
(movement, sweat, etc.)
• The algorithms to compute “sleep efficiency” are
opaque and proprietary
• I compared S+ with Ōura for me over 8 weeks and
…
Accuracy of sleep tracking ?
54. • 56 days, but S+ not continuous (travel, S+ is not
travel-friendly) – I missed 1, 1 and 7 days
• Correlation is (only) 0.147 (rises to 0.16 when
blanks eliminated)
• And because ranges may not be normalized, the
visualization reveals …
S+ and Ōura
56. So What ?
• Its all a bit … unsatisfactory
• I’m feeling a bit … let down … it shouldn’t be like this,
there’s something not right
• I’m actually feeling … trapped .. its my data, about
me, but I can’t fix this, for me, I can’t leverage benefit,
• Not everyone is like me though, and would want to do
this, but maybe you’d want somebody to do this for
you, like a wealth manager or stock broker
• There are some benefits at population level
56
57. Almost all vendors who allow us gather individual
data, get value from pooling anonymised data
• Fitbit – 150B hours of HR data, statistics from
millions of sleep nights
• 23a DNA testing – diseases, long-lost relatives
• Strava – global heatmap of runs/cycles
• Jaw – pinpointing earthquake epicentres !
Population-level Analytics from Pooled
Individual Data
58. Resting Heart Rate is an excellent indicator of overall health.
https://finance.yahoo.com/news/exclusive-fitbits-150-billion-hours-heart-data-reveals-secrets-human-health-133124215.html
60. 2014 – Northern Calif. 6.0M Earthquake
% people who woke up correlates with
distance from epicentre
61.
62.
63. Back to my problem of …
• Unsatisfactory … let down … trapped
63
64. • Open up about their algorithms and allow a
“normalisation” of sleep metrics for interoperability
and device/vendor independence
• Include “errorbars” in their outputs
• Allow exporting of our data, our original raw data,
with those error margins
Sleep Sensing Vendors ought to …
65. • Imagine a world where our data is managed for us by trusted
third parties analogous to how banks manage wealth
• They may pool it, like banks lend money
• They may share mine with organisations like social media
companies, educational institutions, entertainment companies,
etc. but only if I say so, and I might get paid, or I might get better
services
• I would be delighted rather than afraid, to gather data and have
data gathered about me for my benefit
• Most people would not micromanage data, most people don’t
micromanage wealth
• We have seen the data points that can be gathered
Utopia ? Naivete ?
66. • What’s the appetite for this ?
• Is there even a demand ?
• Are there green shoots against surveillance
capitalism ?
68. Devices
Apple Watch & HealthKit
Wahoo Chest Strap
Fitbit Activity Tracker / Scales
Nokia Activity Tracker / Scales / BP
…
Aggregation Software
HealthKit
Microsoft Health
Gyrosco.pe
Remember
this ?
69. 6
9
• Consolidates health data from iPhone,
Apple Watch, and third-party apps
• Activity, Sleep, Mindfulness, and
Nutrition
• “You are in charge of your data”
• “The Health app lets you keep all your
health and fitness information under
your control and in one place on your
device. You decide which information is
placed in Health and which apps can
access your data through the
Health app”
75. dacadoo
• Revenue stream is
corporate
• Employer signs up
as a service to
employees,
employees use it,
employer gets
healthier (more
productive) staff
76. • I don’t see a spanner breaking up Surveillance
Capitalism, too traumatic
• I see a slow creep towards
– Surveillance Socialism (don’t like that)
– Surveillance Democracy (don’t like that either)
– Sousveillance
• Not happening overnight, generational