http://raskar.info or CameraCulture Wiki Page
How to come up w ideas: Idea Hexagon
How to write a paper
How to give a talk
Open research problems
How to decide merit of a project
How to attend a conference, brainstorm
Strive for Five
Before 5 teams
Be early, let others do details
Beyond 5 years
What no one is thinking about
Within 5 steps of Human Impact
Relevance
Beyond 5 mins of instruction
Deep, iterative, participatory
Fusing 5+ Expertise
Fun, barrier for others
'Media' is a plural for medium. The medium for impact of digital technologies at MIT Media Lab can be photons, electrons, neurons, atoms, cells, musical notes and more.
Over the last 40 years, computing has moved from processor, network, social and more sensory.
MIT Media Lab works at the intersection of computing and such media for human-centric technologies.
Though revolutionary in many ways, digital photography is essentially electronically implemented film photography. By contrast, computational photography exploits plentiful low-cost computing and memory, new kinds of digitally enabled sensors, optics, probes, smart lighting, and communication to capture information far beyond just a simple set of pixels. It promises a richer, even a multilayered, visual experience that may include depth, fused photo-video representations, or multispectral imagery. Professor Raskar will discuss and demonstrate advances he is working on in the areas of generalized optics, sensors, illumination methods, processing, and display, and describe how computational photography will enable us to create images that break from traditional constraints to retain more fully our fondest and most important memories, to keep personalized records of our lives, and to extend both the archival and the artistic possibilities of photography.
Experience mapping serves as a perfect activity to bring into sprints. Diagrams allow you to pull together a wealth of information in a compact and compelling format that is efficient to use. They are well-suited for agile teams.
The key is to focus on engaging others in dialog. It’s not about the map (noun), it’s about mapping (verb). Turn customer insight in to action within the context of a sprint.
This talk will show you how to visualize the user experience quickly and leverage mapping in sprints. I’ll debunk the myth the mapping is a heavy, upfront activity. In fact, when done rapidly, mapping experiences becomes a springboard into creativity and solving real customer problems quickly.
Contains all information you need for an introduction to 3d printing. Includes:
What is 3d printing?
Why use 3d printing?
When did it begin?
How does it work? + 2 small videos to show the same
Recent developments and future
3D Scanners and their Economic FeasibilityJeffrey Funk
These slides use concepts from my (Jeff Funk) course entitled analyzing hi-tech opportunities to analyze how the economic feasibility of 3D scanners is becoming better through improvements in lasers, camera ICs, and processor ICs. 3D scanning is both a complement to 3D printing and a technology with its own unique applications. 3D printing of complex objects can be done from a CAD database or from a 3D scan where a 3D scan can be done with laser or other sources of white light such as LEDs.
3D scanning can also be done for other purposes. For example, scientists and engineers are using 3D scanners to survey archeological, construction, crime scene, and engineering sites, to document maintenance and repair of engineered systems, and to customize medical and dental products for humans. Improvements in lasers, LEDs, camera chips, ICs, and other components continue to improve the economic feasibility of 3D scanning. Longer wavelength lasers increase the scanning range, better camera chips improve the scanning resolution, and better lasers, camera chips, and processor ICs reduce the scanning time. For example, third generation scanners from Argon, one leading supplier, have 100 times higher resolution and one tenth the scan times of Argon’s first generation system.
For costs, lasers make up the largest percentage followed by camera and processor ICs. For example, lasers make up 80% of the hardware cost for one high-end system with a current cost of $1346 and a price of about $3000. As laser costs fall and as volumes enable smaller margins, the price of such systems will fall.
For the same reasons, low-end systems continue to emerge. These include Microsoft’s Kinect and an app for the iPhone. Microsoft’s Kinect was $150 while the app was only $4.99, both in early 2013. As such low-end systems proliferate, and high-end systems continue to get cheaper, 3D scanning will find new applications.
'Media' is a plural for medium. The medium for impact of digital technologies at MIT Media Lab can be photons, electrons, neurons, atoms, cells, musical notes and more.
Over the last 40 years, computing has moved from processor, network, social and more sensory.
MIT Media Lab works at the intersection of computing and such media for human-centric technologies.
Though revolutionary in many ways, digital photography is essentially electronically implemented film photography. By contrast, computational photography exploits plentiful low-cost computing and memory, new kinds of digitally enabled sensors, optics, probes, smart lighting, and communication to capture information far beyond just a simple set of pixels. It promises a richer, even a multilayered, visual experience that may include depth, fused photo-video representations, or multispectral imagery. Professor Raskar will discuss and demonstrate advances he is working on in the areas of generalized optics, sensors, illumination methods, processing, and display, and describe how computational photography will enable us to create images that break from traditional constraints to retain more fully our fondest and most important memories, to keep personalized records of our lives, and to extend both the archival and the artistic possibilities of photography.
Experience mapping serves as a perfect activity to bring into sprints. Diagrams allow you to pull together a wealth of information in a compact and compelling format that is efficient to use. They are well-suited for agile teams.
The key is to focus on engaging others in dialog. It’s not about the map (noun), it’s about mapping (verb). Turn customer insight in to action within the context of a sprint.
This talk will show you how to visualize the user experience quickly and leverage mapping in sprints. I’ll debunk the myth the mapping is a heavy, upfront activity. In fact, when done rapidly, mapping experiences becomes a springboard into creativity and solving real customer problems quickly.
Contains all information you need for an introduction to 3d printing. Includes:
What is 3d printing?
Why use 3d printing?
When did it begin?
How does it work? + 2 small videos to show the same
Recent developments and future
3D Scanners and their Economic FeasibilityJeffrey Funk
These slides use concepts from my (Jeff Funk) course entitled analyzing hi-tech opportunities to analyze how the economic feasibility of 3D scanners is becoming better through improvements in lasers, camera ICs, and processor ICs. 3D scanning is both a complement to 3D printing and a technology with its own unique applications. 3D printing of complex objects can be done from a CAD database or from a 3D scan where a 3D scan can be done with laser or other sources of white light such as LEDs.
3D scanning can also be done for other purposes. For example, scientists and engineers are using 3D scanners to survey archeological, construction, crime scene, and engineering sites, to document maintenance and repair of engineered systems, and to customize medical and dental products for humans. Improvements in lasers, LEDs, camera chips, ICs, and other components continue to improve the economic feasibility of 3D scanning. Longer wavelength lasers increase the scanning range, better camera chips improve the scanning resolution, and better lasers, camera chips, and processor ICs reduce the scanning time. For example, third generation scanners from Argon, one leading supplier, have 100 times higher resolution and one tenth the scan times of Argon’s first generation system.
For costs, lasers make up the largest percentage followed by camera and processor ICs. For example, lasers make up 80% of the hardware cost for one high-end system with a current cost of $1346 and a price of about $3000. As laser costs fall and as volumes enable smaller margins, the price of such systems will fall.
For the same reasons, low-end systems continue to emerge. These include Microsoft’s Kinect and an app for the iPhone. Microsoft’s Kinect was $150 while the app was only $4.99, both in early 2013. As such low-end systems proliferate, and high-end systems continue to get cheaper, 3D scanning will find new applications.
This workshop was given at Business of Software Conference USA 2018. Watch videos from previous BoS Conferences here: http://businessofsoftware.org/videos
MicroLED technology advances enable a credible cost reduction path toward high volume applications.
More info on: https://www.i-micronews.com/report/product/microled-displays-2018.html
The first prototype of our approaches to move beyond design thinking at DNA. Touching on a number of new tools and techniques as well as theoretical positions from a number of sources. Very much the bleeding edge of our current position.
Presentation given by Mark Billinghurst at the 2024 XR Spring Summer School on March 7 2024. This lecture talks about different evaluation methods that can be used for Social XR/AR/VR experiences.
How Spotify uses large scale Machine Learning running on top of Hadoop to power music discovery. From the NYC Predictive Analytics meetup: http://www.meetup.com/NYC-Predictive-Analytics/events/129778152/
Metal 3D Printing - Trends & Emerging Technologies3DEO
Matt Sand, President of metal additive manufacturing company 3DEO, made this presentation at MD&M East, a leading conference in manufacturing medical devices and surgical instruments. His presentation covered the trends and emerging technology in metal 3D printing. This article summarizes the main trends he highlighted in the presentation.
Lecture 8 in the COMP 4010 course on AR and VR. This lecture gives an overview of Augmented Reality technology. Taught by Mark Billinghurst on October 5th, 2017 at the University of South Australia
Lecture 3 in the 2022 COMP 4010 lecture series on AR/VR. This lecture provides an introduction for AR Technology. This was taught by Mark Billinghurst at the University of South Australia in 2022.
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityMark Billinghurst
Lecture 7 of the COMP 4010 course in Virtural Reality. This lecture was about 3D User Interfaces for Virtual Reality. The lecture was taught by Mark Billinghurst on September 13th 2016 at the University of South Australia.
This workshop was given at Business of Software Conference USA 2018. Watch videos from previous BoS Conferences here: http://businessofsoftware.org/videos
MicroLED technology advances enable a credible cost reduction path toward high volume applications.
More info on: https://www.i-micronews.com/report/product/microled-displays-2018.html
The first prototype of our approaches to move beyond design thinking at DNA. Touching on a number of new tools and techniques as well as theoretical positions from a number of sources. Very much the bleeding edge of our current position.
Presentation given by Mark Billinghurst at the 2024 XR Spring Summer School on March 7 2024. This lecture talks about different evaluation methods that can be used for Social XR/AR/VR experiences.
How Spotify uses large scale Machine Learning running on top of Hadoop to power music discovery. From the NYC Predictive Analytics meetup: http://www.meetup.com/NYC-Predictive-Analytics/events/129778152/
Metal 3D Printing - Trends & Emerging Technologies3DEO
Matt Sand, President of metal additive manufacturing company 3DEO, made this presentation at MD&M East, a leading conference in manufacturing medical devices and surgical instruments. His presentation covered the trends and emerging technology in metal 3D printing. This article summarizes the main trends he highlighted in the presentation.
Lecture 8 in the COMP 4010 course on AR and VR. This lecture gives an overview of Augmented Reality technology. Taught by Mark Billinghurst on October 5th, 2017 at the University of South Australia
Lecture 3 in the 2022 COMP 4010 lecture series on AR/VR. This lecture provides an introduction for AR Technology. This was taught by Mark Billinghurst at the University of South Australia in 2022.
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityMark Billinghurst
Lecture 7 of the COMP 4010 course in Virtural Reality. This lecture was about 3D User Interfaces for Virtual Reality. The lecture was taught by Mark Billinghurst on September 13th 2016 at the University of South Australia.
Abstract
Gone are the days, when innovation was believed to be the playground for experts and genius. IDEO consultants found in 1991 at Paolo Alto, California that is well known for innovations ranging from shopping carts to Apple mouse to medical devices, propagated that, “Anybody can innovate” via recipe called as, ‘Design thinking’. Design thinking is a user-centric approach that is a strategic department in many Organizations for Innovation and problem-solving. With scaled Agile framework promoting SAFe 5.0, Medical Device industry applies Design thinking in various areas of customer engagement, usability to ensure user needs are understood and met.
Patterns for building patterns communitiesYishay Mor
Keynote at e-Learning Patterns, Tübingen, March 4-6, 2009
http://www.iwm-kmrc.de/workshops/e-learning-patterns/
Video
http://www.iwm-kmrc.de/workshops/e-learning-patterns/videos/Keynote1YishayMor.html
http://www.iwm-kmrc.de/workshops/e-learning-patterns/videos/Keynote2YishayMor.html
Abstract
http://www.iwm-kmrc.de/workshops/e-learning-patterns/abstracts/patternscommunties.htm
The construct of design pattern is often summarised as "the core of a solution to a problem in context". What, then, is the problem that design patterns solve, and in which contexts?
As design patterns break new grounds in educational research and practice, challenging questions arise: how do we engage new audiences in the pattern paradigm? How do we adapt the form and modes of use of patterns to make them useful in diverse realms of practice? Why do we have such a strong conviction in the value of design patterns?
The tradition of design patterns refers to concepts such as "timelessness" and "expertise". These are problematic in a world of accelerating change. Yet another fundamental principle is accentuated; the need to establish robust design languages capable of capturing the complexity of problems in our environment and offering verifiable solutions. I argue that design-level discourse is imperative in many critical domains of human activity, and that patterns should play a central role in such discourse. Over the last few years, my colleagues and I have been developing a methodology for participatory workshops for practical design patterns. This methodology has emerged from the "Learning Patterns" project, and is being refined by the "Pattern Language Network" project.
In this talk, I will describe the methodology, its history and future plans, and provide some illustrative examples. I will also highlight some of the fundamental questions which is provokes.
Presentation for the interactive deep dive into Ash Maurya's Lean Canvas at Lean UX London in 20 May 2016. Covers its advantages over the Business Model Canvas, walks through each of the segment on the canvas and provides context on how the canvas is used within the lean product discovery process.
Weehawken/Union City Social Innovation Meetup KickoffSandy Sanchez
At the Meetup kickoff event, we introduced the concepts of social innovation and design thinking. The participants were taken through a fun and interactive exercise that served as an icebreaker as well as an introduction to some of the concepts in design thinking, empathy, active listening, and prototyping. We discussed how design thinking can be used in our community, referencing examples from other communities in the US as well as abroad. We also discussed the different types of events, how to participate, and volunteer opportunities.
Creative Collaborations: Using Design Thinking to Promote Multi-modal Transportation
Design is a tool that shapes messages through strategies such as branding, communications, infographics, signage, and interaction. Design is also a process that uncovers public perceptions and behavioral barriers. In this case study, the City of Chattanooga’s Transportation Department collaborated with junior graphic designers at UT Chattanooga to use “design thinking” to promote multimodal transportation. The result is a robust public service campaign based on research methods such as expert interviews, user testing, and empathy studies. Students learned how to design for public good while allowing their work to shift their own perceptions of transportation in a growing city.
Learning Objectives:
Participants will understand the basic concepts of graphic design as it relates to transportation.
Participants will be able to brainstorm ways in which design and communication could improve transportation in their areas.
Participants will be able to identify communication gaps for transportation in their communities.
Participants will understand technologies for online communication and marketing of transportation.
Presenter(s)
Presenter: Blythe Bailey City of Chattanooga
Co-Presenter: Jenny Park Chattanooga Regional Planning Agency
Co-Presenter: Aggie Toppins University of Tennessee at Chattanooga
Requirements Engineering for the HumanitiesShawn Day
This workshop explores how requirements engineering can be employed by digital and non-digital humanities scholars (and others) to conceptualise and communicate a research project.
requirementsEngineeringAs the field of digital humanities has evolved, one of the biggest challenges has been getting the marrying technical expertise with humanities scholarly practice to successfully deliver sustainable and sound digital projects. At its core this is a communications exercise. However, to communicate effectively demands an ability to effectively translate, define and find clarity in your own mind.
From Digital Literacy to Digital FluencyDavid Cain
While our students may appear to be digital natives, they rarely have the capacity to make wise or ethical decisions as they construct their digital identities. As educators, we have a moral imperative to guide our students--even in an ever-changing digital landscape.
Ethical Considerations in the Design of Artificial IntelligenceJohn C. Havens
A presentation for IEEE's Ethics Symposium happening in Vancouver, May 2016. Featuring presentations from John C. Havens, Mike Van der Loos, John P. Sullins, and Alan Mackworth.
Global Leaders for Innovation and Knowledge Program (GLIK)
GLIK2017F MF-504 Capstone Project (March 2nd)
2018.3.2 @ Chuo University, Fujitsu-JAIMS Foundation
ACM SIGGRAPH is delighted to present the 2017 Computer Graphics Achievement Award to Ramesh Raskar in recognition of his pioneering contributions to the fields of computational photography and light transport and for applying these technologies for social impact.
https://www.siggraph.org/about/awards/2017-cg-achievement-award-ramesh-raskar/
I recently gave a talk at ICCP 2015 and clarified that we should stop working on coded aperture for focus effects! (Thus negating my team's work in this area.). I also spoke about the lost decade of computational photography and how we have wasted too many years working on the wrong problems.
The way back to normal starts here
We all want to get out of the house. To reopen the economy. To feel secure again. Safe Paths builds tools that help communities flatten the curve of COVID-19 — together. CovidSafePaths.org
Video of the talk at https://www.youtube.com/watch?v=x9TCYuMUnco
Friction in data sharing is a large challenge for large scale machine learning. Emerging technologies in domains such as biomedicine, health and finance benefit from distributed deep learning methods which can allow multiple entities to train a deep neural network without requiring data sharing or resource aggregation at one single place. The talk will explore the main challenges in data friction that make capture, analysis and deployment of ML. The challenges include siloed and unstructured data, privacy and regulation of data sharing and incentive models for data transparent ecosystems. The talk will compare distributed deep learning methods of federated learning and split learning. Our team at MIT has pioneered a range of approaches including automated machine learning (AutoML), privacy preserving machine learning (PrivateML) and intrinsic as well as extrinsic data valuation (Data Markets). One of the programs at MIT aims to create a standard for data transparent ecosystems that can simultaneously address the privacy and utility of data.
Bio: Ramesh Raskar is an Associate Professor at MIT Media Lab and directs the Camera Culture research group. His focus is on AI and Imaging for health and sustainability. They span research in physical (e.g., sensors, health-tech), digital (e.g., automated and privacy-aware machine learning) and global (e.g., geomaps, autonomous mobility) domains. He received the Lemelson Award (2016), ACM SIGGRAPH Achievement Award (2017), DARPA Young Faculty Award (2009), Alfred P. Sloan Research Fellowship (2009), TR100 Award from MIT Technology Review (2004) and Global Industry Technovator Award (2003). He has worked on special research projects at Google [X], Apple Privacy Team and Facebook and co-founded/advised several companies. Project page https://splitlearning.github.io/" Ramesh Raskar is an Associate Professor at MIT Media Lab and directs the Camera Culture research group. His focus is on Machine Learning and Imaging for health and sustainability. They span research in physical (e.g., sensors, health-tech), digital (e.g., automated and privacy-aware machine learning) and global (e.g., geomaps, autonomous mobility) domains.
In his recent role at Facebook, he launched and led innovation teams in Digital Health, Health-tech, Satellite Imaging, TV and Bluetooth bandwidth for Connectivity, VR/AR and ‘Emerging Worlds’ initiative for FB.
At MIT, his co-inventions include camera to see around corners, femto-photography, automated machine learning (auto-ML), private ML, low-cost eye care devices (Netra,Catra, EyeSelfie), a novel CAT-Scan machine, motion capture (Prakash), long distance barcodes (Bokode), 3D interaction displays (BiDi screen), new theoretical models to augment light fields (ALF) to represent wave phenomena and algebraic rank constraints for 3D displays(HR3D).
Video: https://www.youtube.com/watch?v=2jq_5FaQbTg
After different rejections, the project of a lifetime Ramesh Raskar (associate professor at MIT) finally comes to life.
How did he manage to get his way out of this jungle of misleading signs and career traps? By becoming a pathfinder: always tense towards your goal but also critical and ready to adjust his strategy to reach it.
An incredible life lesson that he gave us in this talk at the last FAIL at Massachusetts Institute of Technology (MIT).
https://www.youtube.com/watch?v=2jq_5FaQbTg&feature=youtu.be&fbclid=IwAR3aAo7SIiCuHY_6ICTjXLOpNBUBwEEJUq72pD-V8N2nX2cWaVIxtPM1gBM
Ramesh Raskar is an Associate Professor at MIT Media Lab and directs the Camera Culture research group. His focus is on AI and Imaging for health and sustainability. These interfaces span research in physical (e.g., sensors, health-tech), digital (e.g., automating machine learning) and global (e.g., geomaps, autonomous mobility) domains. He received the Lemelson Award (2016), ACM SIGGRAPH Achievement Award (2017), DARPA Young Faculty Award (2009), Alfred P. Sloan Research Fellowship (2009), TR100 Award from MIT Technology Review (2004) and Global Indus Technovator Award (2003). He has worked on special research projects at Google [X] and Facebook and co-founded/advised several companies.
Associate Professor, MIT Media Lab
Ramesh Raskar is founder of the Camera Culture research group at the Massachusetts Institute of Technology (MIT) Media Lab and associate professor of Media Arts and Sciences at MIT. Raskar is the co-inventor of radical imaging solutions including femto-photography, an ultra-fast imaging camera that can see around corners, low-cost eye-care solutions for the developing world and a camera that allows users to read pages of a book without opening the cover. He is a pioneer in the fields of imaging, computer vision and machine learning.
Raskar’s focus is on building interfaces between social systems and cyber-physical systems. These interfaces span research in physical (e.g., sensors, health-tech), digital (e.g., tools to enable keeping data private in distributed machine learning applications) and global (e.g., geomaps, autonomous mobility) domains. Recent inventions by Raskar’s team include transient imaging to look around a corner, a next-generation CAT-scan machine, imperceptible markers for motion capture, long-distance barcodes, touch + hover 3D interaction displays and new theoretical models to augment light fields to represent wave phenomena.
Raskar has dedicated his career to linking the best of the academic and entrepreneurial worlds with young engineers, igniting a passion for impact inventing. Raskar seeks to catalyze change on a massive scale by launching platforms that empower inventors to create solutions to improve lives globally.
Raskar has received the Lemelson Award, ACM SIGGRAPH Achievement Award, DARPA Young Faculty Award, Alfred P. Sloan Research Fellowship, TR100 Award from MIT Technology Review and Global Indus Technovator Award. He has worked on special research projects at Google [X] and Facebook and co-founded and advised several companies. He holds more than 80 US patents.
Making the Invisible Visible: Within Our Bodies, the World Around Us, and Beyond
We need to transition from analysis to synthesis when it comes to large scale image based studies of satellite or street level images.
Large scale, image based studies have the ability to unlock the human potential and really address some of the most important societal problems. The question really is, are we going to do that through analysis or are we going to step up to the game and actually start doing synthesis? Are we only go to study and observations or are we going to go and actually make an impact in the society?
Can global image repositories help UN's sustainable development goals (SDGs)? help us understand the social determinants of health? Satellite imagery, Google street view and user contributed photos from a global image repository are being used for large scale image-based studies, visual census and sentiment analysis [Ermon][http://StreetScore.media.mit.edu]. But we need to go beyond simply relying on big data for investigating social questions via remote analysis. We need to transition from analysis to synthesis. For deployable social solutions, we need to consider the full stack of physical devices, organizational interests and sector-specific resources.
Image-based large studies allow us to predict poverty from daytime and nighttime satellite imagery which can influence critical decisions for aid and development planning. In project ‘StreetScore’, our group has shown that semantic analysis of street level imagery such as Google Streetview, can provide varied insights rich in urban perception; our recent project ‘StreetChange’ shows the benefits of time-series data in driving these insights (http://streetchange.media.mit.edu).
We have seen some amazing work and you'll hear from Stephano about poverty mapping my glove previous collaborators to a population density crop maps, Betaine. So we had been, that's been fantastic progress in, in using a global industry, uh, in, in these areas that are taken from satellites or drones and then a street level imagery is also very widely available, either very structured like Google street view, but also from a user contributor photos and to that Nikki like and others in my group have been working on can we do a sentiment analysis of, of this imagery in this case, sentiment analysis of the perceived safety just for Google Street and main street and then create kind of citywide maps of a perceived safety that can be used by city planners and urban planners. So, which is great. But coming back to analysis versus synthesis opportunities, I'm going to give you a flavor of one of the projects we worked on a which is street addresses.
Project page: https://splitlearning.github.io/
Papers: https://arxiv.org/search/cs?searchtype=author&query=Raskar
Video: https://www.youtube.com/watch?v=8GtJ1bWHZvg
Split learning for health: Distributed deep learning without sharing raw patient data: https://arxiv.org/pdf/1812.00564.pdf
Distributed learning of deep neural network over multiple agents
https://www.sciencedirect.com/science/article/pii/S1084804518301590
Otkrist Gupta, Ramesh Raskar,
In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of neural network-based systems, we propose a new technique to train deep neural networks over several data sources. Our method allows for deep neural networks to be trained using data from multiple entities in a distributed fashion. We evaluate our algorithm on existing datasets and show that it obtains performance which is similar to a regular neural network trained on a single machine. We further extend it to incorporate semi-supervised learning when training with few labeled samples, and analyze any security concerns that may arise. Our algorithm paves the way for distributed training of deep neural networks in data sensitive applications when raw data may not be shared directly.
What is SIGGRAPH NEXT?
By Juliet Fiss
What will be the next big thing at SIGGRAPH, and how can the SIGGRAPH community contribute in an impactful way to fields outside of traditional computer graphics? SIGGRAPH NEXT at SIGGRAPH 2015 explored these questions. In this new addition to the SIGGRAPH program, an eclectic set of speakers gave TED-style talks and posed grand challenges to the SIGGRAPH community. In this blog post, Professor Ramesh Raskar of the MIT Media Lab introduces SIGGRAPH NEXT and outlines his vision for it.
What will be the next big thing at SIGGRAPH?
The SIGGRAPH community has a set of hammers that it uses to solve problems: geometry processing, rendering, animation, and imaging. What will be the next hammer, the next major field of study, appear at SIGGRAPH? Let’s examine where our research ideas come from. Often, advances in machine learning, optimization, signal processing, and optics forge our hammers. Our selection of hammer also depends on the nails we see. The most common application areas of computer graphics currently include computer-aided design, movies, games, and photography.
We often ask: “Does this work contribute to SIGGRAPH techniques?”
We should also ask, “Does this work contribute SIGGRAPH techniques to _____?”
When we answer the challenges posed by these traditional application areas of computer graphics, we are “drinking our own champagne.” We have made amazing progress in these application areas, and we should celebrate! SIGGRAPH NEXT is about finding new varieties of champagne; for that, we need new varieties of grapes. We should invite others from nontraditional and emerging application areas to enjoy our champagne with us, and they will become part of our community. First, we can expand our work in existing areas like mobile, user interaction, virtual reality, fabrication, and new types of cameras. We can also expand into emerging areas such as healthcare, energy, education, entrepreneurship, materials, tissue fabrication, and social media. What’s next?
Professor Raskar highlights three top areas where we can make an impact. One big take-home message is that many of these applications involve biology: bio is the new digital, and it will affect us ubiquitously.
Ramesh Raskar
MIT Media Lab
Ramesh Raskar is an Associate Professor at MIT Media Lab. Ramesh Raskar joined the Media Lab from Mitsubishi Electric Research Laboratories in 2008 as head of the Lab’s Camera Culture research group. His research interests span the fields of computational photography, inverse problems in imaging and human-computer interaction. Recent projects and inventions include transient imaging to look around a corner, a next generation CAT-Scan machine, imperceptible markers for motion capture (Prakash), long distance barcodes (Bokode), touch+hover 3D interaction displays (BiDi screen), low-cost eye care devices (Netra,Catra), new theoretical models to augment light fields (ALF) to represent wave phenomena and algebraic rank constraints for 3D displays(HR3D).
In 2004, Raskar received the TR100 Award from Technology Review, which recognizes top young innovators under the age of 35, and in 2003, the Global Indus Technovator Award, instituted at MIT to recognize the top 20 Indian technology innovators worldwide. In 2009, he was awarded a Sloan Research Fellowship. In 2010, he received the Darpa Young Faculty award. Other awards include Marr Prize honorable mention 2009, LAUNCH Health Innovation Award, presented by NASA, USAID, US State Dept and NIKE, 2010, Vodafone Wireless Innovation Project Award (first place), 2011. He holds over 50 US patents and has received four Mitsubishi Electric Invention Awards. He is currently co-authoring a book on Computational Photography.
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)MdTanvirMahtab2
This presentation is about the working procedure of Shahjalal Fertilizer Company Limited (SFCL). A Govt. owned Company of Bangladesh Chemical Industries Corporation under Ministry of Industries.
Cosmetic shop management system project report.pdfKamal Acharya
Buying new cosmetic products is difficult. It can even be scary for those who have sensitive skin and are prone to skin trouble. The information needed to alleviate this problem is on the back of each product, but it's thought to interpret those ingredient lists unless you have a background in chemistry.
Instead of buying and hoping for the best, we can use data science to help us predict which products may be good fits for us. It includes various function programs to do the above mentioned tasks.
Data file handling has been effectively used in the program.
The automated cosmetic shop management system should deal with the automation of general workflow and administration process of the shop. The main processes of the system focus on customer's request where the system is able to search the most appropriate products and deliver it to the customers. It should help the employees to quickly identify the list of cosmetic product that have reached the minimum quantity and also keep a track of expired date for each cosmetic product. It should help the employees to find the rack number in which the product is placed.It is also Faster and more efficient way.
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Dr.Costas Sachpazis
Terzaghi's soil bearing capacity theory, developed by Karl Terzaghi, is a fundamental principle in geotechnical engineering used to determine the bearing capacity of shallow foundations. This theory provides a method to calculate the ultimate bearing capacity of soil, which is the maximum load per unit area that the soil can support without undergoing shear failure. The Calculation HTML Code included.
Saudi Arabia stands as a titan in the global energy landscape, renowned for its abundant oil and gas resources. It's the largest exporter of petroleum and holds some of the world's most significant reserves. Let's delve into the top 10 oil and gas projects shaping Saudi Arabia's energy future in 2024.
Welcome to WIPAC Monthly the magazine brought to you by the LinkedIn Group Water Industry Process Automation & Control.
In this month's edition, along with this month's industry news to celebrate the 13 years since the group was created we have articles including
A case study of the used of Advanced Process Control at the Wastewater Treatment works at Lleida in Spain
A look back on an article on smart wastewater networks in order to see how the industry has measured up in the interim around the adoption of Digital Transformation in the Water Industry.
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxR&R Consult
CFD analysis is incredibly effective at solving mysteries and improving the performance of complex systems!
Here's a great example: At a large natural gas-fired power plant, where they use waste heat to generate steam and energy, they were puzzled that their boiler wasn't producing as much steam as expected.
R&R and Tetra Engineering Group Inc. were asked to solve the issue with reduced steam production.
An inspection had shown that a significant amount of hot flue gas was bypassing the boiler tubes, where the heat was supposed to be transferred.
R&R Consult conducted a CFD analysis, which revealed that 6.3% of the flue gas was bypassing the boiler tubes without transferring heat. The analysis also showed that the flue gas was instead being directed along the sides of the boiler and between the modules that were supposed to capture the heat. This was the cause of the reduced performance.
Based on our results, Tetra Engineering installed covering plates to reduce the bypass flow. This improved the boiler's performance and increased electricity production.
It is always satisfying when we can help solve complex challenges like this. Do your systems also need a check-up or optimization? Give us a call!
Work done in cooperation with James Malloy and David Moelling from Tetra Engineering.
More examples of our work https://www.r-r-consult.dk/en/cases-en/
Hierarchical Digital Twin of a Naval Power SystemKerry Sado
A hierarchical digital twin of a Naval DC power system has been developed and experimentally verified. Similar to other state-of-the-art digital twins, this technology creates a digital replica of the physical system executed in real-time or faster, which can modify hardware controls. However, its advantage stems from distributing computational efforts by utilizing a hierarchical structure composed of lower-level digital twin blocks and a higher-level system digital twin. Each digital twin block is associated with a physical subsystem of the hardware and communicates with a singular system digital twin, which creates a system-level response. By extracting information from each level of the hierarchy, power system controls of the hardware were reconfigured autonomously. This hierarchical digital twin development offers several advantages over other digital twins, particularly in the field of naval power systems. The hierarchical structure allows for greater computational efficiency and scalability while the ability to autonomously reconfigure hardware controls offers increased flexibility and responsiveness. The hierarchical decomposition and models utilized were well aligned with the physical twin, as indicated by the maximum deviations between the developed digital twin hierarchy and the hardware.
About
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
• Remote control: Parallel or serial interface.
• Compatible with MAFI CCR system.
• Compatible with IDM8000 CCR.
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
• Easy in configuration using DIP switches.
Technical Specifications
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
Key Features
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
• Remote control: Parallel or serial interface
• Compatible with MAFI CCR system
• Copatiable with IDM8000 CCR
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
Application
• Remote control: Parallel or serial interface.
• Compatible with MAFI CCR system.
• Compatible with IDM8000 CCR.
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
• Easy in configuration using DIP switches.
Water scarcity is the lack of fresh water resources to meet the standard water demand. There are two type of water scarcity. One is physical. The other is economic water scarcity.
Overview of the fundamental roles in Hydropower generation and the components involved in wider Electrical Engineering.
This paper presents the design and construction of hydroelectric dams from the hydrologist’s survey of the valley before construction, all aspects and involved disciplines, fluid dynamics, structural engineering, generation and mains frequency regulation to the very transmission of power through the network in the United Kingdom.
Author: Robbie Edward Sayers
Collaborators and co editors: Charlie Sims and Connor Healey.
(C) 2024 Robbie E. Sayers
5. Thesis Plans: Takeaways
Waze for life: Global view, not just passion or perseverance
Scale: Think person to population scale (3 ways to do it)
Hot Money: Soc Impactful work has no funding .. find adjacent oppr
How:
1. SpotProbing
2. Maximize chances/ Streetlight Effect
3. Choose: People, Idea Hexagon, Timing
4. Find a hub
6. Waze for life: Global view, not just passion or perseverance
9. Research ..
• http://raskar.info or CameraCulture Wiki Page
– How to come up w ideas: Idea Hexagon
– How to write a paper
– How to give a talk
– Open research problems
– How to decide merit of a project
– How to attend a conference, brainstorm
• Tips
– Get on Seminar/Talks mailing lists worldwide
– http://www.cs.virginia.edu/~robins/YouAndYourResearch.html
– Why do so few scientists make significant contributions and so many are
forgotten in the long run?
– Highly recommended Hamming talk at Bell Labs
Ramesh Raskar, http://raskar.info
10. Thesis Plans: Takeaways
Waze for life: Global view, not just passion or perseverance
Scale: Think person to population scale (3 ways to do it)
Hot Money: Soc Impactful work has no funding .. find adjacent oppr
How:
1. SpotProbing
2. Maximize chances/ Streetlight Effect
3. Choose: People, Idea Hexagon, Timing
4. Find a hub
11. Ramesh Raskar, MIT Media Lab
After X, what is neXt
How to Invent?
Ramesh Raskar, MIT Media Lab
12. Ramesh Raskar, MIT Media Lab
Xd
X++
X X+Y
X
X
neXt
Ramesh Raskar, MIT Media Lab
http://www.slideshare.net/cameraculture/raskar-ideahexagonapr2010
13. Ramesh Raskar, MIT Media Lab
Simple Exercise ..
• Flickr
– Share Photos
What is neXt
Ramesh Raskar, http://raskar.info
16. • Before 5 teams
– Be early, let others do details
• Beyond 5 years
– What no one is thinking about
• Within 5 steps of Human Impact
– Relevance
• Beyond 5 mins of instruction
– Deep, iterative, participatory
• Fusing 5+ Expertise
– Fun, barrier for others
Strive for Five
18. Grand Opportunity Topics
Opportunity Investigation
Solution Presentation
Reflection + Implementation
Resource Map
Problem Canvas
Solution Canvas
Findings Plot
SpotProbing in Four Step
0. Create the Opportunity Statement
1. Resource Map
A. People and Organizations
B. Users and Beneficiaries
C. Breakthroughs and Risks
2. Problem Canvas
3. Solution Canvas
4. Findings Plot
SpotProbing | REDX.io | Raskar
19. Step 0. Opportunity Statement
“What if .. ” or “How can .. ”
Start Big.
Based on your Grand Opportunity, create “Actionable Statements”.
Do NOT use aspirations or annoyances.
Good examples:
How can we can use emerging AI technologies to improve farrmers lives?
What if high resolution radar is available beyond self driving cars?
Bad Examples:
How can we eliminate world hunger?
What if health screening is low cost and ubiquitos?
SpotProbing | REDX.io | Raskar
20. Option 1 Option 8,9
Option 2,3 Option 4
Option 5 Option 10
Option 7 Option 6
Sensors Computer Vision Crowdsourcing . . .
Greenhouses
Crop Prediction
Farmer Finances
Weather Stations
Problems
Techniques
An example Problem Canvas:
What if we can use emerging digital technologies to improve lives of farmers and create a new
AgTech opportunity? SpotProbing | REDX.io | Raskar
21. 4 1 Rural farmers, elderly
3 6 School children, Rural farmers, parents
6 10
Police force, Policy makers, Rural farmers, school
children
1 2 Elderly
8 9 University students, young professionals
10 5 Rural farmers, young professionals, parents
2 7 School children, Doctors
5 4 Teachers, University professors, Rural farmers
9 8 Cab drivers, delivery workers, Delivery management
7 3 Entrepreneurs, Rural farmers, young professionals
Scenarios
Constraints
Option 1
Option 2
Option 3
Option 4
Option 5
Option 6
Option 7
Option 8
Option 9
Option 10
Cost Time Impact
An example Solution Canvas
Regul
ation
Compet
ition …
SpotProbing | REDX.io | Raskar
22. Cost
Time
rural farmers
elderlyOption 1
Option 2
Option 3
Option 4
Option 10
Option 5
Option 9
Option 8
Option 7
Option 6
rural farmers
school children
parents
rural farmers
police force
policy makers
school children
elderly
university students
young professionals
young professionals
rural farmers
parents
school children
doctors
4. Findings
Plot
Time-Cost-Impact
A way to visually interpret
the results from the
Solution Canvas
teachers
university professors
rural farmers
cab drivers
delivery workersdelivery
management
rural farmers
entrepreneurs
young professionals
Create a word cloud of the
different directions of reach
in order to visually
represent the breadth of
impact that each solution
has.
Impact = Circle Size
SpotProbing | REDX.io | Raskar
23. Solution
Presentation
(Heilmeier's)
Some questions to answer
as you put together your
presentation
• WHY – Big idea
• How is it done today? What are the limits of current practice?
• WHO – Who cares?
If you’re successful, what difference will it make?
• WHAT – What’s new? What difference will it make?
• What are you trying to do? Articulate objectives without using jargon.
Why do you think it will be successful?
• HOW – Map of Users, Resource Requirements, Risks
and Workarounds, Milestones
What are the risks and payoffs?
How much will it cost?
How long will it take?
What are the midterm and final “exams” to check for success?
Create a separate slide with your solution map
SpotProbing | REDX.io | Raskar
24. Is project worthwhile? Heilmeier's Questions
• What
– What are you trying to do? Articulate your objectives using absolutely no jargon.
• Related work
– How is it done today, and what are the limits of current practice?
• Contribution
– What's new in your approach and why do you think it will be successful?
• Motivation
– Who cares?
– If you're successful, what difference will it make?
• Challenges
– What are the risks and the payoffs?
– How much will it cost?
– How long will it take?
• Evaluation
– What are the midterm and final "exams" to check for success?
• Why now? (why not before, what’s new that makes possible)
• Why us? (wrong answers: I am smart, passionate, perseverance ..)
http://en.wikipedia.org/wiki/George_H._Heilmeier#Heilmeier.27s_Catechism
25. Ramesh Raskar, MIT Media Lab
Pick atleast 2 out of 3
Fun
Cool
Media Coverage
Impact
Money
Social implications
Research
Novelty
Generality
Science
26. Thesis Plans: Takeaways
Waze for life: Global view, not just passion or perseverance
Scale: Think person to population scale (3 ways to do it)
Hot Money: Soc Impactful work has no funding .. find adjacent oppr
How:
1. SpotProbing
2. Maximize chances/ Streetlight Effect
3. Choose: People, Idea Hexagon, Timing
4. Find a hub
28. Thesis Plans: Takeaways
Waze for life: Global view, not just passion or perseverance
Scale: Think person to population scale (3 ways to do it)
Hot Money: Soc Impactful work has no funding .. find adjacent oppr
How:
1. SpotProbing
2. Maximize chances/ Streetlight Effect
3. Choose: People, Idea Hexagon, Timing
4. Find a hub
33. Thesis Plans: Takeaways
Waze for life: Global view, not just passion or perseverance
Scale: Think person to population scale (3 ways to do it)
Hot Money: Soc Impactful work has no funding .. find adjacent oppr
How:
1. SpotProbing
2. Maximize chances/ Streetlight Effect
3. Choose: People, Idea Hexagon, Timing
4. Find a hub
35. Research ..
• http://raskar.info or CameraCulture Wiki Page
– How to come up w ideas: Idea Hexagon
– How to write a paper
– How to give a talk
– Open research problems
– How to decide merit of a project
– How to attend a conference, brainstorm
• Tips
– Get on Seminar/Talks mailing lists worldwide
– http://www.cs.virginia.edu/~robins/YouAndYourResearch.html
– Why do so few scientists make significant contributions and so many are
forgotten in the long run?
– Highly recommended Hamming talk at Bell Labs
Ramesh Raskar, http://raskar.info
36. What distinguishes Media Lab projects ..
– Synthesize not just analyze
– Use power of human intelligence
• Intelligence Amplification
• Human in loop,
• Social Impact and empowerment
– Democratize, Power to the People
– Be paranoid .. Are we relevant and what is next?
Topics for discussion (create your own study group)
• How to pursue 'ideas in the spirit of the media lab'? What is not in the spirit of ML?
• How to make the best of ML resources?
• What are the common problems in picking/initiating/pursuing/finishing great projects?
• Case studies of successful transitions of efforts into research/demos/products and more
• Some procedural topics: juggling classes vs research, Apprenticeship vs independent
research, group dynamics, media coverage
Ramesh Raskar, http://raskar.info
38. Be proactive not reactive
Generalize today’s concepts
Avoid basing all on today’s hot tech (facebook/twitter/Kinect/VR/etc)
But we are still slaves to available tech
“Let’s do smart things with stupid technology today, rather than wait and do stupid things with smart
technology tomorrow” - Bill Buxton. You can ofcourse do even smarter things with smart tech.
Be prepared but careful on what you do
Be in optimist but be paranoid (vs pessimist + laidback)
Defer judgment (don’t dismiss, believe or start instantly on any idea)
Overnight success after months of work
Have a list of 10-20 problems .. Don’t work on first one you think or that comes your way
Talk to a lot of people (you trust) to see if worth pursuing as most ideas will be useless anyway
Don’t be religious, listen to others
Don’t fall in love with your own incremental idea
Find adjacent opportunity which is easier but is still important
Don’t work on the same project for 2+ years
Fail fast
If u want to win .. Be willing change rules of the game, sometimes the game itself
Remember the 4Ps and their SEQUENCE
– Projects > Papers > Polished Demo/Prototype > Press
– (Note ‘polished demo’ comes AFTER a paper or some external validation)
– Don’t chase press before you have a serious project that is peer-reviewed or validated (novelty and
impact should be already understood) Ramesh Raskar, http://raskar.info
39. • Questions before you start the project
• How to come up with ideas
• How to write a paper
• How to decide if the idea is worth pursuing
• What makes a great ML thesis
• Happy to meet
– Help you towards a fantastic + manageable thesis
Ramesh Raskar, http://raskar.info
40. What Makes a Good ML Thesis?
• An original piece of work
A good thesis puts forth an original
hypothesis/method/design/art piece with appropriate
testing/verification/critique
• Written well
Grammar, appropriate style, organization
• Comprehensive
A good thesis has sufficient information to allow a person of
ordinary skill in the art to replicate the results
A good thesis has a complete set of references
• Accurate
Do not blow hot air!! Every sentence in the thesis must be
correct!!! Do not exaggerate!!!
Slide by Hugh Herr
41. Thesis Organization
• Abstract
• Acknowledgements
• List of Tables and Figures
• Introduction
• Background
• Mechanism/Process Design
• Experimental Methods
• Results
• Discussion and Conclusions
• References
• Appendix A, B, etc. Ramesh Raskar, http://raskar.info
43. Thesis Plans: Takeaways
Waze for life: Global view, not just passion or perseverance
Scale: Think person to population scale (3 ways to do it)
Hot Money: Soc Impactful work has no funding .. find adjacent oppr
How:
1. SpotProbing
2. Maximize chances/ Streetlight Effect
3. Choose: People, Idea Hexagon, Timing
4. Find a hub