Report
Share
Recommended
バーチャル撮影システムによるMixed Reality表現
こちらのスライドは2021年5/28に行われるサイバーエージェントの技術カンファレンスCA BASE NEXTの14時からのセッションの登壇資料です。
https://ca-base-next.cyberagent.co.jp/sessions/virtual-productions-mixed-reality/
==
私はエンジニアとして株式会社CyberHuman Productionsと共に、バーチャル撮影スタジオの研究開発やCG演出実装を担当し、これまで、アーティストライブ、ファッションショー、技術カンファレンスなど、様々なイベントをバーチャルで実現してきました。
バーチャル撮影スタジオでは、リアルタイム3DCG合成撮影やモーションキャプチャ技術、Unreal Engine等を用いて、バーチャルイベントの新しい生配信体験を開発、制作してきました。
本発表では、従来の映像表現からリアルとバーチャルが融合するMixed Reality (MR) 表現への進化へのチャレンジについて話したいと思います。HoloLens2やAzure KinectなどCA BASE NEXTで用いているMR表現とそれを実現する技術について話します。
Kinect技術紹介20140407
Kinectは、カラーカメラ、深度センサー、マイクアレイを備えているセンサー機器です。最も特徴的な機能として、深度センサーから人を認識して「ボーン」とよばれる骨格データを自動生成する機能があります。
入手しやすいこともあり、Natural User Interfaceデバイスとしての標準的なデバイスとなっています。Kinectで得たノウハウは他のNUIデバイスを使うときにも役立つノウハウです。また、今夏発売される新型Kinectでも継承できるものになります。
Kinect Camp with TMCN 「Kinectでできる"楽しい"事例紹介」
2015年6月6日、日本マイクロソフトさんで開催された「Kinect Camp with TMCN」( http://peatix.com/event/89813 )でのキネクトを使った楽しい事例紹介の資料です。
30台以上のKINECT V2を用意してたくさんの人たちとキネクトについて学べた楽しいイベントでした。
MSDN LATAM Kinect SDK V2
The document compares the key features and specifications of the Kinect for Windows 1 and Kinect for Windows 2 sensors. The Kinect for Windows 2 sensor has improved color camera and depth camera resolutions, larger field of view, supports USB 3.0, and can track more skeleton joints compared to the original Kinect sensor. Several open source projects and code samples for Kinect for Windows 2 are also listed.
Stroke mangements ina
This document provides a national clinical guideline for the management of patients with stroke. It covers rehabilitation, prevention and management of complications, and discharge planning. The guideline aims to assist clinicians, healthcare teams, and departments to optimize stroke care. It focuses on general management, rehabilitation, and prevention strategies in the first year after stroke. The guideline complements other SIGN guidelines on specific topics related to stroke care.
Recommended
バーチャル撮影システムによるMixed Reality表現
こちらのスライドは2021年5/28に行われるサイバーエージェントの技術カンファレンスCA BASE NEXTの14時からのセッションの登壇資料です。
https://ca-base-next.cyberagent.co.jp/sessions/virtual-productions-mixed-reality/
==
私はエンジニアとして株式会社CyberHuman Productionsと共に、バーチャル撮影スタジオの研究開発やCG演出実装を担当し、これまで、アーティストライブ、ファッションショー、技術カンファレンスなど、様々なイベントをバーチャルで実現してきました。
バーチャル撮影スタジオでは、リアルタイム3DCG合成撮影やモーションキャプチャ技術、Unreal Engine等を用いて、バーチャルイベントの新しい生配信体験を開発、制作してきました。
本発表では、従来の映像表現からリアルとバーチャルが融合するMixed Reality (MR) 表現への進化へのチャレンジについて話したいと思います。HoloLens2やAzure KinectなどCA BASE NEXTで用いているMR表現とそれを実現する技術について話します。
Kinect技術紹介20140407
Kinectは、カラーカメラ、深度センサー、マイクアレイを備えているセンサー機器です。最も特徴的な機能として、深度センサーから人を認識して「ボーン」とよばれる骨格データを自動生成する機能があります。
入手しやすいこともあり、Natural User Interfaceデバイスとしての標準的なデバイスとなっています。Kinectで得たノウハウは他のNUIデバイスを使うときにも役立つノウハウです。また、今夏発売される新型Kinectでも継承できるものになります。
Kinect Camp with TMCN 「Kinectでできる"楽しい"事例紹介」
2015年6月6日、日本マイクロソフトさんで開催された「Kinect Camp with TMCN」( http://peatix.com/event/89813 )でのキネクトを使った楽しい事例紹介の資料です。
30台以上のKINECT V2を用意してたくさんの人たちとキネクトについて学べた楽しいイベントでした。
MSDN LATAM Kinect SDK V2
The document compares the key features and specifications of the Kinect for Windows 1 and Kinect for Windows 2 sensors. The Kinect for Windows 2 sensor has improved color camera and depth camera resolutions, larger field of view, supports USB 3.0, and can track more skeleton joints compared to the original Kinect sensor. Several open source projects and code samples for Kinect for Windows 2 are also listed.
Stroke mangements ina
This document provides a national clinical guideline for the management of patients with stroke. It covers rehabilitation, prevention and management of complications, and discharge planning. The guideline aims to assist clinicians, healthcare teams, and departments to optimize stroke care. It focuses on general management, rehabilitation, and prevention strategies in the first year after stroke. The guideline complements other SIGN guidelines on specific topics related to stroke care.
Kinect
The presentation provides an overview of the Kinect system, including its history, technology, and capabilities. It describes how Kinect uses structured light and machine learning to map depth and infer body position without any handheld controllers. Kinect launched in 2010 and quickly became the fastest selling consumer electronics device by selling 8 million units in its first 60 days. The technology represents significant advances in computer vision that enable natural user interfaces for gaming and beyond.
Develop Store Apps with Kinect for Windows v2
Agenda:
Intro
The Sensor
Data Source
Kinect Evolution
Data Source
Windows Store App
Body Frame
Coordinate Mapper
Kinect Studio
Gesture Recognition
Gesture Builder
Kinect V2: NUI for dummies!!
Sessione tenuta a Codemotion Roma 2014 l'11 Aprile 2014.
La seconda versione del Kinect, nonostante sia ancora nella fase di beta, porta con se grandi novità sia dal punto di vista hardware che delle funzionalità. Una sessione per capire come è cambiato e cosa mette a disposizione per la realizzazione di interfacce NUI di nuova generazione.
Kinect
Kinect is a motion sensing input device by Microsoft that was first discussed in 2007 and launched for the Xbox 360 in 2010. Using motion capture technology and infrared depth sensing cameras, Kinect allows for gesture control and motion gaming without any physical controllers. It has since been adapted for use in a variety of applications including physical therapy, vascular surgery, and vehicles.
Kinect2 hands on
All you need to know about Kinect2 development.
With these slides you can understand the system requirements needed to start developing with Kinect2 sensor, the available sources accessible with the sensor and the gestures you can perform in order to interact with touchless interfaces.
Kinect 2.0 Programming (3)
Kinect03 程式顯示Kinect One 持續傳入的彩色影像(1920x1080 @30fps)，提供影像分色處理選項與影像存檔功能，顯示已存檔數目，並加上Kinect Gesture 操控功能，讓使用者除了滑鼠、觸控螢幕操控之外，亦可以身體的動作或姿勢操控。
Kinect 2.0 Programming (1)
Kinect01 程式顯示 Kinect One 持續傳入的彩色影像 (1920x1080 @30fps)，提供影像分色處理選項與影像存檔功能，並顯示已存檔數目。
Kinect 2.0 Programming (4)
Kinect04 程式顯示 Kinect One 持續傳入的彩色影像，將挑選瞬間的影像存成 JPEG 檔，將影像檔案上傳雲端 Microsoft Project Oxford 提供之臉部偵測 (Face Detection) 服務，以取得影像中人臉位置、年齡、性別、微笑程度等資訊，將資訊整理後顯示在畫面。
はじめてのKinect for windows v2
2014/09/24,26に行われた、東京エレクトロンデバイス株式会社主催「Kinect for Windows v2最新情報セミナー」の資料です。
大阪開催時に最初のスライドをいくつか追加しました。
Overview of The Virtual Dressing Room Market - Augmented World Expo
This is Zugara's presentation on the Virtual Dressing Room Market at the Augmented World Expo. Presentation covers brief overview on Zugara, 3 Signs that Virtual Dressing Rooms have arrived, and 3 Challenges ahead for Virtual Dressing Rooms.
Kinect 2.0 Programming (2)
Kinect02 程式將 SlideShow 圖片播放程式加上 Kinect Posture 操控功能，讓使用者除了滑鼠、觸控螢幕操控之外，亦可以身體的姿勢操控自動播放彩色影像，或一次播放一張彩色影像。
Programming with kinect v2
This document provides an overview of the Kinect sensor and Kinect for Windows SDK. It introduces the Kinect sensor specs and components. It describes the various data sources that can be accessed from the Kinect like the color video stream, depth map, skeleton data, and audio. It also discusses programming with the Kinect SDK, including accessing frame data, coordinate mapping, and using the Kinect APIs for applications. Examples are provided for gesture recognition, recording and playback functionality, and building basic controls into an app using the Kinect.
Kinect presentation
A brief discussion about Kinect Technology using Microsoft X Box Gaming console and its application in other fields like medicine.
Kinect v2 Introduction and Tutorial
Tsukasa Sugiura presented an introduction to Kinect v2. Key points included:
- Kinect v2 features improved color camera, depth sensor, infrared camera, and body tracking capabilities compared to v1.
- It supports tracking of 6 people with 25 joints per person and new hand gestures like lasso.
- The SDK provides access to color, depth, infrared, body index, and body frames from the sensor.
- Demonstrated the basic workflow of initializing the sensor, getting frame sources and readers, and processing frame data for different streams.
Kinect
This document provides an overview of Kinect motion technology. It describes how Kinect uses an infrared sensor and camera to track a user's full-body motion and interpret gestures and voice commands to control applications without any additional input devices. Applications discussed include gaming, healthcare, virtual pianos, and using Kinect to control robots and provide gesture-based interactions in augmented reality. Advantages are noted as not requiring additional input devices and allowing for voice and facial recognition, while disadvantages include sensitivity to infrared light sources and not detecting certain materials well.
More Related Content
Viewers also liked
Kinect
The presentation provides an overview of the Kinect system, including its history, technology, and capabilities. It describes how Kinect uses structured light and machine learning to map depth and infer body position without any handheld controllers. Kinect launched in 2010 and quickly became the fastest selling consumer electronics device by selling 8 million units in its first 60 days. The technology represents significant advances in computer vision that enable natural user interfaces for gaming and beyond.
Develop Store Apps with Kinect for Windows v2
Agenda:
Intro
The Sensor
Data Source
Kinect Evolution
Data Source
Windows Store App
Body Frame
Coordinate Mapper
Kinect Studio
Gesture Recognition
Gesture Builder
Kinect V2: NUI for dummies!!
Sessione tenuta a Codemotion Roma 2014 l'11 Aprile 2014.
La seconda versione del Kinect, nonostante sia ancora nella fase di beta, porta con se grandi novità sia dal punto di vista hardware che delle funzionalità. Una sessione per capire come è cambiato e cosa mette a disposizione per la realizzazione di interfacce NUI di nuova generazione.
Kinect
Kinect is a motion sensing input device by Microsoft that was first discussed in 2007 and launched for the Xbox 360 in 2010. Using motion capture technology and infrared depth sensing cameras, Kinect allows for gesture control and motion gaming without any physical controllers. It has since been adapted for use in a variety of applications including physical therapy, vascular surgery, and vehicles.
Kinect2 hands on
All you need to know about Kinect2 development.
With these slides you can understand the system requirements needed to start developing with Kinect2 sensor, the available sources accessible with the sensor and the gestures you can perform in order to interact with touchless interfaces.
Kinect 2.0 Programming (3)
Kinect03 程式顯示Kinect One 持續傳入的彩色影像(1920x1080 @30fps)，提供影像分色處理選項與影像存檔功能，顯示已存檔數目，並加上Kinect Gesture 操控功能，讓使用者除了滑鼠、觸控螢幕操控之外，亦可以身體的動作或姿勢操控。
Kinect 2.0 Programming (1)
Kinect01 程式顯示 Kinect One 持續傳入的彩色影像 (1920x1080 @30fps)，提供影像分色處理選項與影像存檔功能，並顯示已存檔數目。
Kinect 2.0 Programming (4)
Kinect04 程式顯示 Kinect One 持續傳入的彩色影像，將挑選瞬間的影像存成 JPEG 檔，將影像檔案上傳雲端 Microsoft Project Oxford 提供之臉部偵測 (Face Detection) 服務，以取得影像中人臉位置、年齡、性別、微笑程度等資訊，將資訊整理後顯示在畫面。
はじめてのKinect for windows v2
2014/09/24,26に行われた、東京エレクトロンデバイス株式会社主催「Kinect for Windows v2最新情報セミナー」の資料です。
大阪開催時に最初のスライドをいくつか追加しました。
Overview of The Virtual Dressing Room Market - Augmented World Expo
This is Zugara's presentation on the Virtual Dressing Room Market at the Augmented World Expo. Presentation covers brief overview on Zugara, 3 Signs that Virtual Dressing Rooms have arrived, and 3 Challenges ahead for Virtual Dressing Rooms.
Kinect 2.0 Programming (2)
Kinect02 程式將 SlideShow 圖片播放程式加上 Kinect Posture 操控功能，讓使用者除了滑鼠、觸控螢幕操控之外，亦可以身體的姿勢操控自動播放彩色影像，或一次播放一張彩色影像。
Programming with kinect v2
This document provides an overview of the Kinect sensor and Kinect for Windows SDK. It introduces the Kinect sensor specs and components. It describes the various data sources that can be accessed from the Kinect like the color video stream, depth map, skeleton data, and audio. It also discusses programming with the Kinect SDK, including accessing frame data, coordinate mapping, and using the Kinect APIs for applications. Examples are provided for gesture recognition, recording and playback functionality, and building basic controls into an app using the Kinect.
Kinect presentation
A brief discussion about Kinect Technology using Microsoft X Box Gaming console and its application in other fields like medicine.
Kinect v2 Introduction and Tutorial
Tsukasa Sugiura presented an introduction to Kinect v2. Key points included:
- Kinect v2 features improved color camera, depth sensor, infrared camera, and body tracking capabilities compared to v1.
- It supports tracking of 6 people with 25 joints per person and new hand gestures like lasso.
- The SDK provides access to color, depth, infrared, body index, and body frames from the sensor.
- Demonstrated the basic workflow of initializing the sensor, getting frame sources and readers, and processing frame data for different streams.
Kinect
This document provides an overview of Kinect motion technology. It describes how Kinect uses an infrared sensor and camera to track a user's full-body motion and interpret gestures and voice commands to control applications without any additional input devices. Applications discussed include gaming, healthcare, virtual pianos, and using Kinect to control robots and provide gesture-based interactions in augmented reality. Advantages are noted as not requiring additional input devices and allowing for voice and facial recognition, while disadvantages include sensitivity to infrared light sources and not detecting certain materials well.
Viewers also liked (19)
Overview of The Virtual Dressing Room Market - Augmented World Expo
Overview of The Virtual Dressing Room Market - Augmented World Expo
Similar to Kinect入門
ViEW2013 「SS-01 画像センサと応用事例の紹介」
2013/12/06
ViEW2013 特別企画セッション「新たなセンサと画像認識の融合」
SS-01 画像センサと応用事例の紹介
http://view.itlab.org/2013/
AI神絵師はITエンジニアの未来をどう変えるのか
DevSumi23-10C1-AI神絵師はITエンジニアの未来をどう変えるのか #GREEVRStudioLab #DevSumi
DevelopersSummit2023
10-C-1 2023/2/10 10:00 ～ 10:40
AI神絵師はITエンジニアの未来をどう変えるのか？～メタバースR&DからみたAI画像生成のトレンド～
AI神絵師はITエンジニアの未来をどう変えるのか？メタバース開発、VRエンタテインメントシステム、メディアアート研究、写真工学、画像工学を専門に30年近い経験を持つ博士(工学)であるフルスタックエンジニア系研究者が、世界1000万ダウンロードを達成したスマホ向けメタバース「REALITY」を開発運営するREALITY株式会社の研究開発部門「GREE VR Studio Laboratory」のR&Dマネジメント業務やデジタルハリウッド大学の教授を行いながら業務外で話題のAI画像生成「Stable Diffusion」のリリースから2ヵ月で2冊の技術書「AIとコラボして神絵師になる」を執筆した経験と未来観測について凝縮してお伝えします。今後のAI関係やメタバース業界トレンドを先取りしつつ、エンジニアの長いキャリアの中でモチベーションの上がる話になるはずです。
https://event.shoeisha.jp/devsumi/20230209/session/4191/
ハイテクで最新なブーブークッションをつくってみました
2016/09/19 Mashup Awards 2016 Kickoff でのLT資料です。
Julie Wataiさんのハイテク・ブーブークッションの製作について発表しました。
Similar to Kinect入門 (20)
Sensor & Device Showcase 2014（Tokyo MotionControl Network）
Sensor & Device Showcase 2014（Tokyo MotionControl Network）