Download to read offline
Uploaded byAkshansh Chaudhary
Recursive Reality Notes - Akshansh Chaudhary
The document outlines various aspects of virtual reality (VR) and augmented reality (AR) education and development, focusing on technology advancements, project assignments, and upcoming events in New York City. It discusses the importance of content creation, motion capture, and real-time VR experiences while emphasizing student assignments related to the exploration of AR and VR applications. Additionally, it highlights tools and platforms available for VR development, including Unity, and provides insights into game mechanics and design principles.
More Related Content
Similar to Recursive Reality Notes - Akshansh Chaudhary
Recursive Reality Notes - Akshansh Chaudhary
- 2.
- 3. 31Aug2018 Primaryfocusoftheclass Wv virtualReality o NYCis focusing on it Joboffortunitiesforinternationalstudents VISA etc F several fagots in around NYC selfAssignment Startlearningunity 3D Theclass may not coverhereto use Unity UpcomingEvent in NYC Cin Sept2ndweek BrooklynArmyTerminallooth Anniversary Showcase yourVNproject getfunding o History ofVR Startedin early199Os a boxin which you stand operate Nextin 2005 headsets thatcame with computers 120 X350 Px resolution Oculus Riftlaunched in 2012 DK Madedizzy n hIw sho didn't catch upwithmovement SoOculussoldthemselves to FB Idea createcontent fora platformso thattheycan stick around fora longtime Akshansh Chaudhary 1 MFADT | Parsons School of Design
- 4. We haveMOTION CAPTURESTUDIOin school 4check it out Checkphojects by NYCMEDIA LAB Verizon othercompanieseduNYC workingon Sa transformativetechnology as comparedto4G what are its applications VB will havetremendous scope ofstreamingspeeds Check HTC vine we have it in school Currentlimitations of VI Difficulttohold connectivityissues inrealtime codeinseveral platformseverycompany Thas a difftcontentsstate Ukheadsetsdon't haveafocalpts Soeyes don'tknow wheretolook qwww.wdwb emtuYfhollFmare not Interestingproject create a Ukinteractionsuchthatthelearning curve is small Akshansh Chaudhary 2 MFADT | Parsons School of Design
- 5. Coming up withnew Uk contentis criticalforit tolast long Current topics in discussion Use Al as personalassistants companionship 4 a movie HER Nickfotuno oneofthebestGamedesigners Usedtoteach atParsons 42 yrs 0 Frederic E Church 9painterswin1800s cotopaxi sublimepaintings History SocietyforNewYork place forSublime paintings Harry Potter exhibition coming in Octsois Theidea ofthe cause is to go backtobasics understandnature exploretheworld 4Create Va experiences ninththatunderstanding Check out MicrosoftHololens otherV12devices 4Some ofthem are available at TNS 0 CheckGoogleCardboard Akshansh Chaudhary 3 MFADT | Parsons School of Design
- 6. Understanding physical spaceCdepthinformation Sowhen thingsareputin space theycan beputbehindother things BACCAM primary Vh headsetwhichwouldbeusedin class as tracksirisCnotheard Otherheadsets MeiageSolo Bridge Fone goodforeyetracking Magicleap oygffgnksfsanfqggfi.ge adusGo Ithebest HodgeHacking StructureSensor 8Dscanning can bedone using iOSdevices Graphics wise BEST HTC Vine Disadvantage lotofcables o Microsofthascreated a standard forVRdevelopment 4companies likeDellHeer HP etc are using it Isit is a separateplatform buttechnology wise it is still developing Akshansh Chaudhary 4 MFADT | Parsons School of Design
- 7. Magicleap 9 moregestures bettercustemignthanMS Hoblens Leapmotion Availableopensource fordownloadingdesignfiles Youwouldprimarily usethisforyourtargets o Holokit 9 NYUdevelopedheadset only does HR fan tah youneedtocode yourself For VR development Windowsdevices arebetterthanthose of Apple Take a PhysicalComputingclass nextsemester integrates PERIPHERALS very well Motiondetection glove withthis th yo Gesturecontrol sensor course Hokey Makey A kittoquickly makebuttons Dexmo f2 Giveforcefeedback t givea feelingoftouch virtually Woofer Oo Soundfeedbackband Olorama Scent fragrance PerceptionNeuron 9Motiontrackingsetup entirebody Perception won Tip Ifyou need anything talk to Sven Akshansh Chaudhary 5 MFADT | Parsons School of Design
- 8. Homeworkforthisweek lookforAR VR experiencesaroundNYC online Documentthe entirething in a blog 7Sept2018 JesperJuul PHDin Games Analysis on communitybuilding forgames wrotepapers Feistpersonshooter Ninogamesasdgnanimsystemsts rules goals game mechanics game space game components players what you are doing in a game your interactions Game DinaDash Thought idea ByTNSfaculty clickingthe game as pertimer Akshansh Chaudhary 6 MFADT | Parsons School of Design
- 9. Magicaich Ideaused in GameMechanics youwanttheplayerto get intothemagic circle Rules ofPlay Booktalksabout fundametalsofMagic Circle Magic CaicleexampleHodo Gamefeel Gamereferences Book talking about SuperHot feelingsofplayers Personas PlayninththeinosoftHolders PlayExperience Talkaboutthefunpartofa game only Cheap assets Chinese Website 9 taobao.com Akshansh Chaudhary 7 MFADT | Parsons School of Design
- 10. New wayoflooking atgames MDAGameDesign 4 taMechanics D Dynamics Is A Aesthetics iaE mYmzYt paneusing l JobSimulator Game simulatingjobexperience BoughtbyGoogle Marinate Game Experience 8 example JuicyBheakout TE ON MDAexampleof MDA little Big YIyforres.eu yPlanet Donmatheatgaffytuity 81 Depthkit Companies working on VolumetricScanning Realisticvideocaptureofpeople Holopastation Present in NY Kinectalsodoes it But Depthkit isbetter Akshansh Chaudhary 8 MFADT | Parsons School of Design
- 11. Dotutorials on dirty learnuse it Build SphereContraptionon Unity Indy Rigidbody component addPhysicsto your object Addmaterialtotheobjectforadding behavior Assetsection create Physicmaterial Akshansh Chaudhary 9 MFADT | Parsons School of Design
- 12. 14Sept2018 Cool VRproject Viewingsoundin Vh ExperimentswithGoogle ThyVR experience forBladeRunner Is Google CardboardgDaydream whencreatingobjects in 3Dspace don'tkeep it still It shouldhave some sortofmotion todepictlife I changethenoteofmotion ofunity Iplay Edit Pagettsettings Time fixedTimestamp TimeScale I speed Requires goodrenderingpower A fooling Unity Variable TimedetaTime proportionalmovement wot time automaticallydone t.EE Akshansh Chaudhary 10 MFADT | Parsons School of Design
- 13. variable Tinie time eg use sniefMusingthisMr 9141 Backlforth motionachieved Matching herding standards Phocessing Arduino Unity voidsetupCK void setup void Start 3 voiddraw1393 void loop 3 void Updated I Akshansh Chaudhary 11 MFADT | Parsons School of Design
- 14. 21Sept2018 TalkbyJesperJuul Amaster of fPsc FirstPersonShooterControl games Ideaofmakinga game fun's frustration 7 xTm GameStrategies walkSemidation Generativeisland audio Proteus Blocking playergoals egDgs4ia soDays Akshansh Chaudhary 12 MFADT | Parsons School of Design
- 15. 28Sept2018 whendoing VR developmentdon'tmakethe scene looking fromjustone side People shouldbeable to navigatefrom allangles In VR mostly we see content from 1stperson view So think aboutcloseup scenes Take close up pictures Analysing a spacefrombirds eye view is not the best thing Flatfigures are boring Details auras brings exciting needTerrain is very resource intensive in Unity So build models in Maya animated import it in Unity Idea8Even if it is a rule build it somewhereelse InUnity Terrain I unit I meter I Unity int I meter reallife For mobile platform use 2ooowints x sooo units 2km x 2km This is the mare you would use Akshansh Chaudhary 13 MFADT | Parsons School of Design
- 16. Infirstperson control seetheheightoftheperson 4Default height I 8winds 6ft Directional light straight light Sunlight File Buildsettings exportoptions Default Pc Mac player setting Othersetting aone THE Gamma valueadjusts lightness darkness Everything linear 3 Higherendgraphics looks HM 4 useforhighqualityobjects O O Akshansh Chaudhary 14 MFADT | Parsons School of Design
- 17. MainCamera 4 MsAA AntiAliasingMethod Redraws the corners ofthepixelforsmoothness z smoothing HDR 9Alsodoes anti aliasing Don't use both MsAA HDR So turnoff MsAA checkbox O O lighting very complicated object Takes a lotofbakingtime Indeceit lightbounce Direct withoutbaking weonlysee direct light lightwith baking8 Direct indirectvisible Akshansh Chaudhary 15 MFADT | Parsons School of Design
- 18. Goofoffend.see UncheckAutoGenerate Ifyou don't want the bakingtorun automatically Edit ProjectSettings Quality change thequalityofsender HighwayHigh Anti Aliasing Deepdown Disabled Using PostProcessing StackAsset Adjustallprocessing at once first PersonCam AddComponent 7 Post Processing Not Behavior Maincamera Asset 7Create 7 PostProcessing Profile XMLfile Drag and dropthisprofileon the addedcomponentofMainCamera Akshansh Chaudhary 16 MFADT | Parsons School of Design
- 19. AntiAliasing UseTemporal aedfisamplehasAA FastApproximate CFAAA TemporalCTAA Ambientocclusion Emphasizeanythingthatintersects qfthm.LI Motion Blue Can beusedtodothe drunkeffect Eye Adaptation when yougofromdarkroom tolight our eyesadjust Unityrecreates effect Bloom Using gloweffect on a light I Akshansh Chaudhary 17 MFADT | Parsons School of Design
- 20. Bloomeffect Color grading LUMETRICOLOR 8PremierePoo TonemapperFilmicCACES First PersonController 7 FirstPersoncharacter 7 Rendering Path Deferred If using VR use forward O O Akshansh Chaudhary 18 MFADT | Parsons School of Design
- 21. setup your computer for UR equipment IsAndroidSDKJava JDK Edit 7 Preference 7External Tools getall SDKs Followinstallation guide forGoogle Cardboard Daydream f Download these I link theSDK SDK Update tesian share screenshots Additionallighting assets on UnityAssetstore 4Legacy ImageEffects legacy Cinematic ImageEffects Akshansh Chaudhary 19 MFADT | Parsons School of Design
- 22. 05Oct 2018 Workin outfighting TURN offALL LIGHTS Starting fromscratch toseeeffectoflighting Changeskybox A solidcolor Change colorto black Inlighting turn all intensitymultiplierstozero Directional light turnoff checkbox setintensity zero O d Turn intensity multiplierto zero Giving a torcheffect fiftefittmentatha blown EID spotlight Akshansh Chaudhary 20 MFADT | Parsons School of Design
- 23. lighting mode Realtime usedfordynamicobjects third Baked foranobjectwhichdoesn't move eg terrain trees bake a richlightoncesothat it can bereused global Illumination In newer versions ofUnity 2018 Abaked light basicallypaintsthe light on the scene to savespace in realtime Akshansh Chaudhary 21 MFADT | Parsons School of Design
- 24. hitmanEEmfeaet.me This light was 0 baked Addanimation Tselectobject windowAnimation Create keyframesfor different properties Beforesettinglighting Adjustthestatic objects selectobject Inspector static lighting Mixedlighting Akshansh Chaudhary 22 MFADT | Parsons School of Design
- 25. Amin of Bakinglight on staticobjects lighty Afterclicking Generate g lighting Keeparatio of 1 10 2 40 is IT good g Compress lighting Tickle NOT render fullused Akshansh Chaudhary 23 MFADT | Parsons School of Design
- 26. Using lightPaoleeGrouprunifeemlyadd multiple light Putitwherethelightis changing g toteach dotstoresthe lightinfo on build So we can usethis infoon objects Select a dot press ctrlt D.li duplicatethedot 0 makeaddnddots 0 2 Adjustthe positionofthe 0 lightprobe wherever you place 0 theprobe it will take in information 0 lightprobe Data logger So ifyou want a particularcolorto behighlighted add more lightprobepoints fromthatsource Akshansh Chaudhary 24 MFADT | Parsons School of Design
- 27. lightning setimportance Selectthe lightInspector Rendermode MAult Important NotImportant I died lighting vertex lighting Moredetail d Don'thome Uses very less more than computingresources 4 imp lofts Ctakes onlyvertex in 1 scene infoforlighting Mid Team Builda worldusing whatever you havelearned Oct 26 focus on aesthetics Interactions aftermid term It should work in VR Once leaking completes youcan move theobject see which probepoints are affectingthe objectonthatposition This scene is mostlygreen So add more points on redregions bakeagain Akshansh Chaudhary 25 MFADT | Parsons School of Design
- 28. 12 Oct 2018 Workspacesto checktrends forinspiration Artstation Pinterest Behave creative environments Deviant Ast Akshansh Chaudhary 26 MFADT | Parsons School of Design
- 29. Polycount SUPAcommunity tocreateassets getfeedback on work FB pageTheTenthousand Hours Join it Guildwars Dribble Piscine Japanese style Akshansh Chaudhary 27 MFADT | Parsons School of Design
- 30. Howtocreate assets Techniques Photorealistic takingpicturesbuilding a 3Denvironment 4 through it Photogeometry Structuresensors doscanning through iPhone Companies working in Phatgeometry in NYC 8 I studio NYC Depthkit Nyc NYC MediaLab is building a VR ARLab Brooklyn Navy yard Building 22 Akshansh Chaudhary 28 MFADT | Parsons School of Design
- 31. AssetTools Tilt Brush works withOculusRift Shader Ascript in Unity you can controlhow many details you want 2 brush 3Dmodel pyneledit 2Dbased magica rood quickcharbuilding 3D coat realistictextures Cinema 4D create own shapes Medium 3D model in OculusRift Blender Milkshape takemodels fromgames putin other games fileformatconversion thetas egoia goodfor lowpolygon Retopology process to reducethefaces polygonsfrom 10 Hefaces to 10 K c say Akshansh Chaudhary 29 MFADT | Parsons School of Design
- 32. Miku MikuDance MMD Makecharacters animate dance tomusic Japanese design community Create 2 sD models LIVE 2D Putcharacters in a format exportto create fake 2 5D Akshansh Chaudhary 30 MFADT | Parsons School of Design
- 33. Unity Chan Download fromAssetStore to Get a3D model with all expressions 3D kitbashing thredulararrangement Building PARTSofa 3D model getthem to create a finalpiece Usingscrap tocreatesth meaningful Adobe Minamo Fuse Akshansh Chaudhary 31 MFADT | Parsons School of Design
- 34. Autodesk characterGenerator AdobeFuse better8online clipstudio Japaneseversion ofUnity BowlRoll MMD CommunityBlog forinspiration Open Hogwarts a project whichis an open communityfor creating Hogwarts setup theplatform on OculusGo with the prototypeof Mid Termproject Akshansh Chaudhary 32 MFADT | Parsons School of Design
- 35. I9Oct 2018 Maeragingresources formobileplatform AssetstoreResourcechecker importinproject Itshows alltheassets beingused intheproject checktheirsizes goto Photoshop trim it import thereduced file1512KD in Unity Sometimes texturesizes are of32 bit Ifthey I don'thave an alpha channel reduce it to 16bit Window Rendering Occlusion culling selectall Bake Idea Bakes onlythescenethatis visible notthe entire scene j Akshansh Chaudhary 33 MFADT | Parsons School of Design
- 36. Toreduce thesizefather go to therespectiveobject click on static in Inspector Afterdoingthatto allstatic objects use Occlusion Culling The compression would be better stateI Bakeas manylightsas you can don'tbunthem in realtime Inthe game view gotostats I seethevertices fanmobile ME3galiaatigan.ae hfngf.fm vertices L l th vertices ForOculusGo F specialsettings on theirwebsite tofurtheroptimize thescene Akshansh Chaudhary 34 MFADT | Parsons School of Design
- 37. whendoing gamedesign don'tshowtheentire screen atonce this willreducewhatneedstoberendered less no ofvertices Addturns tothe viewso thatthe X X X entireviewis 1 x x f notviable x ja Iv a Make a 2 3 sentencepitch Handover your world toanyonebysayingthispitch Akshansh Chaudhary 35 MFADT | Parsons School of Design
- 38. 26Oct 2018 Thinking languagesetse As yougetin your 2nd year focuson one skill buildon it Also learnthetoolswhichare used in theindustry open Frameworks notused in an industry Cinder alternative openframeworks used bythe industry Processing veryhinting notusedin an industry It is very slow to work on heavytasks Layers Processing Jana c mmmm inT.no fs JavaScript very usefulas it isusedin the industry However Is is nota visuallanguage It's greatfor connecting things together Akshansh Chaudhary 36 MFADT | Parsons School of Design
- 39. CommentsonElevatitch when you create an Elevatorpitchthinkaboutwhat you want otherstofeelafterseeing theproject 02Nov2018 ZachGage IndieGame Developer Fishinggames Playcrafting A communityteaching game design mobile dupt Awardevent at TNS in Dec2018 0News Nintendois working with a local NYC company toimplement their controllers in theschoolausiculum Akshansh Chaudhary 37 MFADT | Parsons School of Design
- 40. AssignmentfortheweekafterThanksgiving Research on theassignedtopicleg shades Understandits usefor2 weeks Nov 3rd 4thwk Give a 30 minphesenthexplainingthetopic its use totheclass 1 explore Designingyour own controller HumanInterfaceDeviceCHID Idea create a device which the computer understands addmaldriveris not required You can alsouse sound trigger controls on thecontroller eg AdGems PhonePhreaking usesound totriggercalling UsedintheSos Akshansh Chaudhary 38 MFADT | Parsons School of Design
- 41. o Makey Markey Deviceswhichcandetectv low levels ofresistance on thebody use that tocreateactions Using Adafruitcomponentstocreate an HD controller Arduino PaoMicro can be used as an HHScontroller Needs an additionalbluetoothmodule Nintendo Labo keyboard greatpComp device youtube Firstlookat NintendoLabo Usingthecameratotriggeractions Japan's culture newspapers includecarboardbasedprojects which inspires kidsto makestuff So they are familiar withmaking stuffwithcardboard Non HlD o LeapMotion Peroducts used forhandtacking Kinect They haveprogramlogicsystembuiltforUnity µConnect with PCthrough USB Good company to workfor friendly interested inproduct improvement Akshansh Chaudhary 39 MFADT | Parsons School of Design
- 42. Manus VRo b 900 MyoGestureControlArmband Tracksthe arm muscles when we grabsomething Dexmo f2 thimic touching in VN SmartGloves by Dani Hu TNS Alumni Woojer a belt to givemusic flb Now making a fullsuit Japan an algorithm thatgeneratescharacters when youinputdifftbarcodes blasted inJapan Akshansh Chaudhary 40 MFADT | Parsons School of Design
- 43. Apple'sfocus creating a livingroom technology Microsoft FDA approved Akinsurgery projectonthe backofa person's back doctors can analyze do surgery NAV MESH CNPc QR Samples Defining the area ofthe mapin Unityto bethe most expensiveto go ega.gepatrolling theobjectshould move in thekey Alfollows a path Michaelworked on it in 5 in s VerbalCommand Tv robustpipeline Google IBM Watson Createinteractionwith voice limitation 8 connectionspeeddependency sG will solve it latency willhave a guaranteedvalue it would be toox faster eye train Watson todetect HarryPotterspells done byKyle Akshansh Chaudhary 41 MFADT | Parsons School of Design
- 44. m Create aconversation through TextASpeech leg whathappens in a voicecall Watsoncloud expensiveservice l yrfreefor developers FeistGoo interactions free o Watch Watson Unity SDK series on YouTube a A TRICK Useyour TNS alias to createmultipleaccounts extendsoftwarelicenses get 2licenses o o Gamers liketo sit play think about thatwhen creatinggames1interactions forthataudience Akshansh Chaudhary 42 MFADT | Parsons School of Design
- 45. 09Nov2018 INTERACTIONS BASED ONGAZE o Newrendererfeaturehomecome on OculusGo Add a fewlines in thecodeto give a better rendering Using Gayeinning cRAYCASTING SONAR EVENT Setup a listenerto listentheaggressiveness aidknowthe 4yourplayerAbject intersection with an Setup Event object triggerevent f CDelegates Achain de listener Polling writing everything in the update1323 fn Akshansh Chaudhary 43 MFADT | Parsons School of Design
- 46. 0 Doing Raycasting on Unity CheckAssetshire Unity Projects 7VR Samples Ithasmostofthesettings alreadydone Automatically focuses on thetarget Titans jhaicalviewofthe menu Scriptspresent in Unity StatAssets OnUp KeyPressed OnDoron Key Released UsetheStd packageshared byKyle Usetheprefabs customize it as needed Sphere ChangeColors bwe can addsound on theobject o it doesn't destroyitself ScriptAR colorchange OnEnable OnDisable i b using events listeners Akshansh Chaudhary 44 MFADT | Parsons School of Design
- 47. Sphere fire It hasparticlesysteminsideitSo the object needs to be linked withtheparticles Ihfentimiffitote system add action remove action void onEnable void onDisable are built in functions using UnityEngine Addingthis tothescript willmake Unity understand Particle Systems Shortcut to commentfuncomment on E E Comment Al t k t o Uncomment Ctrl t k t u In a game F severalparticle systems So itgetsconfusing to don't use sound sys on a particle Treat an emptygameObject use it as a soundsource RR Explosion 4 var Michael Bay explosionparticleeffects Akshansh Chaudhary 45 MFADT | Parsons School of Design
- 48. If sthis privateyou want to see it in theinspectorwindow add Serializefield3 before it few multipleexplosion playwithdifftvolumelevels for bettereffects With using Events listeners if elsestatements are not needed anymore Akshansh Chaudhary 46 MFADT | Parsons School of Design
- 49. 30Nov2018 DIFFERENT PROJECT PRESENTATIONS KeDingNick's team DMthe DistanceIndependentMillimeters Creating a v1 that'sreadable Character in Unity Defaultfreight 1.6 Ul canvas set thescaleG o oo l when we import an inrage inside unity changeits propertyfrom Default to sprite Then in the UI element drag dropthis ring in the source Image section Dot MatrixSystem IsCreate a reference Sipin Unity Akshansh Chaudhary 47 MFADT | Parsons School of Design
- 50. Using Mixamo Rigging UploadingtoMixamo FBX Doesn't work well in thioamo Expertcharacteras 0 BT to be usedin Miami Downloadingfrom thinearms Always FBX forUnity FBX storesmaterials OBI Doesn'tstore Import FB in cab materials you can treat it there export it again as FBX Then inpostet in Unity usinganimationwinded making transition Using 2 brush a sculpting tool Good 3D softwareto use Element Akshansh Chaudhary 48 MFADT | Parsons School of Design
- 51. Echo Ashita DavidSpacialSound GoodsoftwareforSpacialSound Audio Handled throughaudiosource audiolistener Ago Yashwanth others Blind Flying Game Using Osesimpt x Akshansh Chaudhary 49 MFADT | Parsons School of Design
- 52. I4 Dec 2018 FINALS p Sam Commentsonmyfinialproject SATO Documenttheprocesswell That willhelpexplainthe concept Greatexplanation ofthephysicalprototype Testthe HUD byplacing it in differentlocations wrt the medicine 1 21 Akshansh Chaudhary 50 MFADT | Parsons School of Design
- 53. Theinterface the HUDhags with headmovement Improvethat Kyle Add an animation nextto the ring enzymesuch that whenthemedicinepassesthrough the animation blocks the enzyme That willcreate a better feedback to theplayer Theinterface starts veryquickly in the beginning butthe pacenormalizesafterwards Akshansh Chaudhary 51 MFADT | Parsons School of Design