This document summarizes a computer vision tool being developed to help dance scholars analyze solo dance performances. The tool extracts the dancer's body contour from video frames and generates a skeletonized output to focus on body movements. It allows users to add textual annotations to frames and view the original and processed videos simultaneously. Future work includes vectorizing the dancer's movements and developing an interface for accessing annotated dance videos from an archive with precision but low bandwidth usage.
AUTOMATIC TRANSLATION OF ARABIC SIGN TO ARABIC TEXT (ATASAT) SYSTEMcscpconf
ย
Sign language continues to be the preferred tool of communication between the deaf and the hearing-impaired. It is a well-structured code by hand gesture, where every gesture has a specific meaning, In this paper has goal to develop a system for automatic translation of Arabic Sign Language. To Arabic Text (ATASAT) System this system is acts as a translator among deaf and dumb with normal people to enhance their communication, the proposed System consists of five main stages Video and Images capture, Video and images processing, Hand Signs Construction, Classification finally Text transformation and interpretation, this system depends on building a two datasets image features for Arabic sign language gestures alphabets from two resources: Arabic Sign Language dictionary and gestures from different signer's human, als using gesture recognition techniques, which allows the user to interact with the outside world.This system offers a novel technique of hand detection is proposed which detect and extract hand gestures of Arabic Sign from Image or video, in this paper we use a set of appropriate features in step hand sign construction and classification of based on different classification algorithms such as KNN, MLP, C4.5, VFI and SMO and compare these results to get better classifier.
Software Development Careers: Why, What, and How?Sanjay Goel
ย
This presentation was used during the 3 hrs long session for pre-final year CSE/IT/ECE students at JIIT on 13th June 2015. It even has the slides that were skipped because of time shortage. Thanks to some of the star alumni of 1st (2005) to 5th (2009) batch graduated from JIIT for their messages that are also included in this presentation. Each of their message was read out by different students during the presentation. I hope more engineering students at JIIT and even at other institutes will find it useful for making the right choice wrt their career.
This presentation is a continuously evolving presentation and is kept updated with new insights and information.
AUTOMATIC TRANSLATION OF ARABIC SIGN TO ARABIC TEXT (ATASAT) SYSTEMcscpconf
ย
Sign language continues to be the preferred tool of communication between the deaf and the hearing-impaired. It is a well-structured code by hand gesture, where every gesture has a specific meaning, In this paper has goal to develop a system for automatic translation of Arabic Sign Language. To Arabic Text (ATASAT) System this system is acts as a translator among deaf and dumb with normal people to enhance their communication, the proposed System consists of five main stages Video and Images capture, Video and images processing, Hand Signs Construction, Classification finally Text transformation and interpretation, this system depends on building a two datasets image features for Arabic sign language gestures alphabets from two resources: Arabic Sign Language dictionary and gestures from different signer's human, als using gesture recognition techniques, which allows the user to interact with the outside world.This system offers a novel technique of hand detection is proposed which detect and extract hand gestures of Arabic Sign from Image or video, in this paper we use a set of appropriate features in step hand sign construction and classification of based on different classification algorithms such as KNN, MLP, C4.5, VFI and SMO and compare these results to get better classifier.
Software Development Careers: Why, What, and How?Sanjay Goel
ย
This presentation was used during the 3 hrs long session for pre-final year CSE/IT/ECE students at JIIT on 13th June 2015. It even has the slides that were skipped because of time shortage. Thanks to some of the star alumni of 1st (2005) to 5th (2009) batch graduated from JIIT for their messages that are also included in this presentation. Each of their message was read out by different students during the presentation. I hope more engineering students at JIIT and even at other institutes will find it useful for making the right choice wrt their career.
This presentation is a continuously evolving presentation and is kept updated with new insights and information.
Indian Classical Dance Mudra Classification Using HOG Features and SVM Classi...IJECEIAES
ย
Digital understanding of Indian classical dance is least studied work, though it has been a part of Indian Culture from around 200BC. This work explores the possibilities of recognizing classical dance mudras in various dance forms in India. The images of hand mudras of various classical dances are collected form the internet and a database is created for this job. Histogram of oriented (HOG) features of hand mudras input the classifier. Support vector machine (SVM) classifies the HOG features into mudras as text messages. The mudra recognition frequency (MRF) is calculated for each mudra using graphical user interface (GUI) developed from the model. Popular feature vectors such as SIFT, SURF, LBP and HAAR are tested against HOG for precision and swiftness. This work helps new learners and dance enthusiastic people to learn and understand dance forms and related information on their mobile devices.
There has been over the past few years, a very increased popularity for yoga. A lot of literatures have been published that claim yoga to be beneficial in improving the overall lifestyle and health especially in rehabilitation, mental health and more. Considering the fast-paced lives that individuals live, people usually prefer to exercise or work-out from the comfort of their homes and with that a need for an instructor arises. Hence why, we have developed a self-assisted system which can be used to detect and classify yoga asanas, which is discussed in-depth in this paper. Especially now when the pandemic has taken over the world, it is not feasible to attend physical classes or have an instructor over. Using the technology of Computer Vision, a computer-assisted system such as the one discussed, comes in very handy. The technologies such as ml5.js, PoseNet and Neural Networks are made use for the human pose estimation and classification. The proposed system uses the above-mentioned technologies to take in a real-time video input and analyze the pose of an individual, and classifies the poses into yoga asanas. It also displays the name of the yoga asana that is detected along with the confidence score.
International Journal of Engineering Research and Applications (IJERA) is an open access online peer reviewed international journal that publishes research and review articles in the fields of Computer Science, Neural Networks, Electrical Engineering, Software Engineering, Information Technology, Mechanical Engineering, Chemical Engineering, Plastic Engineering, Food Technology, Textile Engineering, Nano Technology & science, Power Electronics, Electronics & Communication Engineering, Computational mathematics, Image processing, Civil Engineering, Structural Engineering, Environmental Engineering, VLSI Testing & Low Power VLSI Design etc.
Video Data Visualization System : Semantic Classification and Personalization ijcga
ย
We present in this paper an intelligent video data visualization tool, based on semantic classification, for
retrieving and exploring a large scale corpus of videos. Our work is based on semantic classification
resulting from semantic analysis of video. The obtained classes will be projected in the visualization space.
The graph is represented by nodes and edges, the nodes are the keyframes of video documents and the
edges are the relation between documents and the classes of documents. Finally, we construct the userโs
profile, based on the interaction with the system, to render the system more adequate to its preferences.
Video Data Visualization System : Semantic Classification and Personalization ijcga
ย
We present in this paper an intelligent video data visualization tool, based on semantic classification, for retrieving and exploring a large scale corpus of videos. Our work is based on semantic classification resulting from semantic analysis of video. The obtained classes will be projected in the visualization space. The graph is represented by nodes and edges, the nodes are the keyframes of video documents and the
edges are the relation between documents and the classes of documents. Finally, we construct the userโs profile, based on the interaction with the system, to render the system more adequate to its preferences.
Hardware landscape from computer vision to wearable sensors, and a light intro for UX requirements to ensure adherence and engagement.
At the intersection of new sensors, big data, deep learning, gamification, behavioral medicine and human factors.
Applications benefiting from "quantitative sensorimotor training", "precision exercise", "precision physiotherapy" or whatever you are calling this, include weight and strength training, powerlifting, bodybuilding, martial arts, yoga, dance, musical instrument training, post-surgery rehabilitation for ACL tears, etc.
Alternative download link:
https://www.dropbox.com/s/wcfrzdjkn58xjdq/physio_pipeline_hw.pdf?dl=0
New Generation MTech and MSc Programs at JKLUSanjay Goel
ย
A brief overview of the salient features of the curriculum of new generation MTech and MSc programs at JKLU.
MTech SCHOLARSHIPS (First year)
1. Scholarships from 25% to 100% of tuition fees are offered to meritorious students based on their final scores in the under-graduation program, in the first year of study.
CGPA Scholarships
>=9.01 Equivalent to 100% of tuition fees
8.50 - 9.00 Equivalent to 75% of tuition fees
8.01 - 8.50 Equivalent to 50% of tuition fees
7.50 - 8.00 Equivalent to 25% of tuition fees
2. Students who qualify for GATE will be eligible for scholarships equivalent to 75% tuition fees.
MERIT SCHOLARSHIPS (Second year)
Students who have obtained CGPA of 8.50 and above in first year will be awarded scholarship equivalent to 75% of the tuition fee.
Students who have obtained CGPA above 7.50 and below 8.50 in first year will be awarded scholarship equivalent to 50% of the tuition fee.
Build a Career in Engineering and Technology 19.08.20Sanjay Goel
ย
On 19th August 2020, I gave a webinar through CollegeDunia for fresh 12th pass-outs on this theme. In this more than 1 hour-long session, Iย focused on the following four issues:
1. Careers for Future?
2. What to learn for future careers and how?
3. Which institutes are equipped to facilitate learning for the future career in engineering and technology?
4. Is JKLU a good option?
The Youtube video of this presentation is available at: https://youtu.be/Md79MvZhYeg
More Related Content
Similar to Computer Vision based Dance Visualisation
Indian Classical Dance Mudra Classification Using HOG Features and SVM Classi...IJECEIAES
ย
Digital understanding of Indian classical dance is least studied work, though it has been a part of Indian Culture from around 200BC. This work explores the possibilities of recognizing classical dance mudras in various dance forms in India. The images of hand mudras of various classical dances are collected form the internet and a database is created for this job. Histogram of oriented (HOG) features of hand mudras input the classifier. Support vector machine (SVM) classifies the HOG features into mudras as text messages. The mudra recognition frequency (MRF) is calculated for each mudra using graphical user interface (GUI) developed from the model. Popular feature vectors such as SIFT, SURF, LBP and HAAR are tested against HOG for precision and swiftness. This work helps new learners and dance enthusiastic people to learn and understand dance forms and related information on their mobile devices.
There has been over the past few years, a very increased popularity for yoga. A lot of literatures have been published that claim yoga to be beneficial in improving the overall lifestyle and health especially in rehabilitation, mental health and more. Considering the fast-paced lives that individuals live, people usually prefer to exercise or work-out from the comfort of their homes and with that a need for an instructor arises. Hence why, we have developed a self-assisted system which can be used to detect and classify yoga asanas, which is discussed in-depth in this paper. Especially now when the pandemic has taken over the world, it is not feasible to attend physical classes or have an instructor over. Using the technology of Computer Vision, a computer-assisted system such as the one discussed, comes in very handy. The technologies such as ml5.js, PoseNet and Neural Networks are made use for the human pose estimation and classification. The proposed system uses the above-mentioned technologies to take in a real-time video input and analyze the pose of an individual, and classifies the poses into yoga asanas. It also displays the name of the yoga asana that is detected along with the confidence score.
International Journal of Engineering Research and Applications (IJERA) is an open access online peer reviewed international journal that publishes research and review articles in the fields of Computer Science, Neural Networks, Electrical Engineering, Software Engineering, Information Technology, Mechanical Engineering, Chemical Engineering, Plastic Engineering, Food Technology, Textile Engineering, Nano Technology & science, Power Electronics, Electronics & Communication Engineering, Computational mathematics, Image processing, Civil Engineering, Structural Engineering, Environmental Engineering, VLSI Testing & Low Power VLSI Design etc.
Video Data Visualization System : Semantic Classification and Personalization ijcga
ย
We present in this paper an intelligent video data visualization tool, based on semantic classification, for
retrieving and exploring a large scale corpus of videos. Our work is based on semantic classification
resulting from semantic analysis of video. The obtained classes will be projected in the visualization space.
The graph is represented by nodes and edges, the nodes are the keyframes of video documents and the
edges are the relation between documents and the classes of documents. Finally, we construct the userโs
profile, based on the interaction with the system, to render the system more adequate to its preferences.
Video Data Visualization System : Semantic Classification and Personalization ijcga
ย
We present in this paper an intelligent video data visualization tool, based on semantic classification, for retrieving and exploring a large scale corpus of videos. Our work is based on semantic classification resulting from semantic analysis of video. The obtained classes will be projected in the visualization space. The graph is represented by nodes and edges, the nodes are the keyframes of video documents and the
edges are the relation between documents and the classes of documents. Finally, we construct the userโs profile, based on the interaction with the system, to render the system more adequate to its preferences.
Hardware landscape from computer vision to wearable sensors, and a light intro for UX requirements to ensure adherence and engagement.
At the intersection of new sensors, big data, deep learning, gamification, behavioral medicine and human factors.
Applications benefiting from "quantitative sensorimotor training", "precision exercise", "precision physiotherapy" or whatever you are calling this, include weight and strength training, powerlifting, bodybuilding, martial arts, yoga, dance, musical instrument training, post-surgery rehabilitation for ACL tears, etc.
Alternative download link:
https://www.dropbox.com/s/wcfrzdjkn58xjdq/physio_pipeline_hw.pdf?dl=0
New Generation MTech and MSc Programs at JKLUSanjay Goel
ย
A brief overview of the salient features of the curriculum of new generation MTech and MSc programs at JKLU.
MTech SCHOLARSHIPS (First year)
1. Scholarships from 25% to 100% of tuition fees are offered to meritorious students based on their final scores in the under-graduation program, in the first year of study.
CGPA Scholarships
>=9.01 Equivalent to 100% of tuition fees
8.50 - 9.00 Equivalent to 75% of tuition fees
8.01 - 8.50 Equivalent to 50% of tuition fees
7.50 - 8.00 Equivalent to 25% of tuition fees
2. Students who qualify for GATE will be eligible for scholarships equivalent to 75% tuition fees.
MERIT SCHOLARSHIPS (Second year)
Students who have obtained CGPA of 8.50 and above in first year will be awarded scholarship equivalent to 75% of the tuition fee.
Students who have obtained CGPA above 7.50 and below 8.50 in first year will be awarded scholarship equivalent to 50% of the tuition fee.
Build a Career in Engineering and Technology 19.08.20Sanjay Goel
ย
On 19th August 2020, I gave a webinar through CollegeDunia for fresh 12th pass-outs on this theme. In this more than 1 hour-long session, Iย focused on the following four issues:
1. Careers for Future?
2. What to learn for future careers and how?
3. Which institutes are equipped to facilitate learning for the future career in engineering and technology?
4. Is JKLU a good option?
The Youtube video of this presentation is available at: https://youtu.be/Md79MvZhYeg
Developing and PublishingAcademic ProductsSanjay Goel
ย
These lecture slides were used in two lectures delivered on 25th June 2014 at a 3 day workshop organised under the TEQIP (Technical Education Quality Improvement Programme ) scheme by Equate India for the faculty participants from few NITs, Aligarh Muslim University, and Sardar Patel College of Engineering.
Problem Solving and Research Methodology: Part-I- Risk Engineering - Excerpts...Sanjay Goel
ย
These are excerpts of the references discussed in the lectures of an elective course Problem Solving and research Methodology offered to MTech (CSE) and BTech (CSE/IT) students at JIIT. Part -I contains the references discussed in the class before first test, it mainly deals with the theme of Risk Engineering.
This is the summary of the material discussed in the classes of CSCW, a new elective taught to MTech students in 2012 at JIIT, Noida, India. Essentially speaking, these are the excerpts of the selected papers and other publications.
A talk given during the orientation program of MBA students of JBS, JIIT, 2007. Howeevre, the content is relevant for all postgraduate students and aspirants.
3.0 Project 2_ Developing My Brand Identity Kit.pptxtanyjahb
ย
A personal brand exploration presentation summarizes an individual's unique qualities and goals, covering strengths, values, passions, and target audience. It helps individuals understand what makes them stand out, their desired image, and how they aim to achieve it.
LA HUG - Video Testimonials with Chynna Morgan - June 2024Lital Barkan
ย
Have you ever heard that user-generated content or video testimonials can take your brand to the next level? We will explore how you can effectively use video testimonials to leverage and boost your sales, content strategy, and increase your CRM data.๐คฏ
We will dig deeper into:
1. How to capture video testimonials that convert from your audience ๐ฅ
2. How to leverage your testimonials to boost your sales ๐ฒ
3. How you can capture more CRM data to understand your audience better through video testimonials. ๐
Buy Verified PayPal Account | Buy Google 5 Star Reviewsusawebmarket
ย
Buy Verified PayPal Account
Looking to buy verified PayPal accounts? Discover 7 expert tips for safely purchasing a verified PayPal account in 2024. Ensure security and reliability for your transactions.
PayPal Services Features-
๐ข Email Access
๐ข Bank Added
๐ข Card Verified
๐ข Full SSN Provided
๐ข Phone Number Access
๐ข Driving License Copy
๐ข Fasted Delivery
Client Satisfaction is Our First priority. Our services is very appropriate to buy. We assume that the first-rate way to purchase our offerings is to order on the website. If you have any worry in our cooperation usually You can order us on Skype or Telegram.
24/7 Hours Reply/Please Contact
usawebmarketEmail: support@usawebmarket.com
Skype: usawebmarket
Telegram: @usawebmarket
WhatsApp: +1โช(218) 203-5951โฌ
USA WEB MARKET is the Best Verified PayPal, Payoneer, Cash App, Skrill, Neteller, Stripe Account and SEO, SMM Service provider.100%Satisfection granted.100% replacement Granted.
Company Valuation webinar series - Tuesday, 4 June 2024FelixPerez547899
ย
This session provided an update as to the latest valuation data in the UK and then delved into a discussion on the upcoming election and the impacts on valuation. We finished, as always with a Q&A
Digital Transformation and IT Strategy Toolkit and TemplatesAurelien Domont, MBA
ย
This Digital Transformation and IT Strategy Toolkit was created by ex-McKinsey, Deloitte and BCG Management Consultants, after more than 5,000 hours of work. It is considered the world's best & most comprehensive Digital Transformation and IT Strategy Toolkit. It includes all the Frameworks, Best Practices & Templates required to successfully undertake the Digital Transformation of your organization and define a robust IT Strategy.
Editable Toolkit to help you reuse our content: 700 Powerpoint slides | 35 Excel sheets | 84 minutes of Video training
This PowerPoint presentation is only a small preview of our Toolkits. For more details, visit www.domontconsulting.com
Putting the SPARK into Virtual Training.pptxCynthia Clay
ย
This 60-minute webinar, sponsored by Adobe, was delivered for the Training Mag Network. It explored the five elements of SPARK: Storytelling, Purpose, Action, Relationships, and Kudos. Knowing how to tell a well-structured story is key to building long-term memory. Stating a clear purpose that doesn't take away from the discovery learning process is critical. Ensuring that people move from theory to practical application is imperative. Creating strong social learning is the key to commitment and engagement. Validating and affirming participants' comments is the way to create a positive learning environment.
VAT Registration Outlined In UAE: Benefits and Requirementsuae taxgpt
ย
Vat Registration is a legal obligation for businesses meeting the threshold requirement, helping companies avoid fines and ramifications. Contact now!
https://viralsocialtrends.com/vat-registration-outlined-in-uae/
"๐ฉ๐ฌ๐ฎ๐ผ๐ต ๐พ๐ฐ๐ป๐ฏ ๐ป๐ฑ ๐ฐ๐บ ๐ฏ๐จ๐ณ๐ญ ๐ซ๐ถ๐ต๐ฌ"
๐๐ ๐๐จ๐ฆ๐ฌ (๐๐ ๐๐จ๐ฆ๐ฆ๐ฎ๐ง๐ข๐๐๐ญ๐ข๐จ๐ง๐ฌ) is a professional event agency that includes experts in the event-organizing market in Vietnam, Korea, and ASEAN countries. We provide unlimited types of events from Music concerts, Fan meetings, and Culture festivals to Corporate events, Internal company events, Golf tournaments, MICE events, and Exhibitions.
๐๐ ๐๐จ๐ฆ๐ฌ provides unlimited package services including such as Event organizing, Event planning, Event production, Manpower, PR marketing, Design 2D/3D, VIP protocols, Interpreter agency, etc.
Sports events - Golf competitions/billiards competitions/company sports events: dynamic and challenging
โญ ๐ ๐๐๐ญ๐ฎ๐ซ๐๐ ๐ฉ๐ซ๐จ๐ฃ๐๐๐ญ๐ฌ:
โข 2024 BAEKHYUN [Lonsdaleite] IN HO CHI MINH
โข SUPER JUNIOR-L.S.S. THE SHOW : Th3ee Guys in HO CHI MINH
โขFreenBecky 1st Fan Meeting in Vietnam
โขCHILDREN ART EXHIBITION 2024: BEYOND BARRIERS
โข WOW K-Music Festival 2023
โข Winner [CROSS] Tour in HCM
โข Super Show 9 in HCM with Super Junior
โข HCMC - Gyeongsangbuk-do Culture and Tourism Festival
โข Korean Vietnam Partnership - Fair with LG
โข Korean President visits Samsung Electronics R&D Center
โข Vietnam Food Expo with Lotte Wellfood
"๐๐ฏ๐๐ซ๐ฒ ๐๐ฏ๐๐ง๐ญ ๐ข๐ฌ ๐ ๐ฌ๐ญ๐จ๐ซ๐ฒ, ๐ ๐ฌ๐ฉ๐๐๐ข๐๐ฅ ๐ฃ๐จ๐ฎ๐ซ๐ง๐๐ฒ. ๐๐ ๐๐ฅ๐ฐ๐๐ฒ๐ฌ ๐๐๐ฅ๐ข๐๐ฏ๐ ๐ญ๐ก๐๐ญ ๐ฌ๐ก๐จ๐ซ๐ญ๐ฅ๐ฒ ๐ฒ๐จ๐ฎ ๐ฐ๐ข๐ฅ๐ฅ ๐๐ ๐ ๐ฉ๐๐ซ๐ญ ๐จ๐ ๐จ๐ฎ๐ซ ๐ฌ๐ญ๐จ๐ซ๐ข๐๐ฌ."
Affordable Stationery Printing Services in Jaipur | Navpack n PrintNavpack & Print
ย
Looking for professional printing services in Jaipur? Navpack n Print offers high-quality and affordable stationery printing for all your business needs. Stand out with custom stationery designs and fast turnaround times. Contact us today for a quote!
The world of search engine optimization (SEO) is buzzing with discussions after Google confirmed that around 2,500 leaked internal documents related to its Search feature are indeed authentic. The revelation has sparked significant concerns within the SEO community. The leaked documents were initially reported by SEO experts Rand Fishkin and Mike King, igniting widespread analysis and discourse. For More Info:- https://news.arihantwebtech.com/search-disrupted-googles-leaked-documents-rock-the-seo-world/
Implicitly or explicitly all competing businesses employ a strategy to select a mix
of marketing resources. Formulating such competitive strategies fundamentally
involves recognizing relationships between elements of the marketing mix (e.g.,
price and product quality), as well as assessing competitive and market conditions
(i.e., industry structure in the language of economics).
Cracking the Workplace Discipline Code Main.pptxWorkforce Group
ย
Cultivating and maintaining discipline within teams is a critical differentiator for successful organisations.
Forward-thinking leaders and business managers understand the impact that discipline has on organisational success. A disciplined workforce operates with clarity, focus, and a shared understanding of expectations, ultimately driving better results, optimising productivity, and facilitating seamless collaboration.
Although discipline is not a one-size-fits-all approach, it can help create a work environment that encourages personal growth and accountability rather than solely relying on punitive measures.
In this deck, you will learn the significance of workplace discipline for organisational success. Youโll also learn
โข Four (4) workplace discipline methods you should consider
โข The best and most practical approach to implementing workplace discipline.
โข Three (3) key tips to maintain a disciplined workplace.
1. VSMMโ05, Belgium
Computer Vision based Dance
Visualisation
Sanjay Goel, Chirag Gupta, T. Gnana Swaroop,
Gaurav Jain, Tarang Gupta and Shoma Chatterjee
Jaypee Institute of Information Technology,
Noida, India
Abstract :- In this paper we discuss a Computer Vision based tool for dance scholars. The tool aims to
use computer vision to enable the analyst to concentrate on body movements. The processed video highlights
the main body motion by extracting body contour. The tool provides the ability to add and display
additional textual information with each frame. It also facilitates juxtaposition of original video with extracted
video.
1. Introduction
The fascination for Indian dance all over the world is indicative of the deep-felt need to use the
human body to express and celebrate the great universal truths. It illuminates India's culture in a
direct manner, playing on the sensibilities of the onlooker. Dance in India has seeped into several
other realms like poetry, sculpture, architecture, literature, music and theatre. All Indian dance
forms are thus structured around the nine rasas or emotions [1], hasya (happiness), krodha (anger),
bhibasta (disgust), bhaya (fear), shoka (sorrow), viram (courage), karuna (compassion), adbhuta
(wonder) and shanta (serenity). Very little contribution other than video storage and
dissemination has been made by the fast growing computer technology in the field of dance and
none for Indian classical dance. This paper discusses a tool that is under development to help
dance scholars to analyze solo dance performances.
1.1 Literature Survey:
Computers find various uses in Dance [5]. Some important non-graphics uses are described
in administration, lighting control, and competition scrutineering. Graphical applications
include notation, choreography, teaching, and performance. One of the earlier works [2]
explores the nature of creative composition particularly as it applies to dance, and describes
the development of interactive computer based tools to assist the composer. The hierarchical
nature of the composition process calls for an interface which allows the composer the
flexibility to move back and forth between alternate views and conceptual levels of
abstraction. COMPOSE, an interactive system for the composition of dance has been
implemented on Silicon Graphics and Apple workstations, [2]. The user visually composes in
space and in time using menus of postures and sequences. The animation of the dance
composition allows the final result to be evaluated.
One of the first Dance Technology composition, choreographed in 1994, researchers used
Motion Interactive (MINT) - a special motion - capture program they developed - to translate
dance into computer animation, [3]. Two video cameras captured the movement of reflective
2. VSMMโ05, Belgium
markers at 27 points on a dancerโs body. The researchers digitized the video, using it to
create a computer model of the dancer [3]. For another performance, the researchers
employed infrared cameras to track emitters hidden on a dancerโs costume. This data is fed
into a high - speed graphics workstation in real time, the animation video resulted in
animated trails of the dancerโs movements by projection of real-time graphics onto a
translucent screen [3].
A collaboration between the Atlanta Ballet and Georgia Techโs Interactive Media
Technology Center (IMTC), the Dance Technology Project featured combining ballet and
computer animation techniques [3]. The project dealt with video costuming. That is, a camera
and computer system track the motions of the dancers on stage while a second graphics
computer is used to create their โvirtual costumesโ which are projected onto them, in exact
registration to their body orientations - even as they dance. Other activities were computer
generated dancers intermingling with real dancers, and computer - generated art โcreatedโ by
the dancers as the performance progressed [3].
The work reported in [4] deals with phrase structure detection in contemporary western
dance. Phrases are a sequence of movements that exist at a higher semantic abstraction than
gestures. The problem is important since phrasal structure in dance, plays a key role in
communicating meaning, [4]. They detect fundamental dance structures that form the basis
for more complex movement sequences.
Computed dancing figures have also been proposed as an aid in teaching dance [5]. For
example, the computer could be used to show idealised movements slowly of fast steps,
that are impossible to demonstrate slowly because of problems with balance or momentum.
Computers could also be used as a teaching aid for student to classify for themselves
steps with complex alternatives [5].
The authors in [6] have come up with an algorithm of synthesizing music that can
appropriately express emotions in dances. This algorithm can help one compile music
suitable for dance movies or animation films, and is also applicable to any entertainment
systems that use music or dance. The algorithm is composed of three modules. The first
is the module of computing emotions from an inputted dance, the second that of
computing emotions from music in the database and last that of selecting music suitable
for inputted dance via an interface of emotion, [6].
An experimental dance performance featuring live-motion capture, real-time computer
graphics, and multi-image projection was produced by a cross-departmental team of faculty
and students at Purdue University, [7]. Dancers occupied and traversed performance mediums
or โframesโ including a virtual performance frame occupied by a 3D character, driven by a
dancer in motion-capture equipment. Developing and facilitating the relationships between
the dancers in various performance frames was a primary focus of the project.
A multimodal information system method for a basic dance training system is discussed
in [8]. The system targets on beginners and enables them to learn basics of dances easily.
One of the most effective ways of learning dance is to watch a video showing the
performance of dance masters. However, some information cannot be conveyed well
3. VSMMโ05, Belgium
through video. One is the translational motion, especially that in depth direction. One
cannot tell exactly how far does the dancers move forward or backward, [8]. Another is the
timing information. Although one can tell how to move arms or legs from video. It is
difficult to know when to start moving them. The first issue is solved by introducing an
image display on a mobile robot [8]. One can learn the amount of translation just by
following the robot. They introduced active devices for the second issue [8]. The active
devices are composed of some vibro-motors and are developed to direct action-starting cues
with vibration, [8].
1.2 Scope of project
The main objective of our project is to exploit the potential of digital image processing and
computer vision techniques to serve some of the common and regular needs of scholars and students
of Indian classical dance. At present, dance students and scholars learn or analyze dance
movements by observing performances of professional dancers. Video recordings of
performances are popular for later reference and analysis. Often the dance scholar needs to
concentrate on specific aspects like hand movement and so on. In the absence of any tool to filter out
distracting details, such scholarly analysis becomes a tedious task. User friendly software tool(s) can
help dance scholars analyze and annotate the recorded performances, add subtitles and annotation for
specific frame sequence and store the annotated video in a regular format viewable on any
regular media player. Availability of such software will encourage scholars to add more
information in recorded videos which can be accessed, understood and appreciated by a
common man. Such software will allow the scholars to create a well documented archive of
dance videos with searchable annotations.
2. Outline of the Algorithm
This section discusses design of our Computer Aided Dance Analysis and Visualization tool.
The tool allows users to view the original video and the processed video simultaneously. It
also allows the users to add information to every frame of the dance video. All forms of
Indian Classical dance depict a story. Frame specific information can be added with each
frame as frame annotation. It allows the users to filter out distracting details by extracting
body contour and image skeleton.
We have designed a sample interface using Visual C++. Matlab has been used as an
intermediate test environment [14], where we tested the various image processing algorithms
which have later been migrated to Visual C++. The phases involved in the design of the
dance tool and the results are underlined below. The main processes are segmentation, edge
detection and skeletonization.
2.1 Segmentation and Edge Detection
We extract frames from the video, as in Fig. 1, and segment to separate the dancer from
the frame. We use the Region Growing algorithm [9] for this because we need to separate
the dancer on the basis of color as well as region. For applying multi pass region growing
algorithm, we convert the image to 256 level grayscale. We initially select all pixels
4. VSMMโ05, Belgium
of a frame as seed points. Then we compare alternate seeds (s1) across the height
and width of the frame with all four seed neighbors (north,south,east,west). The initial
threshold range is kept to be within eight graylevel difference. If the two compared
seeds are found similar i.e. within the threshold range, then we mark the neighbor
with the value of seed s1 . Next we continue with the same process in subsequent
passes by doubling the threshold range in subsequent passes until it reaches 128 as
we need a binary output. The output of this process is the image of dancer separated
from the rest of image as shown in Fig. 2. We convolve the segmented image with the
Laplacian Mask for boundary detection [9] as in Fig. 3.
Fig 1. Input Video Frame
Fig 2. Clustered Frame
5. VSMMโ05, Belgium
Fig 3. Edge extracted/Boundary detected
2.2 Skeletonization
The next and the most important algorithm is skeletonization. We tried using different
thinning algorithms like Medial Axis Transform [9] but none of them gave statisfactory
results. In Medial Axis Transformation of a region R with border B, for each point p in R,
we find its closest neighbor in B. If p has more than one such neighbor, it is said to
belong to medial axis of R. The Medial Axis Transformation does not serve our purpose as
the output of this algorithm for an L-shaped figure would be as shown in Fig. 4.
Skeleton from Medial Axis Transformation Expected Skeleton
Fig. 4
Also the complexity of the Medial Axis Transformation is very high as it compares every
pixel in the boundary of the region to each of the pixels in the image. This was the reason
why we had to modify the algorithm to suit our purpose. In the modified algorithm
6. VSMMโ05, Belgium
instead of calculating the distance of each pixel from the boundary pixel we calculate the
distance of each boundary point from its horizontally opposite boundary point. Unlike Medial
Axis Transform where we compare all the points (whether boundary or region) with each
other, we select only the boundary points. We select a point in the boundary and find
its opposite (horizontal) boundary point. One horizontal line may have portions of more
than one body parts. The odd numbered boundary points on every horizontal line mark the
beginning and the corresponding subsequent even numbered boundary point mark the end
of the body part. We mark the center of these two points as the skeleton point for all
such pairs of boundary points. S represents the set of all skeleton points. The output we
get from this is not the perfect skeleton in all positions but this along with the
boundary is enough for user to visualize the movements. This allows us to get closer to
the expected skeleton as in Fig. 5 with much lower complexity allowing us to process same
video in a lesser time.
Fig 5. Skeletonized Frame
2.3 Object Tracking
The final image processing algorithm in the project is synchronized multiple inter-connected
object tracking. The main objective of this step is to mask and track the anchor points of
the body. These anchor points comprised of head, neck, shoulders, elbows, palms, waist and
one or two points for legs. The points for legs were kept low keeping in mind the
traditional classical dances where the female dancers wear saris. In our future work, we plan
to use the anchor points for creating Vector Stick diagram of the dancer.
Traditional object tracking [15,16] failed in our case because such algorithms are made
for tracking simple object in a video. In our case we had to track multiple inter-connected
complex objects (body parts) in a video and that too in a synchronized way. We have
designed our own algorithm for this purpose. This algorithm is based on the principle of pattern
matching and tracks objects in the input video using the output from the Skeletonizing algorithm.
First of all we mark a point on the object which we want to track as p1. We quantize the image
into 32 gray levels. When an object moves in a video some blurring is caused which
results in slight changes in color of the object. To correct these errors we quantize the
7. VSMMโ05, Belgium
image into 32 gray levels as they are adequate to track major object motions. Now we
take a 11x11 pixel window (w1) on frame (j) with center as p1. Then we take 121, 11x11
pixel search windows from frame (j+1) with centers lying on each pixel of the
corresponding 11x11 window (w1) on frame (j+1). We compare the histograms of all
these search windows on frame (j+1) with (w1) and identify the window of
minimum difference as the region (wr ) in which motion has taken place. The comparison
of histograms is done according to the following formula:
Diff = โ [ฦ1 (binx) - ฦ2 (binx)]; where x extends from 1 to 32 gray scales
ฦ1(x): number of pixels of bin x gray scale in primary window.
ฦ2(x): number of pixels of bin x gray scale in search window.
Now the problem is to search one point out of these 121 points in the window (wr).
Firstly, we find the difference along the x and y axis between p1 and the center of wr
(center of wr - p1) to identify the quarter as given in Table 1 with (0,0) being considered
as the top left corner of the image.
X Difference Y Difference Quarter
Positive Positive Bottom right
Negative Positive Bottom left
Positive Negative Top right
Negative Negative Top left
Table 1 : Quarter Identification in the search window
Now we search the identified quarter for skeleton points in top-down, left-right order
and mark the first skeleton point found. Marking the point on the skeleton makes sure that
the point does not move out of the body. If the point is not found in this quarter we
scan the full window for skeleton points and mark the first skeleton point found. If there
is no point of skeleton in this window we simply mark the center of this window as the
corresponding point in frame (j+1). This process is applied to all the consecutive frames with
respect to immediate predecessor frame, hence tracking the object as shown in Fig. 6.
8. VSMMโ05, Belgium
Fig. 6. Locus of tracked finger
2.4 Interface
The design and interface of the tool was created in Visual C++ following the Document View
Architecture. Our tool extensively used Multithreading in Visual C++. The processed video
highlights the main body motion by extracting the body contour and also provides the
ability to add and display additional textual information about the dance video with each
frame for the user. It facilitates juxtaposition of original video with extracted video as shown in
Fig. 7.
2.5 Future Scope
The work on the vectorization of the dancerโs stick diagram has been intiated. We have
also realised an interface for easy ( and precise ) access of dance videos from the Digital
Video Archive. The major obstacle is to do this without consuming huge bandwidth. Our
interface for Digital Video Archives is based on the skeletonization algorithm reported in
this paper. Details of this interface will be discussed in a future paper.
9. VSMMโ05, Belgium
Screen Shot of the Main Application
Player Controller
Slider Toolbar
Input Video Subtitle Addition Processed Output
Displayed Here Video Displayed Here
Fig. 7
Acknowledgements
We are extremely thankful to Maria, a dance teacher who runs her own dance school. We
had a very fruitful discussion and we got many new interesting perspectives to look at our problem.
Some of the relevant outcomes of this discussion were, extracting the dancer from the dance video,
hiding irrelevant information like color of dress etc., and applying enhancements on the dancer to
study the dance movements better and ability to compare two dance performances of same dancer or
similar performances by different dancers.
10. VSMMโ05, Belgium
References
[1] Visual dictionary of Hastas for Indian dance - hand gestures of Indian Dance
http://www.kanakasabha.com/hastas/index.htm
[2] T. Schiphorst, et al., Tools for Interaction with the Creative Process of Composition.
Centre for Systems Science, Simon Fraser University, Burnaby, BC, V5A 1S6, Canada., CHI 90 Proceedings,
pp 167 โ 174.
[3] Reseach for the Games. Georgia Tech forged strong ties to Atlantaโs 1996 Olympic Games.
Compiled by Lea McLees.
[4] V. M. Dyaberi, et al. Phrase Structure Detection in Dance, Proceedings of the 12th annual ACM
international conference on Multimedia, Oct 2004, pp. 332 - 335.
[5] Dance and the Computer : A Potential for Graphic Synergy. Technical Report 422.
Basser Department of Computer Science. University of Sydney, Oct 2003.
[6] Hirofumi Morioka , et al.Proposal of an Algorithm to Synthesize Music Suitable for Dance.
Proceedings of the 2004 ACM SIGCHI International Conference on Advances in
Computer Entertainment Technology, Sept 2004, pp. 296 โ 301.
[7] W. Scott, et al. Mixing Dance Realities: Collaborative Development of Live -
Motion Capture in a Performing Arts Environment. ACM Computers in Entertainment ( CIE ),
vol 2, issue 2, April 2004.
[8] Akio Nakamura, et al. Multimodal Presentation Method for a Dance Training System.
Saitama University, JAPAN. CHI 2005, pp 1685 โ 1688.
[9] R.C. Gonzalez and R.E. Woods - Digital Image Processing, second edition, Pearson Education.
[10] The Open Video Project
http://www.Open-Video.org
[11] Digital Video Archives: Managing Through Metadata
[12] Informedia Digital Video Library System โ Carnegie Mellon University
[13] Fabio Chestani -
Video Retrieval Interfaces
[14] Building GUIs with Matlab version 5 from MathWorks
[15] Darrell D. Demirdjian T. Ko T. -
Constraining Human Body Tracking,
Artificial Intelligence Laboratory, MIT
[16] Minden Gary, Niehaus Doug and Roberts James -
The Digital Video Library System: Vision and Design