BPPIMT(VIPRoad)-Big Data Analytics with R-Gr12

ANALYSING SURVEY DATA
RELATED TO ATTITUDE TOWARDS
INFLATION
GROUP MEMBERS :
1. SWAMI NATH SATPAL, NETAJI SUBHASH ENGINEERING COLLEGE
2. SATYAM KUMAR, NETAJI SUBHASH ENGINEERING COLLEGE
3. GAURAV KUMAR, NETAJI SUBHASH ENGINEERING COLLEGE
4. SHIVAM KUMAR, NETAJI SUBHASH ENGINEERING COLLEGE
5. WASHID SAYEED, NETAJI SUBHASH ENGINEERING COLLEGE
6. SUMAN KUNDU, RCC INSTITUTE OF TECHNOLOGY

Acknowledgement
I take this opportunity to express my profound gratitude and
deep regards to my faculty Sanjoy Chowdhury for his
exemplary guidance, monitoring and constant encouragement
throughout the course of this project.
The blessing, help and guidance given by him time to time shall
carry me a long way in the journey of life on which I am about
to embark.
I am obliged to my project team members for the valuable
information provided by them in their respective fields. I am
grateful for their cooperation during the period of my
assignment.
Swami Nath Satpal

CONTENTS
 ACKNOWLEDGEMENT
 PROJECT OBJECTIVE
 PROJECT SCOPE
 REQUIREMENT SPECIFICATION
 DATA VISUALISATION
-E R DIAGRAM
-LOOK UP TABLES
 FUTURE SCOPE OF IMPROVEMENTS
 SCREENSHOTS
 CODES
 REPORTS
 CERTIFICATE

Project Objective
Analyzing survey data related to attitude towards inflation
of the common people in their day to day life.
This project is concerned with some guidelines for the
fundamental ideas of analysis of data from surveys.

Project Scope
The purpose of analyzing this data is to generate the
following reports:
1. The percentage of male & female respondents who said
"Gone down" over each quarter when asked which of the
options best describes how prices have changed over the past
12 months.
2. Percentage of respondents (in each income category) who
said "is too high" over each quarter from 2003 to 2015 when
asked what are their thoughts on the government setting an
inflation target of 2.0%.
3. Percentage of respondents (at each education level) who
mentioned "Stayed about the same" for each quarter from
2004 to 2012 when asked what they have to say on how the
interest rates have changed over the past 12 months on things
such as mortgages, bank loans and savings.
4. Percentage of respondents (at each tenure category) who
mentioned "Rise a lot" for each quarter from 2003 to 2015 on
what were their expectations of the interest to change over
the next 12 months.

Requirement Specifications
 Problem Definition :-
This project analyses survey data conducted by a
bank in England to understand the general populations’
attitude to inflation. The data to be analysed ranges
from 2003 to 2015. The survey data has been captured
for every quarter within this period. The reports have
been evaluated on the following survey questions:
Options which best describes how prices have
changed over the last 12 months and we have
calculated the percentage of male & female
respondents who said “Gone Down” over each
quarter.
The Government has set an inflation target of
2.0% so what is the thinking of the public about
this and here we have calculated the percentage
of respondents who is said is too high over each
quarter from 2003 to 2010.

How would you say interest rates on things such
as mortgages, bank loans and savings have
changed over the last 12 months and here we
have calculated the percentage of respondents
who mentioned “Stayed about the same” for each
How would you expect interest rates to change
over the next 12 months and here we have
calculated the percentage of respondents who
mentioned “Rise a lot” for each quarter from
2003 to 2015.
 Software Requirements
PIG
HIVE
R
FILEZILLA
VMWARE

DATA VISUALISATION
E-R DIAGRAM

Future Scope Of IMProvements
The future aspect of this survey is that user can use
these data to analyze and inspect the attitudes of
people towards inflation for further more queries and
can generate reports on these surveys, if required in
the future and would be highly helpful .

 Screenshots of the percentage of male & female
respondents who said "Gone down" over each quarter
when asked which of the options best describes how
prices have changed over the past 12 months.

CODES
 INSERT OVERWRITE TABLE male_1
select yyyyqq,count(q1) from q1 where q1='1' group by yyyyqq;
 INSERT OVERWRITE TABLE male_q1
select yyyyqq,count(q1) from q1 group by yyyyqq;
 INSERT OVERWRITE TABLE female_1
select yyyyqq,count(q1) from fq1 where q1='1' group by yyyyqq;
 INSERT OVERWRITE TABLE female_q1
select yyyyqq,count(q1) from fq1 group by yyyyqq;
 CREATE TABLE final(yyyyqq string,male_res1 string,male_q1
string,fe_yyyyqq string,female_res1 string,female_q1 string)
COMMENT ‘This table consists of male responded and female responded to
the questions asked’
ROW FORMAT DELIMITED
FIELDS TERMINATED BY','
STORED AS TEXTFILE;
 INSERT OVERWRITE TABLE final
select f2.yyyyqq, f2.male_res1, f2.male_q1, f2.male_res1/f2.male_q1,
f3.female_res1,f3.female_q1,f3.female_res1/f3.female_q1 from final2
f2,final3 f3 where f2.yyyyqq=f3.yyyyqq;

 Screenshots of thepercentage of respondents (in
each income category) who said "is too high" over
each quarter from 2003 to 2010 when asked what are
their thoughts on the government setting an inflation
target of 2.0%.

CODES
 INSERT OVERWRITE TABLE income_1
select yyyyqq,count(q4) from data where income='1' and yyyy between
'2003' and '2010' group by yyyyqq ;
 INSERT OVERWRITE TABLE income_q1_1
select yyyyqq,count(q4) from data where income='1' and yyyy between
'2001' and '2010' and q4='1' group by yyyyqq;
 CREATE TABLE final(yyyyqq string,inc1_res1 string,inc1_tres
string,inc_per string,inc2_res1 string,inc2_tres string,inc2_per string,
inc3_res1 string,inc3_tres string,inc3_per string,inc4_res1 string,inc4_tres
string,inc4_per string)
COMMENT ‘percentage of respondents who said income is too high in each
income category’
ROW FORMAT DELIMITED
FIELDS TERMINATED BY','
STORED AS TEXTFILE;
select in1.yyyyqq, in1.q4_res1, in1.q4_tot, in1.q4_res1/in1.q4_tot,
in2.q4_res1, in2.q4_tot, in2.q4_res1/in2.q4_tot,
in3.q4_res1, in3.q4_tot, in3.q4_res1/in3.q4_tot, in4.q4_res1, in4.q4_tot,
in4.q4_res1/in4.q4_tot FROM income_join1 in1,income_join2
in2,income_join3 in3,income_join4 in4
where in1.yyyyqq=in2.yyyyqq;

 Screenshots shows the percentage of
respondents who mentioned Stayed about the same
for each quarter from 2004 to 2012 at education level.

CODES
 INSERT OVERWRITE TABLE educ1
SELECT yyyyqq,count(q5) FROM data1 where educ='1' and q5='3' and yyyy
between '2004' and '2012' group by yyyyqq;
 INSERT OVERWRITE TABLE educ_total1
SELECT educ1.yyyyqq,educ1.q5,educ_q1.q5 FROM educ1,educ_q1 where
educ1.yyyyqq=educ_q1.yyyyqq;
 INSERT OVERWRITE TABLE educ_total2
SELECT educ2.yyyyqq,educ2.q5,educ_q2.q5 FROM educ2,educ_q2 where
educ2.yyyyqq=educ_q2.yyyyqq;
SELECT edu1.yyyyqq ,edu1.res_3, edu1.res_q5, edu1.res_3/edu1.res_q5,
edu2.res_3, edu2.res_q5, edu2.res_3/edu2 .res_q5
FROM educ_total1 edu1,educ_total2 edu2 where edu1.yyyyqq=edu2.yyyyqq;

Reports
Options which best describes how
prices have changed over the last 12
months and we have calculated the
percentage of male & female
respondents who said “Gone Down”
over each quarter.

The Government has set an inflation target of
2.0% so what is the thinking of the public about
this and here we have calculated the percentage
of respondents who is said is too high over each
who mentioned “Stayed about the same” for
each quarter from 2004 to 2012.


who mentioned “Stayed about the same” for
each quarter from 2004 to 2012.

 How would you expect interest rates to change
over the next 12 months and here we have
calculated the percentage of respondents who
mentioned “Rise a lot” for each quarter from
2003 to 2015.

CERTIFICATE
This is to certify that Mr. SWAMI NATH SATPAL of
NETAJI SUBHASH ENGINEERING COLLEGE,
registration number: 141090110114, has
successfully completed the project on BIG DATA
ANALYTICS WITH R using BIG DATA under the
guidance of Mr. SANJOY CHOWDHURY.
--- ---------------------------------------------------
SANJOY CHOWDHURY
Globsyn Finishing School
(a division of Globsyn Skills)

CERTIFICATE
This is to certify that Mr. SATYAM KUMAR of NETAJI
SUBHASH ENGINEERING COLLEGE, registration
number: 141090110085, has successfully
completed the project on BIG DATA ANALYTICS
WITH R using BIG DATA under the guidance of Mr.
SANJOY CHOWDHURY.
--- ---------------------------------------------------
SANJOY CHOWDHURY

CERTIFICATE
This is to certify that Mr. SHIVAM KUMAR of
NETAJI SUBHASH ENGINEERING
COLLEGE, registration number: 141090110092,
has successfully completed the project on BIG DATA
ANALYTICS WITH R using BIG DATA under the
guidance of Mr. SANJOY CHOWDHURY.
--- ---------------------------------------------------
SANJOY CHOWDHURY

CERTIFICATE
This is to certify that Mr. GAURAV KUMAR of NETAJI
SANJOY CHOWDHURY.
--- ---------------------------------------------------
SANJOY CHOWDHURY

CERTIFICATE
This is to certify that Mr. WASHID SAYEED of NETAJI
SANJOY CHOWDHURY.
--- ---------------------------------------------------
SANJOY CHOWDHURY

CERTIFICATE
This is to certify that Mr. SUMAN KUNDU of RCC
INSTITUTE OF TECHNOLOGY, registration
SANJOY CHOWDHURY.
--- ---------------------------------------------------
SANJOY CHOWDHURY

BPPIMT(VIPRoad)-Big Data Analytics with R-Gr12

Recommended

Recommended

More Related Content

Similar to BPPIMT(VIPRoad)-Big Data Analytics with R-Gr12

Similar to BPPIMT(VIPRoad)-Big Data Analytics with R-Gr12 (20)

BPPIMT(VIPRoad)-Big Data Analytics with R-Gr12