The document contains questions and answers related to a cloud computing exam. It includes 5 questions worth 5 marks each on topics like the 2013 ACM Turing Award winner and their contributions to distributed systems and cloud computing, different cloud computing models, data transfer methods, descriptions of Google File System and Hadoop Distributed File System, and architectures for Hadoop on Google Cloud Platform and web applications on Google App Engine. The answers to the questions are provided in slides within the linked website.
Cloud computing means using multiple server computers via a digital network, as though they were one computer.
We can say , it is a new computing paradigm, involving data and/or computation outsourcing.
it has many issues like security issues, privacy issues, data issues, energy issues, bandwidth issues, cloud interoperability.
there are solutions like scaling of resources, distribute servers etc.
Presented By Ashok.J 3 rd BCA - AVVM Sri Pushpam College, Poondi , Tanjor
Slide 2: GRID COMPUTING Conceptual View Of Grid Computing ?
What Is Grid Computing?: What Is Grid Computing? Grid computing is the collection of computer resources from multiple locations to reach a common goal. GRID COMPUTING
Slide 4: How Grid Computing Works? GRID COMPUTING
Slide 5: Types Of Grid Data Grid Collaboration Grid Network Grid Utility Grid GRID COMPUTING Computational Grid
Slide 6: Grid topologies
Slide 7: Intra grids A Typical intra grid topology exist within S ingle Organization, providing a basic set of grid Services
Slide 8: Extra grids An Extra grid, Typically involves more than one security provider , and the level Management complexity increases
Slide 9: Inter Grids An inter grid requires the dynamic integration of applications, resources and service with patterns, Customers access via WAN/ Internet
Slide 10: A Simple Grid GRID COMPUTING
Slide 11: Complex Inter grid GRID COMPUTING
Slide 12: Grid Scheduled An application is one or more jobs that are scheduled to run a Grid GRID COMPUTING
Slide 13: Advantages : Can solve larger, more complex problems in a shorter time Easier to collaborate with other organizations Make better use of existing hardware GRID COMPUTING
Slide 14: Disa dvantages : Grid software and standards are still evolving Learning curve to get started Non-interactive job submission GRID COMPUTING
Slide 15: BENEFITS OF GRID COMPUTING GRID COMPUTING Exploiting underutilized resources Parallel CPU capacity Virtual organizations for collaboration and virtual resources Access to additional resources Resource balancing Reliability Management
Presented By Ashok.J ashokmannai0005@gmail.com
Cloud computing means using multiple server computers via a digital network, as though they were one computer.
We can say , it is a new computing paradigm, involving data and/or computation outsourcing.
it has many issues like security issues, privacy issues, data issues, energy issues, bandwidth issues, cloud interoperability.
there are solutions like scaling of resources, distribute servers etc.
Presented By Ashok.J 3 rd BCA - AVVM Sri Pushpam College, Poondi , Tanjor
Slide 2: GRID COMPUTING Conceptual View Of Grid Computing ?
What Is Grid Computing?: What Is Grid Computing? Grid computing is the collection of computer resources from multiple locations to reach a common goal. GRID COMPUTING
Slide 4: How Grid Computing Works? GRID COMPUTING
Slide 5: Types Of Grid Data Grid Collaboration Grid Network Grid Utility Grid GRID COMPUTING Computational Grid
Slide 6: Grid topologies
Slide 7: Intra grids A Typical intra grid topology exist within S ingle Organization, providing a basic set of grid Services
Slide 8: Extra grids An Extra grid, Typically involves more than one security provider , and the level Management complexity increases
Slide 9: Inter Grids An inter grid requires the dynamic integration of applications, resources and service with patterns, Customers access via WAN/ Internet
Slide 10: A Simple Grid GRID COMPUTING
Slide 11: Complex Inter grid GRID COMPUTING
Slide 12: Grid Scheduled An application is one or more jobs that are scheduled to run a Grid GRID COMPUTING
Slide 13: Advantages : Can solve larger, more complex problems in a shorter time Easier to collaborate with other organizations Make better use of existing hardware GRID COMPUTING
Slide 14: Disa dvantages : Grid software and standards are still evolving Learning curve to get started Non-interactive job submission GRID COMPUTING
Slide 15: BENEFITS OF GRID COMPUTING GRID COMPUTING Exploiting underutilized resources Parallel CPU capacity Virtual organizations for collaboration and virtual resources Access to additional resources Resource balancing Reliability Management
Presented By Ashok.J ashokmannai0005@gmail.com
Presentation detailed about SDN (Software Defined Network) overview . It covers from basics like different controllers and touches upon some technical details.
Covers Terminologies used, OpenFlow, Controllers, Open Day light, Cisco ONE, Google B4, NFV,etc
This presentation gives a detailed overview about Cloud Computing, its features and challenges faced by it in the market. It gives an insight into cloud security and privacy issues and its measures.
Automated Web Service Change Management (AWSCM) A tool published at IEEE Clou...Animesh Chaturvedi
This is a presentation of publication on IEEE CloudCom 2014 http://doi.ieeecomputersociety.org/10.1109/CloudCom.2014.144
AWSCM https://sites.google.com/site/animeshchaturvedi07/research/awscm
Presentation detailed about SDN (Software Defined Network) overview . It covers from basics like different controllers and touches upon some technical details.
Covers Terminologies used, OpenFlow, Controllers, Open Day light, Cisco ONE, Google B4, NFV,etc
This presentation gives a detailed overview about Cloud Computing, its features and challenges faced by it in the market. It gives an insight into cloud security and privacy issues and its measures.
Automated Web Service Change Management (AWSCM) A tool published at IEEE Clou...Animesh Chaturvedi
This is a presentation of publication on IEEE CloudCom 2014 http://doi.ieeecomputersociety.org/10.1109/CloudCom.2014.144
AWSCM https://sites.google.com/site/animeshchaturvedi07/research/awscm
In this paper, we discuss security issues for cloud computing, Map Reduce and Hadoop
environment. We also discuss various possible solutions for the issues in cloud computing
security and Hadoop. Today, Cloud computing security is developing at a rapid pace which
includes computer security, network security and information security. Cloud computing plays a
very vital role in protecting data, applications and the related infrastructure with the help of
policies, technologies and controls.
HIGH LEVEL VIEW OF CLOUD SECURITY: ISSUES AND SOLUTIONScscpconf
In this paper, we discuss security issues for cloud computing, Map Reduce and Hadoop
environment. We also discuss various possible solutions for the issues in cloud computing
security and Hadoop. Today, Cloud computing security is developing at a rapid pace which
includes computer security, network security and information security. Cloud computing plays a
very vital role in protecting data, applications and the related infrastructure with the help of
policies, technologies and controls.
Building a Big Data platform with the Hadoop ecosystemGregg Barrett
This presentation provides a brief insight into a Big Data platform using the Hadoop ecosystem.
To this end the presentation will touch on:
-views of the Big Data ecosystem and it’s components
-an example of a Hadoop cluster
-considerations when selecting a Hadoop distribution
-some of the Hadoop distributions available
-a recommended Hadoop distribution
Developed by Google’s Artificial Intelligence division, the Sycamore quantum processor boasts 53 qubits1.
In 2019, it achieved a feat that would take a state-of-the-art supercomputer 10,000 years to accomplish: completing a specific task in just 200 seconds1
Representational State Transfer (REST)
IaaS and Hybrid Cloud
Orchestration & Virtualization: Eucalyptus & Amazon
Content Delivery Network (CDN): Facebook and Akamai
PaaS and Container as a Service (CaaS)
PaaS: Google App Engine (GAE) and Ruby on Rails
CaaS: DockerHub
SaaS and Distributed Version Control (DVC)
SaaS: Facebook Testing (Infer and Sapienz)
DVC: GitHub and Git-LFS
Cloud Security and Privacy policies
NIST Guidelines, GDPR, CDN Security
Representational State Transfer (REST)
IaaS and Hybrid Cloud
Orchestration & Virtualization: Eucalyptus & Amazon
Content Delivery Network (CDN): Facebook and Akamai
PaaS and Container as a Service (CaaS)
PaaS: Google App Engine (GAE) and Ruby on Rails
CaaS: DockerHub
SaaS and Distributed Version Control (DVC)
SaaS: Facebook Testing (Infer and Sapienz)
DVC: GitHub and Git-LFS
Cloud Security and Privacy policies
NIST Guidelines, GDPR, CDN Security
Cloud Service Life-Cycle
Cloud Deployment Scenarios
Cloud Service Development and Testing
Web Service Slicing for Regression Testing of Services
Cloud Service Evolution Analytics
Quality of Service and Service Level Agreement
System of Systems Engineering (SoSE),
System “ilities” (Reliability, Availability, Maintainability, and Changeability),
State Series,
System Evolution Analytics,
System Network Evolution Rules,
System Network Complexity,
System Evolution Recommender
Service Evolution Analytics
P, NP, NP-Complete, and NP-Hard
Reductionism in Algorithms
NP-Completeness and Cooks Theorem
NP-Complete and NP-Hard Problems
Travelling Salesman Problem (TSP)
Travelling Salesman Problem (TSP) - Approximation Algorithms
PRIMES is in P - (A hope for NP problems in P)
Millennium Problems
Conclusions
Systems Analysis,
Systems Design,
Systems Modelling,
Systems Architecture,
System Development and Testing,
System Maintenance and Evolution,
SDLC example (Cloud Service life cycle)
Requirements Engineering,
Functional and Non-Functional Requirements,
Engineering Design Process and Process Engineering,
Logistics Management,
Risk management, and
Requirements specification
Complex systems,
Software systems,
Database systems,
Operating systems,
Bioinformatics systems,
Social Systems,
Service Oriented Systems,
Cloud Systems,
Ubiquitous systems,
Distributed Version Control Systems (GitHub), and
Software Container Systems (DockerHub and Google App Engine).
Interdisciplinary Science, Engineering, and Management,
Systems theory,
Systems thinking,
System development life cycles,
Synergy,
Project management,
Engineering Domains (Industry 4.0) , and
Communities (INCOSE and IEEE SMC Society).
1. Big Data Analytics
- Big Data
- Spark: Big Data Analytics
- Resilient Distributed Datasets (RDD)
- Spark libraries (SQL, DataFrames, MLlib for machine learning, GraphX, and Streaming)
- PFP: Parallel FP-Growth
2. Ubiquitous Computing
- Edge Computing
- Cloudlet
- Fog computing
- Internet of Things (IoT)
- Virtualization
- Virtual Conferencing
- Virtual Events (2D, 3D, and Hybrid)
1. Representational State Transfer (REST)
2. IaaS and Hybrid Cloud
- Orchestration & Virtualization: Eucalyptus & Amazon
- Content Delivery Network (CDN): Facebook and Akamai
3. PaaS and Container as a Service (CaaS)
- PaaS: Google App Engine (GAE) and Ruby on Rails
- CaaS: DockerHub
4. SaaS and Distributed Version Control (DVC)
- SaaS: Facebook Testing (Infer and Sapienz)
- DVC: GitHub and Git-LFS
5. Cloud Security and Privacy policies
- NIST Guidelines, GDPR, and CDN Security
1. Cloud Life-Cycle
2. Cloud Deployment Scenario
3. Cloud Service Development and Testing
4. Web Service Slicing for Regression Testing of Services
5. Cloud Service Evolution Analytics
6. Quality of Service and Service Level Agreement
Final project report on grocery store management system..pdfKamal Acharya
In today’s fast-changing business environment, it’s extremely important to be able to respond to client needs in the most effective and timely manner. If your customers wish to see your business online and have instant access to your products or services.
Online Grocery Store is an e-commerce website, which retails various grocery products. This project allows viewing various products available enables registered users to purchase desired products instantly using Paytm, UPI payment processor (Instant Pay) and also can place order by using Cash on Delivery (Pay Later) option. This project provides an easy access to Administrators and Managers to view orders placed using Pay Later and Instant Pay options.
In order to develop an e-commerce website, a number of Technologies must be studied and understood. These include multi-tiered architecture, server and client-side scripting techniques, implementation technologies, programming language (such as PHP, HTML, CSS, JavaScript) and MySQL relational databases. This is a project with the objective to develop a basic website where a consumer is provided with a shopping cart website and also to know about the technologies used to develop such a website.
This document will discuss each of the underlying technologies to create and implement an e- commerce website.
Courier management system project report.pdfKamal Acharya
It is now-a-days very important for the people to send or receive articles like imported furniture, electronic items, gifts, business goods and the like. People depend vastly on different transport systems which mostly use the manual way of receiving and delivering the articles. There is no way to track the articles till they are received and there is no way to let the customer know what happened in transit, once he booked some articles. In such a situation, we need a system which completely computerizes the cargo activities including time to time tracking of the articles sent. This need is fulfilled by Courier Management System software which is online software for the cargo management people that enables them to receive the goods from a source and send them to a required destination and track their status from time to time.
About
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
• Remote control: Parallel or serial interface.
• Compatible with MAFI CCR system.
• Compatible with IDM8000 CCR.
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
• Easy in configuration using DIP switches.
Technical Specifications
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
Key Features
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
• Remote control: Parallel or serial interface
• Compatible with MAFI CCR system
• Copatiable with IDM8000 CCR
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
Application
• Remote control: Parallel or serial interface.
• Compatible with MAFI CCR system.
• Compatible with IDM8000 CCR.
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
• Easy in configuration using DIP switches.
Saudi Arabia stands as a titan in the global energy landscape, renowned for its abundant oil and gas resources. It's the largest exporter of petroleum and holds some of the world's most significant reserves. Let's delve into the top 10 oil and gas projects shaping Saudi Arabia's energy future in 2024.
Explore the innovative world of trenchless pipe repair with our comprehensive guide, "The Benefits and Techniques of Trenchless Pipe Repair." This document delves into the modern methods of repairing underground pipes without the need for extensive excavation, highlighting the numerous advantages and the latest techniques used in the industry.
Learn about the cost savings, reduced environmental impact, and minimal disruption associated with trenchless technology. Discover detailed explanations of popular techniques such as pipe bursting, cured-in-place pipe (CIPP) lining, and directional drilling. Understand how these methods can be applied to various types of infrastructure, from residential plumbing to large-scale municipal systems.
Ideal for homeowners, contractors, engineers, and anyone interested in modern plumbing solutions, this guide provides valuable insights into why trenchless pipe repair is becoming the preferred choice for pipe rehabilitation. Stay informed about the latest advancements and best practices in the field.
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...Amil Baba Dawood bangali
Contact with Dawood Bhai Just call on +92322-6382012 and we'll help you. We'll solve all your problems within 12 to 24 hours and with 101% guarantee and with astrology systematic. If you want to take any personal or professional advice then also you can call us on +92322-6382012 , ONLINE LOVE PROBLEM & Other all types of Daily Life Problem's.Then CALL or WHATSAPP us on +92322-6382012 and Get all these problems solutions here by Amil Baba DAWOOD BANGALI
#vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore#blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #blackmagicforlove #blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #Amilbabainuk #amilbabainspain #amilbabaindubai #Amilbabainnorway #amilbabainkrachi #amilbabainlahore #amilbabaingujranwalan #amilbabainislamabad
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdffxintegritypublishin
Advancements in technology unveil a myriad of electrical and electronic breakthroughs geared towards efficiently harnessing limited resources to meet human energy demands. The optimization of hybrid solar PV panels and pumped hydro energy supply systems plays a pivotal role in utilizing natural resources effectively. This initiative not only benefits humanity but also fosters environmental sustainability. The study investigated the design optimization of these hybrid systems, focusing on understanding solar radiation patterns, identifying geographical influences on solar radiation, formulating a mathematical model for system optimization, and determining the optimal configuration of PV panels and pumped hydro storage. Through a comparative analysis approach and eight weeks of data collection, the study addressed key research questions related to solar radiation patterns and optimal system design. The findings highlighted regions with heightened solar radiation levels, showcasing substantial potential for power generation and emphasizing the system's efficiency. Optimizing system design significantly boosted power generation, promoted renewable energy utilization, and enhanced energy storage capacity. The study underscored the benefits of optimizing hybrid solar PV panels and pumped hydro energy supply systems for sustainable energy usage. Optimizing the design of solar PV panels and pumped hydro energy supply systems as examined across diverse climatic conditions in a developing country, not only enhances power generation but also improves the integration of renewable energy sources and boosts energy storage capacities, particularly beneficial for less economically prosperous regions. Additionally, the study provides valuable insights for advancing energy research in economically viable areas. Recommendations included conducting site-specific assessments, utilizing advanced modeling tools, implementing regular maintenance protocols, and enhancing communication among system components.
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)MdTanvirMahtab2
This presentation is about the working procedure of Shahjalal Fertilizer Company Limited (SFCL). A Govt. owned Company of Bangladesh Chemical Industries Corporation under Ministry of Industries.
Overview of the fundamental roles in Hydropower generation and the components involved in wider Electrical Engineering.
This paper presents the design and construction of hydroelectric dams from the hydrologist’s survey of the valley before construction, all aspects and involved disciplines, fluid dynamics, structural engineering, generation and mains frequency regulation to the very transmission of power through the network in the United Kingdom.
Author: Robbie Edward Sayers
Collaborators and co editors: Charlie Sims and Connor Healey.
(C) 2024 Robbie E. Sayers
Fundamental question and answer in cloud computing quiz by animesh chaturvedi
1. IVYear B.E. (InformationTechnology) IET-DAVV
ClassTest I February 2015
Subject: 4IT458 - Cloud Computing
Time Duration 70 minutes Maximum Marks 25
Fundamental Question and Answer in
Cloud Computing Quiz
https://sites.google.com/site/animeshchaturvedi07/academic-teaching/cloudcomputing
2. Questions are in equal marks
proportion that is five marks each
Q1.Who had won the “ACM A. M.TuringAward” in 2013?What is the role of
contributions by the winner in the growing larger scale distributed systems and cloud
computing?What is the title of highly cited research paper by the winner?
Q2.Which type of cloud computing model will you choose “if your organization has
significant infrastructure but still undergoing huge spikes of users (or requires cloud
bursting)”?
Q3. Suppose your organization want to transfer 100TB of data from X toY location.
Assume average bandwidth found to be 30 Mbit/sec in between X toY.What medium
you will choose physical or network to transfer the data from X toY? 1TB = 10^12
Bytes, 1 Byte = 2^3 bits and 1 Mbit/sec = 10^6 bits/sec.
Q4. Describe Google File System (GFS) and Hadoop Distributed File System (HDFS)?
Q5. Draw the architectures for “Hadoop on Google Cloud Platform” and “GoogleApp
Engine”.
https://sites.google.com/site/animeshchaturvedi07/academic-teaching/cloudcomputing
3. Answer
Answers to the questions can be inferred from the following
Answer 1 in slide 4 and 5
Answer 2 in slide 6
Answer 3 in slide 7
Answer 4 in slide 8 to 14
Answer 5 in slide 14 to 19
https://sites.google.com/site/animeshchaturvedi07/academic-teaching/cloudcomputing
4. Turing Award 2013
“Leslie Lamport, a Principal Researcher at Microsoft Research, as the
recipient of the 2013 ACM A. M.Turing Award.” Lamport’s proposed
widely used algorithms and tools that have applications in cloud
computing.
His 1978 paper “Time, Clocks, and the Ordering of Events in a
Distributed System” is one of the most cited in the history of computer
science.
“Turing Award for imposing clear, well-defined coherence on the
seemingly chaotic behavior of distributed computing systems, in which
several autonomous computers communicate with each other by passing
messages. He devised important algorithms and developed formal
modeling and verification protocols that improve the quality of real
distributed systems. These contributions have resulted in improved
correctness, performance, and reliability of computer systems.”
http://www.acm.org/press-room/news-releases/2014/turing-award-13
5. Turing Award 2013
“GoogleVice President of ResearchAlfred Spector noted that
“with the growing shift to ever-larger scale distributed systems
and cloud computing, Lamport’s work has taken on a significantly
increased role. His results have benefited many research
communities including those in parallel and high performance
computing systems, concurrent algorithms, and software
reliability. And, his work has had implications not just in the
theoretical community, but also with the engineers and
programmers who design and implement many types of systems.”
Harry Shum, Microsoft executive vice president ofTechnology and
Research:“I really started to appreciate the incredible
contribution his work has made to our industry, especially in cloud
computing and distributed systems, when I worked at Bing.At
Bing, we studied his paper on Paxos and applied his technology to
build the distributed systems that we still use today.”
http://www.acm.org/press-room/news-releases/2014/turing-award-13
http://research.microsoft.com/en-us/news/features/lamport-031814.aspx
6. Hybrid cloud
Hybrid cloud will help in extension of the capacity or the capability of a cloud service,
by aggregation, integration or customization with another cloud service.Ability to
connect, managed or dedicated services with both private and public cloud resources.
1. If an organization have some client data on a private cloud application, but want to
interconnect that application to a business intelligence application provided on a
public cloud as a software service.
2. If an organizations use public cloud computing resources to meet temporary capacity
needs that can not be met by the private cloud.
Cloud bursting: when the demand for computing capacity increases then an
application deployment model in a private cloud or data center will "bursts" to a public
cloud. During spike in processing demand requirement private cloud infrastructure that
supports average workloads will start using cloud resources from public or private
clouds together.
Advantage: payment only for the extra compute resources when they are needed.
7. Data Transfer Bottlenecks
Physical medium will be selected for data transfer. Because
For data-intensive application, data placement and transport across
the boundaries of clouds, may be complicate.
Data transfer costs is an important issue
Overcome the high cost of Internet transfers is to ship disks.
Assume that we want to ship 100TB from X toY. Suppose
measured bandwidth average found to be 30 Mbit/sec.
It would take
100 ∗ 10^12 Bytes /(30 × 10^6 bits/second)
= (8 × 10^14) /(3 × 10^7) seconds = 8/3 × 10^7 seconds,
= 308 plus days.
Very high network transfer fees for this data.
Mell, Peter, andTim Grance.“The NIST definition of cloud computing.”
National Institute of Standards andTechnology 53.6 (2009): 50.
8. Hadoop Distributed File System
http://hadoop.apache.org/docs/r1.2.1/hdfs_design.html accessed on
Jan 2015
10. Hadoop Distributed File System
Name Node: Manages File System - mapping files to blocks
and blocks to data nodes. Maintains status of data nodes
Heartbeat: Datanode sends heartbeat at regular intervals, if
heartbeat is not received, datanode is declared to be dead
Blockreport: DataNode sends list of blocks on it. Used to check
health of HDFS
Data Node:
Replicates (On Datanode failure, On Disk failure and On Block
corruption)
Data integrity (Checksum for each block, Stored in hidden file)
Rebalancing- balancer tool (addition of new nodes,
decommissioning and deletion of some files)
http://hadoop.apache.org/docs/r1.2.1/hdfs_design.html accessed on
Jan 2015
12. Google File System
A scalable distributed file system for large distributed data-
intensive applications.
It provides fault tolerance. High aggregate performance to a large
number of clients.
It is widely deployed within Google as the storage platform for the
generation and processing of data used by Google service as well
as research and development efforts that require large data sets.
The largest cluster to date provides hundreds of terabytes of
storage across thousands of disks on over a thousand machines, and
it is concurrently accessed by hundreds of clients. Earlier Google
effort, "BigFiles", developed by Larry Page and Sergey Brin. Files
are divided into fixed-size chunks of 64 megabytes.
GFS is not implemented in the kernel of an operating system, but
is instead provided as a userspace library.
http://research.google.com/archive/gfs.html
http://en.wikipedia.org/wiki/Google_File_System
13. Google Content Management
Web information, marketing campaigns or social media.
Personalized for individual users or groups.
Google Cloud Platform (GCP) components and services to
create a Content Management system.
Google Load Balancer to support traffic routed to multiple
zones for high availability.
Google’s Cloud DNS provides a robust DNS manages the
domain.
Static content Cloud Storage
Dynamic content Cloud SQL implementation.
https://cloud.google.com/solutions/architecture/contentmanagement accessed 15 Jan 2015
15. Architecture: Hadoop on Google Cloud
Platform
Infrastructure for MapReduce using Hadoop.
Compute power and Cloud Storage to store the input and
output of the MapReduce jobs.
Hadoop Master: includes the HDFS NameNode and the
MapReduce JobTracker.
Nodes in the cluster will run MapReduce tasks with
DataNode and MapReduceTaskTracker.
Backing-up the storage through Google Cloud Storage
Connector for Hadoop. HDFS, can be used, Google’s Cloud
Storage.
https://cloud.google.com/solutions/architecture/hadoop accessed 15 Jan 2015
16. Architecture: Hadoop on Google Cloud
Platform
https://cloud.google.com/solutions/architecture/hadoop accessed 15 Jan 2015
17. Architecture: Web Application on
Google App Engine
Simple development and deployment ofWebApplications with
autoscaling compute power as well as the integrated features like
distributed in-memory cache, task queues and datastore, to create
robust applications quickly and easily.
For applications written in Java, Python, PHP and Go.
Supports multiple application versions which support A/B testing.
Memcache is an in-memory cache to provide extremely high speed
access to information cached by the web server (e.g. authentication or
account information).
Task Queues provide a mechanism to offload longer running tasks to
backend servers, freeing the front end servers to service new user
requests.
Google Load Balancer which provides transparent load balancing to
applications.
Google’s Cloud DNS is used to manage DNS domain of user.
https://cloud.google.com/solutions/architecture/webapp accessed 15 Jan 2015
18. Architecture: Web Application on
Google App Engine
https://cloud.google.com/solutions/architecture/webapp accessed 15 Jan 2015
19. Google Web Tool - Kit
GWT gives us API to design rich web applications.
GWT is a Swing-like Java framework. Developer can write web
application without writing HTML or JavaScript code.
GWT is a development environment similar to any Web-Server-Code
or Desktop-app development environment.
GWT helps to debug, re-factor and unit test aWeb-Client.
GWT provides a so-called hosted mode, that allows developers to debug
Java code, as well as a web mode which executes the GWT-generated
JavaScript code.
Google uses GWT for its Sites: Google Docs, Google AdSense,
GoogleWallet
Other Sites: gogrid.com, Scenechronize, Google Moderator,
Whirled. See more at http://gwtgallery.appspot.com/