E-LESSON-3

IDOL Institute of Distance and Online Learning ENHANCE YOUR QUALIFICATION, ADVANCE YOUR CAREER.

BCA 2 All right are reserved with CU-IDOL Internet Computing and Ethics Course Code: MCA 612 Semester: First SLM Unit: 3 e-Lesson No.: 3 www.cuidol.in Unit-3 (BCA113)

Cloud Computing 33 OBJECTIVES INTRODUCTION Student will be able to define various cloud • In this unit description of cloud computing services and its application. and services they are providing along with its applications. Student will be able to learn about the deployment models and challenges faced by cloud computing . •Explain deployment models and challenges faced for cloud computing. Student will be able to learn about characteristics and types of Big Data. Student will be able to know about challenges of •Define Big data and their characteristics and Big Data. types along with the challenges . www.cuidol.in Unit-3 (BCACA11131)3) INASlTl ITriUgThEt OarFeDrIeSsTeArNvCeEd AwNitDh OCNUL-IIDNOE LLEARNING

TOPICS TO BE COVERED 4  Introduction to Cloud Computing  Cloud Computing Services and applications  About deployment model of cloud computing  Cloud Computing Challenges  About characteristics and Types of Big Data  About challenges of Big Data www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

What is Cloud Computing 5  Cloud Computing is a general term used to describe a new class of network based computing that takes place over the Internet,  basically a step on from Utility Computing  a collection/group of integrated and networked hardware, software and Internet infrastructure (called a platform).  Using the Internet for communication and transport provides hardware, software and networking services to clients.  These platforms hide the complexity and details of the underlying infrastructure from users and applications by providing very simple graphical interface or API (Applications Programming Interface) www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

What is Cloud Computing 6  Cloud computing, aims at allowing access to large amounts of computing power in a fully virtualized manner, by aggregating resources and offering a single system view.  It delivers computing as a utility.  Utility computing describes a business model for on-demand delivery of computing power; consumers pay providers based on usage (“pay- as-you-go”)  Cloud computing acts an umbrella term to describe a category of sophisticated on- demand computing services initially offered by commercial providers, such as Amazon, Google, and Microsoft.  It denotes a model on which a computing infrastructure is viewed as a “cloud,” from which businesses and individuals access applications from anywhere in the world on demand. www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

What is Cloud Computing 7  The National Institute of Standards and Technology (NIST) characterizes cloud computing as  “. . . a pay-per-use model for enabling available, convenient, on-demand network access to a shared pool of configurable computing resources (e.g. networks, servers, storage, applications, services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.” www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Cloud Computing Characteristics 8 Common Characteristics: Massive Scale Resilient Computing Homogeneity Geographic Distribution Virtualization Low Cost Software Service Orientation Advanced Security Essential Characteristics: On Demand Self-Service Broad Network Access Rapid Elasticity Resource Pooling Measured Service www.cuidol.in Unit-3 (BCA113) 8 All right are reserved with CU-IDOL

Cloud Models 9  Two distinct set of models:  Deployment models: refers to location & management of cloud’s infrastructure.  Service models: refers to the services that one can access on the cloud computing platform. www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Types of Deployment models 10  1. Public Cloud - A public cloud can be accessed by any subscriber with an internet connection and access to the cloud space.  2. Private Cloud - A private cloud is established for a specific group or organization and limits access to just that group.  3. Community Cloud - A community cloud is shared among two or more organizations that have similar cloud requirements.  4. Hybrid Cloud - A hybrid cloud is essentially a combination of at least two clouds, where the clouds included are a mixture of public, private, or community www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Types of Cloud Service Models 11 Software as a SaaS is a model of software deployment where the software Service (SaaS) applications are provided to the customers as a service. Platform as a PaaS deliver a computing platform where the developers Service (PaaS) can develop their own applications. Infrastructure as a IaaS delivers computer infrastructure, typically a platform virtualization Service (IaaS) environment, as a service. Rather than purchasing servers, software, data center space or network equipment, clients instead buy those resources as a fully outsourced service. www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Types of Cloud Service Model 12 SalesForce CRM LotusLive Google App Engine www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Opportunities and Challenges  The use of the cloud provides a number of opportunities: 13  It enables services to be used without any understanding of their infrastructure.  Cloud computing works using economies of scale:  It potentially lowers the outlay expense for start up companies, as they would no longer need to buy their own software or servers.  Cost would be by on-demand pricing.  Vendors and Service providers claim costs by establishing an ongoing revenue stream.  Data and services are stored remotely but accessible from “anywhere”. www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Opportunities and Challenges 14  In parallel there has been backlash against cloud computing:  Use of cloud computing means dependence on others and that could possibly limit flexibility and innovation:  The others are likely become the bigger Internet companies like Google and IBM, who may monopolise the market.  Some argue that this use of supercomputers is a return to the time of mainframe computing that the PC was a reaction against.  Security could prove to be a big issue:  It is still unclear how safe out-sourced data is and when using these services ownership of data is not always clear.  There are also issues relating to policy and access:  If your data is stored abroad whose policy do you adhere to? www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Advantages and Disadvantages 15 www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Application of Cloud Computing 16  Shared pool of configurable computing resources  On-demand network access  Provisioned by the Service Providerz www.cuidol.in Unit-3 (BCA113) 16 All right are reserved with CU-IDOL

Application of Cloud Computing 17  Customer Relationship Management  Business Process  E commerce Applications  Human Resources and Employees  Online Storage (Google Drive)  Back-up and Recovery www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Big Data 18  “Big data is defined as large amount of data which requires new technologies and architectures so that it becomes possible to extract value from it…”  Big data is sort of a misnomer, as it only points out the size of the data not giving too much of attention to its other existing properties. www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Characteristics Big Data 19  Variety - the stored data is not all of the same type or category  Structured data - data that is organized in a structure so that it is identifiable e.g. SQL data  Semi-structured data - a form of structured data that has a self-describing structure yet does not conform with the formal structure of a relational database e.g. XML  Unstructured data - data with no identifiable structure e.g. image, audio, video.  Variability - represents the inconsistency of the data flow  The flow of data can be highly inconsistent, leading to periodic peaks and lows  Daily, seasonal and event-triggered peak data loads can be challenging to manage, especially for unstructured data[2]  For example a large natural disaster would spike page visits for cnn.com www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Characteristics Big Data 20  Volume - The “Big” in Big data and represents the large volume or size of the data  At present the data existing is in petabytes and is supposed to increase to zettabytes in the near future  For example big social networking sites are producing data in order of terabytes everyday and this amount of data is difficult to handle using traditional system.  Variability - represents the inconsistency of the data flow  The flow of data can be highly inconsistent, leading to periodic peaks and lows  Daily, seasonal and event-triggered peak data loads can be challenging to manage, especially for unstructured data[2]  For example a large natural disaster would spike page visits for cnn.com www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Characteristics Big Data 21  Variety - the stored data is not all of the same type or category  Structured data - data that is organized in a structure so that it is identifiable e.g. SQL data  Semi-structured data - a form of structured data that has a self-describing structure yet does not conform with the formal structure of a relational database e.g. XML  Unstructured data - data with no identifiable structure e.g. image,audio,video www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Types of Big Data 22 Factors Structured data Semi-structured Unstructured data Flexibility It is dependent and less data It is flexible in nature and flexible It is more flexible than there is an absence of a structured data but less schema Transaction Management Matured transaction and than flexible than Query performance various concurrency unstructured data No transaction Technology technique The transaction is management and no Structured query allow adapted from DBMS not concurrency complex joining matured An only textual query is It is based on the Queries over anonymous possible relational database table nodes are possible This is based on character It is based on RDF and and library data XML www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Big Data Challenges and Issues 23  Privacy and Security  The most important issue with Big data which includes conceptual, technical as well as legal significance  The personal information of a person when combined with external large data sets leads to the inference of new private facts about that person  Big data used by law enforcement will increase the chances of certain tagged people to suffer from adverse consequences without the ability to fight back or even having knowledge that they are being discriminated against.  Technical Challenges:  Fault tolerance  Scalability  Quality of data  Heterogeneous data www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Big Data Challenges and Issues 24  Data Access and Sharing of Information  If data is to be used to make accurate decisions in time it becomes necessary that it should be available in accurate, complete and timely manner  Storage and Processing Issues  Many companies are struggling to store the large amount of data they are producing  Outsourcing storage to the cloud may seem like an option but long upload times and constant updates to the data preclude this option  Processing a large amount of data also takes a lot of time www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Big Data Challenges and Issues 25  Analytical Challenges:  What if data volume become so large?  Does all data need to be stored?  Does all data need to be analysis?  Many companies are struggling to store the large amount of data they are producing  Processing a large amount of data also takes a lot of time  Human Resources and Man Power:  Lack of analytical skilled manpower.  Need proper training courses to learn tactics to manage big data. www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Big Data Approaches: Tools and Techniques 26  Hadoop - is an open source project hosted by Apache Software Foundation for managing Big data  Hadoop consists of two main components  The Hadoop File System (HDFS) which is a distributed file-system that stores the data on multiple separate servers (each of which having its own processor(s))  MapReduce the framework that understands and assigns work to the nodes in a cluster[3] www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Big Data Approaches: Tools and Techniques27  Hadoop provides the following advantages[3]  Data read/write performance is increased by distributing the data across the cluster allowing each processor to do work in a parallel fashion  It’s scalable, new nodes can be added as needed without making changes to the existing system  It’s cost effective because it brings parallel computing to commodity servers  It’s flexible, it can absorb any type of data, structured or not from any number of sources  It’s fault tolerant, it handles failures intrinsically by always storing multiple copies of the data and automatically loading a copy when a fault is detected www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

Big Data Approaches: Tools and Techniques 28  How do you use Hadoop?  The developer writes a program that conforms to the MapReduce programming model  The developer specifies the format of the data to be processed in their program  How does MapReduce work?[4]  Each Hadoop program performs two tasks:  Map - Breaks all of the data down into key/value pairs  Reduce - Takes the output from the map step as input and combines those data key/value pairs into a smaller set of key/value pairs www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

MULTIPLE CHOICE QUESTIONS 29 Q1. Which is not the come in the 5 Vs of Big Data---------? a) Velocity b) Volume c) Variety d) None of these Q2.What is the full form SAS: a) System AS a Service b) Service As a Software c) Software AS a Service d) None of these Q3.IAS stands for : Unit-3 (BCA113) All right are reserved with CU-IDOL a) Infrastructure As a Service b) Infrastructure As a Software c) Internet As a Service d) None of these Answers:1. d) 2. c) 3.a) www.cuidol.in

MULTIPLE CHOICE QUESTIONS 30 Q4.Which is not the Common Characteristics of cloud computing: a) Low cost software b) Advance security c) Virtualization d) All of the above Q5.What do you mean by Big data: a) Large amount of data b) Structured data c) Unstructured data d) All of these Q6.What are the types of deployment model?: a) File Transfer Program b) File Transmission Program c) File Transfer Protocol d) None of these Answers: 4.d) 5. d) 6.c) www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

SUMMARY 31  Cloud Computing is a general term used to describe a new class of network based computing that takes place over the Internet, .  Cloud computing, aims at allowing access to large amounts of computing power in a fully virtualized manner, by aggregating resources and offering a single system view  Deployment models and service model are two distinct model of cloud computing.  Data and services are stored remotely but accessible from “anywhere”.  Customer Relationship Management, Business Process, E commerce Applications, Human Resources and Employees, Online Storage (Google Drive),Back-up and Recovery are application of cloud computing www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

SUMMARY 32  Big data is defined as large amount of data which requires new technologies and architectures so that it becomes possible to extract value from it.  Types of big data are:  Structured data - data that is organized in a structure so that it is identifiable e.g. SQL data  Semi-structured data - a form of structured data that has a self-describing structure yet does not conform with the formal structure of a relational database e.g. XML  Unstructured data - data with no identifiable structure e.g. image,audio,video  Privacy and Security ,Technical Challenges, Storage and Processing Issues , human and man power etc. are some challenges of big data. www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

FREQUENTLY ASKED QUESTIONS 33 Q1. Describe cloud computing. Ans: Cloud Computing is a general term used to describe a new class of network based computing that takes place over the Internet. For Further details please refer to the subject SLM unit 3. Q2. Explain the different types of cloud. Ans: The various cloud are - Public Cloud, Private Cloud, Community Cloud, and Hybrid Cloud. For further details please refer to the subject SLM unit 3. Q3. Define SaaS, PaaS, and IaaS. Ans: SaaS is a model of software deployment where the software applications are provided to the customers as a service. For Further details please refer to the subject SLM unit 3. Q4. Define big data. List the characteristics big data. Ans: Big data is defined as large amount of data which requires new technologies and architectures so that it becomes possible to extract value from it…” For Further details please refer to the subject SLM unit 3. www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

REFERENCES 34 http://ieeexplore.ieee.org.ezp.scranton.edu/xpls/icp.jsp?arnumber=6612229&tag=1#references https://blogs.vmware.com/vfabric/2013/03/why-every-database-must-be-broken-soon.html http://www.sas.com/en_us/insights/big-data/what-is-big-data.html http://www-01.ibm.com/software/data/infosphere/hadoop/ http://www-01.ibm.com/software/data/infosphere/hadoop/mapreduce/ www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL

35 THANK YOU www.cuidol.in Unit-3 (BCA113) All right are reserved with CU-IDOL