Cloud Computing: Concepts, Technologies and Business Implications
اسلاید 1: Cloud Computing: Concepts, Technologies and Business ImplicationsB. Ramamurthy & K. Maduraibina@buffalo.edu & kumar.madurai@ctg.comThis talks is partially supported by National Science Foundation grants DUE: #0920335, OCI: #10412806/23/2010Wipro Chennai 20111
اسلاید 2: Outline of the talkIntroduction to cloud contextTechnology context: multi-core, virtualization, 64-bit processors, parallel computing models, big-data storages…Cloud models: IaaS (Amazon AWS), PaaS (Microsoft Azure), SaaS (Google App Engine)Demonstration of cloud capabilitiesCloud models Data and Computing models: MapReduceGraph processing using amazon elastic mapreduceA case-study of real business application of the cloudQuestions and Answers6/23/2010Wipro Chennai 20112
اسلاید 3: Speakers’ Background in cloud computing Bina:Has two current NSF (National Science Foundation of USA) awards related to cloud computing:2009-2012: Data-Intensive computing education: CCLI Phase 2: $250K2010-2012: Cloud-enabled Evolutionary Genetics Testbed: OCI-CI-TEAM: $250K Faculty at the CSE department at University at Buffalo.Kumar:Principal Consultant at CTGCurrently heading a large semantic technology business initiative that leverages cloud computingAdjunct Professor at School of Management, University at Buffalo.6/23/2010Wipro Chennai 20113
اسلاید 4: Introduction: A Golden Era in Computing6/2/2011Cloud Futures 2011, Redmond, WA4
اسلاید 5: Cloud Concepts, Enabling-technologies, and Models: The Cloud Context6/23/2010Wipro Chennai 20115
اسلاید 6: Evolution of Internet ComputingPublishInformInteractIntegrateTransactDiscover (intelligence)Automate (discovery)timescaleSocial media and networkingSemanticdiscoveryData-intensiveHPC, cloudwebdeep webData marketplace and analytics6/23/2010Wipro Chennai 20116
اسلاید 7: Top Ten Largest DatabasesRef: http://www.focus.com/fyi/operations/10-largest-databases-in-the-world/6/23/2010Wipro Chennai 20117
اسلاید 8: ChallengesAlignment with the needs of the business / user / non-computer specialists / community and societyNeed to address the scalability issue: large scale data, high performance computing, automation, response time, rapid prototyping, and rapid time to productionNeed to effectively address (i) ever shortening cycle of obsolescence, (ii) heterogeneity and (iii) rapid changes in requirementsTransform data from diverse sources into intelligence and deliver intelligence to right people/user/systemsWhat about providing all this in a cost-effective manner?6/23/2010Wipro Chennai 20118
اسلاید 9: Enter the cloudCloud computing is Internet-based computing, whereby shared resources, software and information are provided to computers and other devices on-demand, like the electricity grid.The cloud computing is a culmination of numerous attempts at large scale computing with seamless access to virtually limitless resources. on-demand computing, utility computing, ubiquitous computing, autonomic computing, platform computing, edge computing, elastic computing, grid computing, …6/23/2010Wipro Chennai 20119
اسلاید 10: “Grid Technology: A slide from my presentation to Industry (2005)Emerging enabling technology.Natural evolution of distributed systems and the Internet.Middleware supporting network of systems to facilitate sharing, standardization and openness.Infrastructure and application model dealing with sharing of compute cycles, data, storage and other resources.Publicized by prominent industries as on-demand computing, utility computing, etc.Move towards delivering “computing” to masses similar to other utilities (electricity and voice communication).”Now,Hmmm…sounds like the definition for cloud computing!!!!!6/23/2010Wipro Chennai 201110
اسلاید 11: It is a changed world now…Explosive growth in applications: biomedical informatics, space exploration, business analytics, web 2.0 social networking: YouTube, FacebookExtreme scale content generation: e-science and e-business data delugeExtraordinary rate of digital content consumption: digital gluttony: Apple iPhone, iPad, Amazon KindleExponential growth in compute capabilities: multi-core, storage, bandwidth, virtual machines (virtualization)Very short cycle of obsolescence in technologies: Windows Vista Windows 7; Java versions; CC#; PhythonNewer architectures: web services, persistence models, distributed file systems/repositories (Google, Hadoop), multi-core, wireless and mobileDiverse knowledge and skill levels of the workforce You simply cannot manage this complex situation with your traditional IT infrastructure:6/23/2010Wipro Chennai 201111
اسلاید 12: Answer: The Cloud Computing?Typical requirements and models: platform (PaaS), software (SaaS), infrastructure (IaaS), Services-based application programming interface (API)A cloud computing environment can provide one or more of these requirements for a costPay as you go model of businessWhen using a public cloud the model is similar to renting a property than owning one.An organization could also maintain a private cloud and/or use both.6/23/2010Wipro Chennai 201112
اسلاید 13: Enabling Technologies64-bit processorMulti-core architecturesVirtualization: bare metal, hypervisor. …VM0VM1VMnWeb-services, SOA, WS standardsServices interfaceCloud applications: data-intensive, compute-intensive, storage-intensiveStorage Models: S3, BigTable, BlobStore, ...BandwidthWS6/23/2010Wipro Chennai 201113
اسلاید 14: Common Features of Cloud ProvidersDevelopment Environment: IDE, SDK, PluginsProduction EnvironmentSimplestorageTable Store <key, value>DrivesAccessible through Web servicesManagement Console and Monitoring tools& multi-level security6/23/2010Wipro Chennai 201114
اسلاید 15: Windows AzureEnterprise-level on-demand capacity builderFabric of cycles and storage available on-request for a costYou have to use Azure API to work with the infrastructure offered by MicrosoftSignificant features: web role, worker role , blob storage, table and drive-storage6/23/2010Wipro Chennai 201115
اسلاید 16: Amazon EC2Amazon EC2 is one large complex web service.EC2 provided an API for instantiating computing instances with any of the operating systems supported.It can facilitate computations through Amazon Machine Images (AMIs) for various other models.Signature features: S3, Cloud Management Console, MapReduce Cloud, Amazon Machine Image (AMI)Excellent distribution, load balancing, cloud monitoring tools6/23/2010Wipro Chennai 201116
اسلاید 17: Google App Engine This is more a web interface for a development environment that offers a one stop facility for design, development and deployment Java and Python-based applications in Java, Go and Python.Google offers the same reliability, availability and scalability at par with Google’s own applications Interface is software programming basedComprehensive programming platform irrespective of the size (small or large)Signature features: templates and appspot, excellent monitoring and management console6/23/2010Wipro Chennai 201117
اسلاید 18: DemosAmazon AWS: EC2 & S3 (among the many infrastructure services)Linux machine Windows machineA three-tier enterprise applicationGoogle app EngineEclipse plug-in for GAEDevelopment and deployment of an applicationWindows AzureStorage: blob store/containerMS Visual Studio Azure development and production environment6/23/2010Wipro Chennai 201118
اسلاید 19: Cloud Programming Models6/23/2010Wipro Chennai 201119
اسلاید 20: The Context: Big-dataData mining huge amounts of data collected in a wide range of domains from astronomy to healthcare has become essential for planning and performance.We are in a knowledge economy.Data is an important asset to any organizationDiscovery of knowledge; Enabling discovery; annotation of dataComplex computational modelsNo single environment is good enough: need elastic, on-demand capacitiesWe are looking at newer Programming models, andSupporting algorithms and data structures.6/23/2010Wipro Chennai 201120
اسلاید 21: Google File SystemInternet introduced a new challenge in the form web logs, web crawler’s data: large scale “peta scale”But observe that this type of data has an uniquely different characteristic than your transactional or the “customer order” data : “write once read many (WORM)” ; Privacy protected healthcare and patient information; Historical financial data; Other historical data Google exploited this characteristics in its Google file system (GFS)6/23/2010Wipro Chennai 201121
اسلاید 22: What is Hadoop?At Google MapReduce operation are run on a special file system called Google File System (GFS) that is highly optimized for this purpose.GFS is not open source.Doug Cutting and others at Yahoo! reverse engineered the GFS and called it Hadoop Distributed File System (HDFS).The software framework that supports HDFS, MapReduce and other related entities is called the project Hadoop or simply Hadoop.This is open source and distributed by Apache.6/23/2010Wipro Chennai 201122
اسلاید 23: Fault toleranceFailure is the norm rather than exceptionA HDFS instance may consist of thousands of server machines, each storing part of the file system’s data.Since we have huge number of components and that each component has non-trivial probability of failure means that there is always some component that is non-functional.Detection of faults and quick, automatic recovery from them is a core architectural goal of HDFS.6/23/2010Wipro Chennai 201123
اسلاید 24: HDFS ArchitectureNamenodeBreplicationRack1Rack2ClientBlocksDatanodesDatanodesClientWriteReadMetadata opsMetadata(Name, replicas..)(/home/foo/data,6. ..Block ops6/23/2010Wipro Chennai 201124
اسلاید 25: Hadoop Distributed File SystemApplicationLocal file systemMaster nodeName NodesHDFS ClientHDFS ServerBlock size: 2KBlock size: 128MReplicated6/23/2010Wipro Chennai 201125
اسلاید 26: What is MapReduce?MapReduce is a programming model Google has used successfully is processing its “big-data” sets (~ 20000 peta bytes per day)A map function extracts some intelligence from raw data.A reduce function aggregates according to some guides the data output by the map.Users specify the computation in terms of a map and a reduce function, Underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, andUnderlying system also handles machine failures, efficient communications, and performance issues. -- Reference: Dean, J. and Ghemawat, S. 2008. MapReduce: simplified data processing on large clusters. Communication of ACM 51, 1 (Jan. 2008), 107-113.6/23/2010Wipro Chennai 201126
اسلاید 27: Classes of problems “mapreducable”Benchmark for comparing: Jim Gray’s challenge on data-intensive computing. Ex: “Sort”Google uses it for wordcount, adwords, pagerank, indexing data. Simple algorithms such as grep, text-indexing, reverse indexingBayesian classification: data mining domainFacebook uses it for various operations: demographicsFinancial services use it for analyticsAstronomy: Gaussian analysis for locating extra-terrestrial objects.Expected to play a critical role in semantic web and in web 3.06/23/2010Wipro Chennai 201127
اسلاید 28: CountCountCountLarge scale data splitsParse-hashParse-hashParse-hashParse-hashMap <key, 1><key, value>pairReducers (say, Count)P-0000 P-0001 P-0002 , count1 , count2,count36/23/2010Wipro Chennai 201128
اسلاید 29: MapReduce EngineMapReduce requires a distributed file system and an engine that can distribute, coordinate, monitor and gather the results.Hadoop provides that engine through (the file system we discussed earlier) and the JobTracker + TaskTracker system. JobTracker is simply a scheduler. TaskTracker is assigned a Map or Reduce (or other operations); Map or Reduce run on node and so is the TaskTracker; each task is run on its own JVM on a node.6/23/2010Wipro Chennai 201129
اسلاید 30: DemosWord count application: a simple foundation for text-mining; with a small text corpus of inaugural speeches by US presidentsGraph analytics is the core of analytics involving linked structures (about 110 nodes): shortest path 6/23/2010Wipro Chennai 201130
اسلاید 31: A Case-study in Business: Cloud Strategies6/23/2010Wipro Chennai 201131
اسلاید 32: Predictive Quality Project OverviewIdentify special causes that relate to bad outcomes for the quality-related parameters of the products and visually inspected defectsComplex upstream process conditions and dependencies making the problem difficult to solve using traditional statistical / analytical methodsDetermine the optimal process settings that can increase the yield and reduce defects through predictive quality assurancePotential savings huge as the cost of rework and rejects are very highProblem / Motivation:Solution:Use ontology to model the complex manufacturing processes and utilize semantic technologies to provide key insights into how outcomes and causes are relatedDevelop a rich internet application that allows the user to evaluate process outcomes and conditions at a high level and drill down to specific areas of interest to address performance issues6/23/2010Wipro Chennai 201132
اسلاید 33: Why Cloud Computing for this ProjectWell-suited for incubation of new technologiesSemantic technologies still evolving Use of Prototyping and Extreme ProgrammingServer and Storage requirements not completely knownTechnologies used (TopBraid, Tomcat) not part of emerging or core technologies supported by corporate ITScalability on demandDevelopment and implementation on a private cloud6/23/2010Wipro Chennai 201133
اسلاید 34: Public Cloud vs. Private CloudRationale for Private Cloud:Security and privacy of business data was a big concernPotential for vendor lock-inSLA’s required for real-time performance and reliabilityCost savings of the shared model achieved because of the multiple projects involving semantic technologies that the company is actively developing 6/23/2010Wipro Chennai 201134
اسلاید 35: Cloud Computing for the Enterprise What should IT DoRevise cost model to utility-based computing: CPU/hour, GB/day etc. Include hidden costs for management, trainingDifferent cloud models for different applications - evaluateUse for prototyping applications and learnLink it to current strategic plans for Services-Oriented Architecture, Disaster Recovery, etc.6/23/2010Wipro Chennai 201135
اسلاید 36: References & useful linksAmazon AWS: http://aws.amazon.com/free/AWS Cost Calculator: http://calculator.s3.amazonaws.com/calc5.htmlWindows Azure: http://www.azurepilot.com/Google App Engine (GAE): http://code.google.com/appengine/docs/whatisgoogleappengine.htmlGraph Analytics: http://www.umiacs.umd.edu/~jimmylin/Cloud9/docs/content/Lin_Schatz_MLG2010.pdfFor miscellaneous information: http://www.cse.buffalo.edu/~bina6/23/2010Wipro Chennai 201136
اسلاید 37: SummaryWe illustrated cloud concepts and demonstrated the cloud capabilities through simple applicationsWe discussed the features of the Hadoop File System, and mapreduce to handle big-data sets.We also explored some real business issues in adoption of cloud.Cloud is indeed an impactful technology that is sure to transform computing in business.6/23/2010Wipro Chennai 201137
نقد و بررسی ها
هیچ نظری برای این پاورپوینت نوشته نشده است.