Cloud computing covers a wide range of areas, with a data communications background and authoritative certification, which increases the influence in this field. So what are the skills of cloud computing?
Cloud computing systems use many technologies, among which programming models, data management technology, data storage technology, virtualization technology, and cloud computing platform management technology are the most important.
(1 )Programming model
MapReduce is a java, Python, and Chop programming model developed by Google. It is a simplified distributed programming model and an efficient task scheduling model, used for parallel computing of large-scale data sets (more than 1TB) .The strict programming model makes programming in the cloud computing environment very simple. The idea of the MapReduce model is to decompose the problem to be executed into Map (mapping) and Reduce (simplification). First, the data is cut into irrelevant blocks through the Map program , allocate (schedule) a large amount of computer processing to achieve the effect of distributed computing, and then summarize and output the results through the Reduce program.
(2) Massive data distributed storage technology
Cloud The computing system consists of a large number of servers and serves a large number of users at the same time. Therefore, the cloud computing system uses distributed storage to store data and ensure the reliability of the data through redundant storage. Data storage systems widely used in cloud computing systems It is an open source implementation of HDFS developed by the Google GFS and Hadoop teams.
GFS is the Google File System.
System) is a scalable distributed file system for large, Distributed and accessing large amounts of data. The design concept of GFS is different from traditional file systems. It is designed for large-scale data processing and Google's application features. It runs on cheap ordinary hardware, but can provide fault tolerance. It can be used for Provide services with high overall performance to a wide range of users.
A GFS cluster consists of a master server and a large number of block servers, and is accessed by many clients. The master server stores the metadata of the file system, including namespace, Access control information, mapping from files to blocks and the current location of blocks. Also controls system-wide activities such as block lease management, orphan block garbage collection, and block transfers between block servers. The master server periodically passes HeartBeat information Communicate with each block server, issue instructions to the block server, and collect its status. Files in GFS are divided into 64MB blocks, with redundant storage, and each data is stored in the system with more than 3 backups.
The replacement of the client and the main server is limited to metadata operations, and all data communications are directly connected to the block server, which greatly improves the efficiency of the system and prevents the main server from being overloaded.
(3 )A large amount of data management technology
Cloud computing needs to process and analyze a large amount of distributed data, so data management technology must be able to effectively manage large amounts of data. The data management technology in cloud computing systems is mainly Google BT (BigTable) Data management technology and the open source data management module HBase developed by the Hadoop team.
Cloud computing is a computing method based on the Internet.
Concept:
Cloud computing is a type of distributed computing, which refers to the decomposition of huge data computing processing programs into countless small programs through the network "cloud", and then, These small programs are processed and analyzed through a system composed of multiple servers to obtain results and return them to the user.
Deployment mode:
Private cloud: Enterprises purchase or lease equipment to build it for internal use. Huawei's data center belongs to this model. Huawei itself is the operator and its user, which means that the user and the operator are one.
Public cloud: Just like a shared switch, telecom operators operate this switch, but its users may be ordinary people.
Features:
Cloud computing has efficient computing capabilities. Adding cloud computing functions to the original server can rapidly increase the computing speed, and ultimately achieve dynamic expansion of the level of virtualization. The purpose of application expansion. Cloud computing has very strong compatibility. It is not only compatible with low-configuration machines and hardware products from different manufacturers, but also enables higher-performance computing with peripherals.
Advantages of cloud computing:
1. Agility
Cloud computing can easily use various technologies to make it faster Innovate freely and build almost anything imaginable. Resources can be quickly spun up as needed, from infrastructure services such as cloud servers, storage and databases to IoT, machine learning, data lakes and analytics, and more.
2. Scalability and elasticity
With cloud computing, there is no need to over-provision resources in advance to handle peak business activity in the future. Instead, the amount of resources can be provisioned based on actual demand, and these resources can be immediately scaled up or down to expand or shrink capacity as business needs change.
3. Cost savings
Cloud technology transforms fixed capital expenditures (such as data centers and local servers) into variable expenditures, and only needs to be paid according to actual costs. Pay what you use. Additionally, due to economies of scale, variable expenses are much lower than when deployed in-house.
4. Improve data reliability
No need to connect to a single computer or network, and multiple users can easily collaborate on documents and projects at the same time. If a personal computer crashes, all data is safe in the cloud and remains accessible.
Cloud computing is a computing method based on the Internet.
Cloud computing is not a new network technology, but a new network application concept. The core concept of cloud computing is to provide fast and secure cloud computing services and services on the website with the Internet as the center. Data storage allows everyone who uses the Internet to use the huge computing resources and data centers on the network.
"Cloud" is essentially a network. In a narrow sense, cloud computing is a network that provides resources. Users can obtain resources on the "cloud" at any time, use them as needed, and view them. It is infinitely scalable, just pay according to usage.
In a broad sense, cloud computing is a service related to information technology, software, and the Internet. This computing resource sharing pool is called "cloud". Cloud computing brings together many computing resources and uses them through software. Automated management requires only a few people to participate, allowing resources to be provided quickly.
In other words, computing power, as a commodity, can be circulated on the Internet, just like water, electricity, and gas. It can be easily accessed and the price is relatively low.
The background of cloud computing:
The Internet began to rise in 1960 and is mainly used for plain text emails between the military, large enterprises, etc. or news cluster service. It was not until 1990 that it began to enter ordinary households. With the development of web sites and e-commerce, the Internet has become one of the necessities of life that people cannot live without.
The concept of cloud computing was first proposed at the Search Engine Conference in August 2006, becoming the third revolution of the Internet. Cloud computing is also becoming a strategic focus for the development of the information technology industry, and information technology companies around the world are transforming to cloud computing.
For an enterprise, the computing power of a computer is far from meeting the data computing needs, so the company must purchase a computer with stronger computing power, that is, a server. For larger enterprises, the computing power of one server is obviously not enough, so the enterprise needs to purchase multiple servers.
It has even evolved into a data center with multiple servers, and the number of servers will directly affect the business processing capabilities of the data center.
In addition to the high initial construction costs, the money spent on electricity in computer operating expenses is much higher than the investment cost. Add in the maintenance expenses of the computer and network, and these total costs It is difficult for small and medium-sized enterprises to afford it, so the concept of cloud computing came into being.
上一篇:云计算原理详解
下一篇:云计算是基于什么的计算方式