目录

容器云平台搭建

容器云平台搭建

传统开发测试运维流程

https://imgkr2.cn-bj.ufileos.com/c9ade344-0669-41b5-b1bb-40ddad60a2c3.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=dSzG1dnoYmcqvZTS%252BAIskmQY05s%253D&Expires=1615176399

https://imgkr2.cn-bj.ufileos.com/aa2bb071-4e26-4bfc-a68d-e75cd6e708a9.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=td1%252Bheraur8t5EXLE%252BLGi5SYywQ%253D&Expires=1615176554

基于云平台大大提高开发测试效率

https://imgkr2.cn-bj.ufileos.com/9fe7df1a-b30a-4b93-ba2e-51c01802c69d.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=ARO2WhS%252F1ykNh%252FJaU5LElEYDl24%253D&Expires=1615176464

容器云解决的问题

https://imgkr2.cn-bj.ufileos.com/0966355e-c55f-4269-bf23-c98a8e341b77.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=gY%252FYPejXJDPaWUoGNQE4NkcsVYo%253D&Expires=1615176519

技术栈选择

https://imgkr2.cn-bj.ufileos.com/9654c6a8-798a-4f09-a552-a07b1c542a07.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=Kmq9I7Zf3BqeCuJdN99%252Ft1TRr10%253D&Expires=1615176586

IAAS基础设施即服务  
CAAS 容器即服务和SAAS做的事情一样 只是换了一种方式  

虚拟机VS容器

https://imgkr2.cn-bj.ufileos.com/92f664f9-d23e-438e-aefa-c015715d38dc.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=EJeZh7YrqdHMKXkP0KfM9rjyCG0%253D&Expires=1615176632

容器对资源进行隔离 是内核态的  

容器云定位

https://imgkr2.cn-bj.ufileos.com/c520add9-c14f-44c6-ad3f-4d8e7143888e.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=r7m63VXAT%252Fv183vmU734jUtWp9s%253D&Expires=1615176668

容器云部署流程

https://imgkr2.cn-bj.ufileos.com/59704ab8-0703-4920-b3e1-5f731d8cdefc.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=114%252FA7Xvf7H2hoxMkZ%252Fo%252B7gE8H8%253D&Expires=1615176702

设计理念

https://imgkr2.cn-bj.ufileos.com/edf28a1a-5195-46ae-98d2-b6273674e305.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=5n3TBlGDmg4wNwipuB2Vh%252Ff%252FX%252BU%253D&Expires=1615176725

容器选型

https://imgkr2.cn-bj.ufileos.com/e94e7e72-26b6-4ccc-b0b3-bf016dc10d6d.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=xkWjmbUVG66%252FqV70EY7KmmurFqw%253D&Expires=1615176744

容器平台全局架构

https://imgkr2.cn-bj.ufileos.com/55e9395c-ebb6-4464-9ee8-a448abeb58b2.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=I3n2%252B%252FMAKg6baQi6OEF1uEIevHs%253D&Expires=1615176763

1、SCM是代码库版本管理  
2、cAdvisor收集容器情况汇报给heapster  
3、heapster再把监控数据放到时序数据库influxDB  
4、日志采集使用阿里开源组件log-pilot  
   log-pilot将Docker里面打印的日志采集到宿主机  
   flume采集宿主机日志到kafka  
   Kafka上传到大数据平台(hadoop平台)  
5、网络插件使用CNI+DHCP  
6、镜像仓库使用Harbor  

可视化云平台

实例管理

https://imgkr2.cn-bj.ufileos.com/06823348-5ab5-48c9-b4ff-3abb97a0ccdf.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=lHgrCtOjKKMKDAD%252BXREUxVK4nUE%253D&Expires=1615177151

CPU分1核、2核、4核  
内存分2G、4G、6G  

容器监控

https://imgkr2.cn-bj.ufileos.com/75a69cce-a06a-4732-941d-0264ed7ed887.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=8i%252BNHS8Y1kX8XUGQLVhxcRyBgi8%253D&Expires=1615177207

镜像管理

https://imgkr2.cn-bj.ufileos.com/6fe7d265-4365-4cda-8899-6ceb3c4ae03c.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=AE9I87%252FYI31B1Zhx86rAwfIfv2g%253D&Expires=1615177251

镜像仓库Harbor

https://imgkr2.cn-bj.ufileos.com/5aa30a10-cdf5-421c-b7dc-a36d95d24350.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=6VW7VvFTvK0sUsPqh13EY45iwLk%253D&Expires=1615177343

监控实现

https://imgkr2.cn-bj.ufileos.com/751e8e46-8ea0-4106-ae9e-41dfa295b8db.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=HdbVF%252FfogUVe88CEZY%252BCPqniizo%253D&Expires=1615177410

https://imgkr2.cn-bj.ufileos.com/d905a4ee-288f-45b5-9c1e-35af1ee37734.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=QAB00D3yUylOGJSAF6%252FEjpdSlRw%253D&Expires=1615177431

云平台再从influxDB中读取监控数据  

https://imgkr2.cn-bj.ufileos.com/d31ebad0-7a61-4858-85ed-6cb42865ef7a.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=pvggmYu6c%252FWj3LCtwSsIMfJQQP8%253D&Expires=1615177545

日志采集

https://imgkr2.cn-bj.ufileos.com/9b342e8e-6fa1-4eff-aee6-39aa5e6056a7.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=Mk48mYDWlLy4Ny%252BlOuET%252Bu%252FsLWk%253D&Expires=1615177735

https://imgkr2.cn-bj.ufileos.com/2f2c8224-13c0-4f89-949c-9c310bcfa192.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=IpGcn31KXSk2n62HH65BB8pQDWc%253D&Expires=1615177690

正确方式

https://imgkr2.cn-bj.ufileos.com/b126ec79-8e80-4146-b90d-6a9f4c4adf10.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=Kp%252B3UECOogKLDcLjKdIuHO%252FGFns%253D&Expires=1615177768

https://imgkr2.cn-bj.ufileos.com/0c4c29d3-c32b-417e-a0c7-84627b2369c6.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=GhZjxK2lJZ0f6CDa7aW4R2LubIc%253D&Expires=1615177784

日志收集具体实现

项目背景

https://imgkr2.cn-bj.ufileos.com/4e6738d3-48c6-4cee-9243-544da65a5dea.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=MdQP%252B3Y0cJD8H5eeCKHt6FITRmg%253D&Expires=1615177818

log-pilot

https://imgkr2.cn-bj.ufileos.com/cffd7d8f-bb4f-4144-87e0-ca3309b30069.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=vFGr8f5y4YljAJTYjI2lb13IM8M%253D&Expires=1615178079

K8S容器日志目录配置

https://imgkr2.cn-bj.ufileos.com/cb8233b5-a72c-4a89-8bdf-d09b89f60816.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=5JCEBzdX2dK28nUf7o8mr1FiqFo%253D&Expires=1615178141

容器日志采集过程

https://imgkr2.cn-bj.ufileos.com/8a6ee28c-3e82-467a-8aa9-ae6367e9bcd9.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=3si5mTvMFERsNgpUtJLffWcjJL8%253D&Expires=1615178295

服务注册发现

https://imgkr2.cn-bj.ufileos.com/e9817c51-b2ac-4132-a054-64d122b6f694.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=6nnriLo7z0LvZnI0U1H7YvHf%252BCo%253D&Expires=1615178336

云平台登陆

https://imgkr2.cn-bj.ufileos.com/87d9c9a6-3f55-4fe2-baee-cc1a012431bc.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=QcjloVoyUfvkDw%252FJfruaIKxpdoU%253D&Expires=1615178388

https://imgkr2.cn-bj.ufileos.com/fb777777-6585-47fb-9907-543846514985.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=KqZN2cbA9jMZd%252BpnNo24vOtho2A%253D&Expires=1615178406

网络方案

https://imgkr2.cn-bj.ufileos.com/a774c705-df4b-4c5b-9f0c-4a32b3759d27.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=IWTO025fEJBjuev3ivDwUFAk8r8%253D&Expires=1615178423

https://imgkr2.cn-bj.ufileos.com/bd217db1-a573-4164-8177-3757b83c14af.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=q9D0m7hrRALlmEwGaGY7YYZvnMQ%253D&Expires=1615178437

Overlay是广义SDN  
Flannel是Overlay的一种  

结论

https://imgkr2.cn-bj.ufileos.com/1b70416a-b4fa-484e-8a22-ad179f97ddfb.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=8hrBWA8WuhCJDqnesrzYJZjsYi8%253D&Expires=1615178481

Bridge如何通信

https://imgkr2.cn-bj.ufileos.com/04ca3eec-2e52-444d-affb-ef0dc6da553b.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=UY%252B%252FmrstSZyCvLdUNmcEiCKaESI%253D&Expires=1615178517

VLAN ID是有限的 最大个数是 2^12   
对于云网络是不够的  

同机房

https://imgkr2.cn-bj.ufileos.com/d883bdab-ce2f-4140-88bd-32f68439dfcd.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=g86nkWzZmFPtFoXVY8O4oJNvru8%253D&Expires=1615178642

多机房

https://imgkr2.cn-bj.ufileos.com/aa381ee1-7f86-45b1-be05-35c96c06df69.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=MU4fu1CkanStMG1QS%252BPBLcmeoSA%253D&Expires=1615178666

https://imgkr2.cn-bj.ufileos.com/4d061acd-5bb9-4f56-93f2-c15b5773c500.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=ZJJs%252F810mBadQ9A%252BbQb%252B0ElNwsk%253D&Expires=1615178699

1、通过Bridge模式不管原生的二层网络还会三层网络对对Bridge本身都没有影响  
2、请求bridge->本地网卡->另外网卡->Bridge  
3、无论跨不跨机房都是一样的  

有状态服务

https://imgkr2.cn-bj.ufileos.com/7f1b6b33-dab5-467d-8897-973b9e2c9989.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=RgcRUennP7yetqDgxjjTJRSsZBg%253D&Expires=1615178873

ceph是开源c++对象存储 比较复杂  

https://imgkr2.cn-bj.ufileos.com/7919fbf4-04c5-4a01-9f74-84bd8511d741.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=%252FkWhvzky9GnkI1DK8c98xqIsSRk%253D&Expires=1615178854

弹性伸缩技术

https://imgkr2.cn-bj.ufileos.com/9fce845b-bb62-46b3-b5fe-ae585b1a43e6.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=hERTkwfwj4%252FjL6m%252FcVmG22OyoZo%253D&Expires=1615178931

通用维度

https://imgkr2.cn-bj.ufileos.com/aeef5006-cf05-47b7-84a1-a6c239f96c65.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=trYuzcJddkAVkCUjVF8RFgnv7Wk%253D&Expires=1615178978

量化维度

https://imgkr2.cn-bj.ufileos.com/6c0b0edf-59fb-4fba-80db-217106f95924.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=TD5zws9r9GnwBKMvdJv%252F9tY4fHA%253D&Expires=1615178989

需要先确定服务分级  

合理维度

https://imgkr2.cn-bj.ufileos.com/c440dd4f-3199-4aed-a0f9-b48e555712bb.png?UCloudPublicKey=TOKEN_8d8b72be-579a-4e83-bfd0-5f6ce1546f13&Signature=nxw5ZUIHcw5RMIrE1GcWpTAsyYo%253D&Expires=1615179013

日志保存时间

日志文件1小时切割一次、保存7天