分布式服务平台架构设计与实现
|
摘要
随着业务的发展和集成度的进一步提高,用户数量和应用服务数量在大规模集成应用环境中具有显著的动态性和很强的增长趋势,这对系统提出了更高的伸缩性和可控性要求。“同时提供多种应用服务并及时响应大量请求”是单机所无法胜任的。为解决单机的性能瓶颈问题,系统需要一种兼具通用性和灵活性的分布式架构。
本文在分析和研究面向对象的中间件技术和面向服务体系结构的过程中发现了他们共性的基础结构:软总线。在此基础上,本文展开如下研究与设计:
①通过分析基于数据库、基于组件和基于Agent等三种较为流行的总线方案,并比较了并发体系下基于任务和基于消息的两种总线模式,确定了采用基于消息的软总线模式,提出了一种基于消息总线的分布式架构模型,设计并实现了一个分布式服务平台。
②针对大规模应用环境,在应用服务规则分布的情况下,提出基于分布式服务平台的服务路由模式。该模式采用多消息总线分担服务的方式来满足应用服务规则分布情况下,系统的持续扩充需求:在设计服务路由表的基础上,给出了消息总线的多种组合方案;引入服务掩码思想,进一步优化了服务路由表,提高了效率。
③借鉴P2P搜索技术,提出基于DHT(Chord)的应用服务定位策略,解决了大规模分布式网络中服务不规则分布下的查找问题。本文通过分析不同P2P网络结构的特性,确定选择完全分布式结构化拓扑组织多个消息总线;然后分析了适合完全分布式结构化P2P网络下的搜索算法:Chord;最后,针对大规模网络环境下应用服务不规则分布的情况,提出虚节点的概念,通过Chord算法进行应用服务定位。
④在Linux系统下,测试了平台的性能,并通过电信运营系统的应用,验证了分布式服务平台设计的有效性。
论文的研究成果对于有实时性要求的大规模分布式系统的构建具有借鉴意义。
With the development of business and further enhancement of integration, the number of users and application services shows a remarkable dynamic characteristic and increasing trend in the large scale integration application environment, which requires the system to have better retractility and controllability. The stand-alone solutions are not adequate for providing simultaneous multiple application services or timely response to high demands. An efficient solution to bottle-neck of the stand-alone is to construct a distributed system framework which is universal and flexible.
Based on the research of object-oriented middleware technology and service-oriented architecture, a common architecture, which is shared by the major service systems, is identified: the software bus. Research and development is conducted in the following areas:
1. Comparison of task-based bus pattern with message-based bus pattern and analysis of three popular bus modes: database-based bus mode, component-based bus mode, and agent-based bus mode. We decide to use message-based bus pattern, and then introduce a message-based distributed architecture. A distributed service platform has been designed and implemented as well.
2. Alluding to the large-scale application environment, the dissertation introduces a distributed service platform based service routing mode when the application services are regularly distributed.
3. Using P2P as a reference, the dissertation brings forward a localization strategy of application service based on DHT to provide a solution to the lookup problem of large scale distributed network when services are irregularly distributed.
4. System performance has been tested under LINUX environment. The design principles of distributed service platform are proven to be effective via application of telecom business supporting system.
Achievements of the dissertation can be used as reference in constructing large-scale real-time distributed systems.
本文在分析和研究面向对象的中间件技术和面向服务体系结构的过程中发现了他们共性的基础结构:软总线。在此基础上,本文展开如下研究与设计:
①通过分析基于数据库、基于组件和基于Agent等三种较为流行的总线方案,并比较了并发体系下基于任务和基于消息的两种总线模式,确定了采用基于消息的软总线模式,提出了一种基于消息总线的分布式架构模型,设计并实现了一个分布式服务平台。
②针对大规模应用环境,在应用服务规则分布的情况下,提出基于分布式服务平台的服务路由模式。该模式采用多消息总线分担服务的方式来满足应用服务规则分布情况下,系统的持续扩充需求:在设计服务路由表的基础上,给出了消息总线的多种组合方案;引入服务掩码思想,进一步优化了服务路由表,提高了效率。
③借鉴P2P搜索技术,提出基于DHT(Chord)的应用服务定位策略,解决了大规模分布式网络中服务不规则分布下的查找问题。本文通过分析不同P2P网络结构的特性,确定选择完全分布式结构化拓扑组织多个消息总线;然后分析了适合完全分布式结构化P2P网络下的搜索算法:Chord;最后,针对大规模网络环境下应用服务不规则分布的情况,提出虚节点的概念,通过Chord算法进行应用服务定位。
④在Linux系统下,测试了平台的性能,并通过电信运营系统的应用,验证了分布式服务平台设计的有效性。
论文的研究成果对于有实时性要求的大规模分布式系统的构建具有借鉴意义。
With the development of business and further enhancement of integration, the number of users and application services shows a remarkable dynamic characteristic and increasing trend in the large scale integration application environment, which requires the system to have better retractility and controllability. The stand-alone solutions are not adequate for providing simultaneous multiple application services or timely response to high demands. An efficient solution to bottle-neck of the stand-alone is to construct a distributed system framework which is universal and flexible.
Based on the research of object-oriented middleware technology and service-oriented architecture, a common architecture, which is shared by the major service systems, is identified: the software bus. Research and development is conducted in the following areas:
1. Comparison of task-based bus pattern with message-based bus pattern and analysis of three popular bus modes: database-based bus mode, component-based bus mode, and agent-based bus mode. We decide to use message-based bus pattern, and then introduce a message-based distributed architecture. A distributed service platform has been designed and implemented as well.
2. Alluding to the large-scale application environment, the dissertation introduces a distributed service platform based service routing mode when the application services are regularly distributed.
3. Using P2P as a reference, the dissertation brings forward a localization strategy of application service based on DHT to provide a solution to the lookup problem of large scale distributed network when services are irregularly distributed.
4. System performance has been tested under LINUX environment. The design principles of distributed service platform are proven to be effective via application of telecom business supporting system.
Achievements of the dissertation can be used as reference in constructing large-scale real-time distributed systems.
引文
[1]Qusay H.Mahmoud,Channasubbanna Prasad.CORBA Communication,2001.http://java.sun.com/developer/technicalArticles/Servlets/corba/
[2]Sun Professional Services for Service Oriented Architecture(SOA).http://www.sun.com/service/pssoa/
[3]Service-Oriented Architecture Services Framework.http://www.sun.com/service/soa/
[4]Service-Oriented Architecture(SOA).http://www.sun.com/products/soa/index.jsp
[5]Sun.CORBA Technology and the Java Platform.http://java.sun.com/j2ee/corba/
[6]Object Management Group.The Common Object Request Broker:Architecture and Specification Revision 3.0[S],2002
[7]李文军,周晓聪,李师贤.分布式对象技术.第1版.北京:机械工业出版社,2003
[8]于振梅.面向服务模式与面向对象技术.山东科学,2006,19(4):74-76
[9]Idiot.WS-Addressing从理论到实践--SOA基础规范介绍,2006.http://www.cnblogs.com/idior/archive/2006/06/28/431017.html
[10]Sun.Enterprise JavaBeans Technology.http://java.sun.com/products/ejb/
[11]J.Wu.Distributed System Design.CRC Press LLC,1999
[12]Sun Java System Message Queue.http://www.sun.com/software/products/message_queue/index.xml
[13]孙国强.用RMI开发基于Java的企业分布式应用.电力信息化,2004,2(8):71-74
[14]Sun.Java Message Service(JMS).http://java.sun.com/products/jms/
[15]潘强.基于软件总线的软构件技术的研究.甘肃:兰州理工大学硕士论文,2006
[16]王中武,刘正熙.软总线体系结构研究.中国民航飞行学院学报,2006,17(2):42-45
[17]王昌宝.基于软总线的软件开发与集成方法研究.无线电工程,2006,36(1):1-3
[18]王军,熊桂喜.基于软总线构件技术的数据传输处理系统开发.现代计算机,2007,1:24-26
[19]沈正伟,杨东勇,施冬材.基于Hermes系统的分布式JAVA消息服务系统的研究与设计.计算机系统应用,2007,6:58-61
[20]阳王东.基于CORBA消息集成总线.湖南:中南大学硕士论文,2006
[21]陈潇锋.软总线在银行自助终端中的应用.上海:华东师范大学硕士论文,2007
[22]程德蓉.基于软总线的微总线研究及在远程教学平台的应用.重庆:重庆大学硕士论文,2007
[23]杨红梅,张建强,耿伯英,乔静.一种基于Agent软总线技术的信息系统集成方法.计算机工程,2007,33(14):36-40
[24]Stephen,D.Huston,C.Schmidt,Douglas.C++ Network Programming Volume 1Mastering Complexity with ACE and Patterns.Addison-Wesley Professional,2001
[25]徐恪,熊勇强,吴建平等.对等网研究综述.国家自然科学基金重点项目,编号:90104002 60203025,2005
[26]杨天路等编著.P2P网络技术原理与系统开发案例.北京:人民邮电出版社,2007
[27]Yingfeng.P2P网络中的DHT分布式哈希结构,2006.http://blog.donews.com/yingfengzhang/archive/2006/01/21/703942.aspx
[28]Gerardo Pardo-Castellote.SOA Feature Story:Real-Time SOA Starts with the Messaging Bus!:The mediator of all component interactions,2007.http://soa.sys-con.com/read/467488.htm
[29]I.Stocia R,Morris D,Karger M Kaashoek F,Balakrishnan H.Chord:a scalable peer-to-peer lookup service for Internet applications.In Proc ACM SIGCOMM'01,San Diego,CA,Aug.2001
[30]李寅,马范援,邹福泰.基于分布式哈希表对等网络的Web服务发现.上海交通大学学报,2006,40(5):805-809
[31]于守健,朱勤,乐嘉锦.一种基于分布式哈希表的Web服务目录系统.计算机工程,2007,33(2):53-55
[32]杨峰,李凤霞,余宏亮,战守义,郑纬民.一种基于分布式哈希表的混合对等发现算法.软件学报,2007,18(3):714-721
[33]昆石网络.http://www.linknat.com/
[2]Sun Professional Services for Service Oriented Architecture(SOA).http://www.sun.com/service/pssoa/
[3]Service-Oriented Architecture Services Framework.http://www.sun.com/service/soa/
[4]Service-Oriented Architecture(SOA).http://www.sun.com/products/soa/index.jsp
[5]Sun.CORBA Technology and the Java Platform.http://java.sun.com/j2ee/corba/
[6]Object Management Group.The Common Object Request Broker:Architecture and Specification Revision 3.0[S],2002
[7]李文军,周晓聪,李师贤.分布式对象技术.第1版.北京:机械工业出版社,2003
[8]于振梅.面向服务模式与面向对象技术.山东科学,2006,19(4):74-76
[9]Idiot.WS-Addressing从理论到实践--SOA基础规范介绍,2006.http://www.cnblogs.com/idior/archive/2006/06/28/431017.html
[10]Sun.Enterprise JavaBeans Technology.http://java.sun.com/products/ejb/
[11]J.Wu.Distributed System Design.CRC Press LLC,1999
[12]Sun Java System Message Queue.http://www.sun.com/software/products/message_queue/index.xml
[13]孙国强.用RMI开发基于Java的企业分布式应用.电力信息化,2004,2(8):71-74
[14]Sun.Java Message Service(JMS).http://java.sun.com/products/jms/
[15]潘强.基于软件总线的软构件技术的研究.甘肃:兰州理工大学硕士论文,2006
[16]王中武,刘正熙.软总线体系结构研究.中国民航飞行学院学报,2006,17(2):42-45
[17]王昌宝.基于软总线的软件开发与集成方法研究.无线电工程,2006,36(1):1-3
[18]王军,熊桂喜.基于软总线构件技术的数据传输处理系统开发.现代计算机,2007,1:24-26
[19]沈正伟,杨东勇,施冬材.基于Hermes系统的分布式JAVA消息服务系统的研究与设计.计算机系统应用,2007,6:58-61
[20]阳王东.基于CORBA消息集成总线.湖南:中南大学硕士论文,2006
[21]陈潇锋.软总线在银行自助终端中的应用.上海:华东师范大学硕士论文,2007
[22]程德蓉.基于软总线的微总线研究及在远程教学平台的应用.重庆:重庆大学硕士论文,2007
[23]杨红梅,张建强,耿伯英,乔静.一种基于Agent软总线技术的信息系统集成方法.计算机工程,2007,33(14):36-40
[24]Stephen,D.Huston,C.Schmidt,Douglas.C++ Network Programming Volume 1Mastering Complexity with ACE and Patterns.Addison-Wesley Professional,2001
[25]徐恪,熊勇强,吴建平等.对等网研究综述.国家自然科学基金重点项目,编号:90104002 60203025,2005
[26]杨天路等编著.P2P网络技术原理与系统开发案例.北京:人民邮电出版社,2007
[27]Yingfeng.P2P网络中的DHT分布式哈希结构,2006.http://blog.donews.com/yingfengzhang/archive/2006/01/21/703942.aspx
[28]Gerardo Pardo-Castellote.SOA Feature Story:Real-Time SOA Starts with the Messaging Bus!:The mediator of all component interactions,2007.http://soa.sys-con.com/read/467488.htm
[29]I.Stocia R,Morris D,Karger M Kaashoek F,Balakrishnan H.Chord:a scalable peer-to-peer lookup service for Internet applications.In Proc ACM SIGCOMM'01,San Diego,CA,Aug.2001
[30]李寅,马范援,邹福泰.基于分布式哈希表对等网络的Web服务发现.上海交通大学学报,2006,40(5):805-809
[31]于守健,朱勤,乐嘉锦.一种基于分布式哈希表的Web服务目录系统.计算机工程,2007,33(2):53-55
[32]杨峰,李凤霞,余宏亮,战守义,郑纬民.一种基于分布式哈希表的混合对等发现算法.软件学报,2007,18(3):714-721
[33]昆石网络.http://www.linknat.com/
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |