CodeForge QQ客服 CodeForge 400电话 客服电话 4006316121
首页 » 源代码 » 集群计算机环境中的负载均衡数据分布

集群计算机环境中的负载均衡数据分布

bob1
发布于2016-05-18 08:30:52
源码作者
浏览次数:
下载次数:0
下载所需积分:1 
源码分类 Tags:
负载均衡nginx
源码分类 所属分类:
AllAll

分享有礼! 》

  • 请点击右侧的分享按钮,把本代码分享到各社交媒体。
  • 通过您的分享链接访问Codeforge,每来2个新的IP,您将获得0.1 积分的奖励。
  • 通过您的分享链接,每成功注册一个用户,该用户在Codeforge上所获得的每1个积分,您都将获得0.2 积分的分成奖励。

代码介绍

CacheManager is a simple but effective solution for data distribution in cluster computer environments without a sophisticated storage system. It is a non-intrusive solution consisting of Python tools.

A problem often occuring in distributed computing system, lacking sophisticated (and expensive) storage systems or distributed file systems, is the frequent overloading of file servers due to massively parallel file access. The overcharge of file servers is usually avoided by keeping copies of the files on local hard disks of the compute nodes.

CacheManager simplifies the caching and reduces the load of the file servers. It uses a central server instance which manages all caching activities of all compute jobs, such that the number of parallel IO-activities is limited to a reasonable amount. It requires neither modifications of the operating system nor software changes of the jobs running in the cluster.

The usage is really simple - you call the tool with a filename as argument and retrieve the path of the local copy. Anything else is handled by the caching tool: * copying the file to the local disk * limiting the parallel access to the file server(s) * keeping track of existing local copies on other nodes * controlling the usage of the local disks

CacheManager has been developed by the Human Language Technology and Pattern Recognition Group at RWTH Aachen University, Germany. It has been used successfully for several years in a cluster computer system with more than 1000 parallel running jobs.

A detailed description can be found in the Wiki.

Sponsored links

源码文件列表

温馨提示: 点击源码文件名可预览文件内容哦 ^_^
名称 大小 修改日期
程序员商城

资源评论

(提交有效评论获得积分)
评论内容不能少于15个字,不要超出160个字。
  • 1
  • 第1页
  • 共1页

集群计算机环境中的负载均衡数据分布 (41.21 kB)

需要 1 积分
您持有 积分

CodeForge积分(原CF币)全新升级,功能更强大,使用更便捷,不仅可以用来下载海量源代码马上还可兑换精美小礼品了 了解更多

您的积分不足,优惠套餐快速获取 30 积分

订单支付完成后,积分将自动加入到您的账号。以下是优惠期的人民币价格,优惠期过后将恢复美元价格。

更多付款方式:网银PayPal

上传代码,免费获取CodeForge积分

您本次下载所消耗的积分将转交上传作者。

同一源码,30天内重复下载,只扣除一次积分。

登录 CodeForge

还没有CodeForge账号? 立即注册
关注微博
联系客服

Switch to the English version?

Yes
CodeForge 英文版
No
CodeForge 中文版

完善个人资料,获价值¥30元积分奖励!

^_^"呃 ...

Sorry!这位大神很神秘,未开通博客呢,请浏览一下其他的吧
好的