[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: Optimizing large copies
From: |
Baker, Darryl |
Subject: |
RE: Optimizing large copies |
Date: |
Thu, 22 Sep 2005 14:49:11 -0400 |
Isn't this a job for rsync rather than cfengine? Right tool for the right
job.
-----Original Message-----
From: help-cfengine-bounces+darryl.baker=gedas.com@gnu.org
[mailto:help-cfengine-bounces+darryl.baker=gedas.com@gnu.org]On Behalf
Of Martin, Jason H
Sent: Thursday, September 22, 2005 2:08 PM
To: help-cfengine@gnu.org
Subject: Optimizing large copies
Hello, I am looking at using CFEngine to guarantee that all of my
application files are the same across a set of hosts. This involves a
few copy statements of directories that totaled together include about
8000 files for nearly 400MB (lots of small images, html's, xml's, and
such). Disregarding the initial copy, it is taking 12 minutes for the
copy statements to run, even if there are no files needing update. I've
tried it with type=checksum and the default type action, and it makes
little difference. (checkum = 12 minutes, mtime = 13 minutes). I'd
really prefer to use checksum anyway, as I'd like CFE to detect if a
change is made on the client (ex user updates CFE central repository,
does sync, updates client, does sync, file should now be back to CFE
version). As a counter-example,an rsyc of the same data takes 7 seconds.
An example 'slow' copy statement:
XYZserver::
/var/cfengine/sourcedir
dest=/$(dest_root)/.cfagent/repository/XYZserver
owner=$(theowner)
group=$(thegroup)
r=inf
purge=true
action=fix
server=$(policyhost)
type=checksum
mode=750
Can anyone suggest how to best address this? I'm tempted to put
time-class into the copy statement to only do the copy/check once a day
or on demand, however that just limits the problem to certain hours. If
anyone has any suggestions on how to improve the performance of this I
would appreciate hearing them.
Has anyone run CFE w/profiling to see where it is spending its time?
(Client is Solaris 9 / CFE 2.1.14, policyhost is Linux / CFE 2.1.15).
Thank you,
-Jason Martin
_______________________________________________
Help-cfengine mailing list
Help-cfengine@gnu.org
http://lists.gnu.org/mailman/listinfo/help-cfengine
- Optimizing large copies, Martin, Jason H, 2005/09/22
- RE: Optimizing large copies,
Baker, Darryl <=
- RE: Optimizing large copies, Martin, Jason H, 2005/09/22
- RE: Optimizing large copies, Baker, Darryl, 2005/09/23
- RE: Optimizing large copies, Martin, Jason H, 2005/09/23
- RE: Optimizing large copies, Martin, Jason H, 2005/09/23
- RE: Optimizing large copies, Martin, Jason H, 2005/09/26
- RE: Optimizing large copies, Martin, Jason H, 2005/09/26