<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>
<div>
<div>Just a note on GlusterFS from our end: our IT had a test GlusterFS set up that had zfs enabled for compression, and we ran into all sorts of problems with I/O on large files. </div>
<div><br>
</div>
<div>We’re planning on performing more tests using a few common workflows on Gluster (w/o ifs) vs GPFS (our current FS, very nice but quite $$$), and possibly a few others.</div>
<div><br>
</div>
<div>chris</div>
<div><br>
</div>
<div>
<div id="MAC_OUTLOOK_SIGNATURE"></div>
</div>
</div>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:12pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>bio-packaging on behalf of Francesco Strozzi<br>
<span style="font-weight:bold">Date: </span>Wednesday, February 10, 2016 at 10:20 AM<br>
<span style="font-weight:bold">To: </span>Pjotr Prins<br>
<span style="font-weight:bold">Cc: </span>"<a href="mailto:bio-packaging@mailman.open-bio.org">bio-packaging@mailman.open-bio.org</a>"<br>
<span style="font-weight:bold">Subject: </span>Re: [Bio-packaging] Distributed file system and experimental cluster<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">Hi Pjotr,
<div>I've used GlusterFS in the past and I think it's reasonably simple to install and configure for testing purposes. We had nice experiences with GlusterFS in mirroring mode on production systems. We tested also the striping mode although in that case we
saw some bad behaviour from the server which resulted in files becoming not accessible after some time. But that was ~2 years ago so hopefully those bugs should be solved now.</div>
<div><br>
</div>
<div>Cheers</div>
<div>Francesco <br>
<div class="GmSign">
<div dir="ltr">
<div><br>
</div>
</div>
</div>
</div>
<div class="gmail_quote">
<div dir="ltr">On Wed, 10 Feb 2016 at 13:37 Pjotr Prins <<a href="mailto:pjotr.public66@thebird.nl">pjotr.public66@thebird.nl</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
On Wed, Feb 10, 2016 at 10:47:38AM +0100, Ricardo Wurmus wrote:<br>
><br>
> Pjotr Prins <<a href="mailto:pjotr.public66@thebird.nl" target="_blank">pjotr.public66@thebird.nl</a>> writes:<br>
><br>
> > Anyone experience with distributed file systems, such as moosefs,<br>
> > glusterfs etc.? I want to try something reasonably easy to install and<br>
> > manage and has striping or chunking.<br>
><br>
> What do you want to achieve with a distributed file system that could<br>
> not be achieved with centralised storage? In the configurations that I<br>
> worked with distributed file systems are only used for volatile scratch<br>
> space. Everything else (e.g. user software, home directories) uses<br>
> either centralised storage or is node-local (e.g. the centrally managed<br>
> system state).<br>
><br>
> That said, I only ever worked on distributed file systems as a user. I<br>
> was never in charge of setting up a distributed file system.<br>
<br>
With large data and many nodes the central storage quickly is the IO<br>
bottleneck on a cluster. At least in more conventional designs.<br>
<br>
Pj.<br>
<br>
--<br>
_______________________________________________<br>
bio-packaging mailing list<br>
<a href="mailto:bio-packaging@lists.open-bio.org" target="_blank">bio-packaging@lists.open-bio.org</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.open-2Dbio.org_mailman_listinfo_bio-2Dpackaging&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=fbHa8Njtvh9VmSnzJxiEUTW9NWDwMMwQAzhgZDO41GQ&m=GYxtZKjTsiOfMz4GCWtSC5nB6dbjD36HmxS2qbtfu1M&s=Bxb5uH2sMtxSdYBNvSiBNtXuoC9WbDmaPkLQJg7UF6A&e=" rel="noreferrer" target="_blank">http://lists.open-bio.org/mailman/listinfo/bio-packaging</a><br>
</blockquote>
</div>
</div>
</div>
</div>
</span>
</body>
</html>