Page 2 of 2

Re: Dedupe .spspx keeps growing

Posted: Fri Mar 14, 2014 9:36 pm
by jcrowe
I am now at 500GB used, while only 250 GB of the datastore shows used. I will be switching to thick disk until this gets sorted out, as I do not like the idea of having to create new deduped drives and migrating ~250GBs of data every few weeks.

Re: Dedupe .spspx keeps growing

Posted: Thu Mar 20, 2014 11:03 am
by Anatoly (staff)
Just a heads up for community: currently we are investigation the issue and fixing it.
We`ll keep you guys posted.

Re: Dedupe .spspx keeps growing

Posted: Thu May 08, 2014 9:01 pm
by jcrowe
Has this been resolved with the new RC? I have been running with thick provisioning while waiting for this to be resolved. I would love to put LSFS under load with a couple database servers, without worrying that I will have to migrate it to a new drive every few weeks or so.

Re: Dedupe .spspx keeps growing

Posted: Thu May 08, 2014 9:27 pm
by anton (staff)
Yes, RC2 has a fully functional garbage collector + TRIM and WRITE_SAME support. Please give it a try in Test & Development config to see would it work for you or not. Feedback is welcomed. Thank you!
jcrowe wrote:Has this been resolved with the new RC? I have been running with thick provisioning while waiting for this to be resolved. I would love to put LSFS under load with a couple database servers, without worrying that I will have to migrate it to a new drive every few weeks or so.

Re: Dedupe .spspx keeps growing

Posted: Sat May 10, 2014 3:07 pm
by jcrowe
anton (staff) wrote:Yes, RC2 has a fully functional garbage collector + TRIM and WRITE_SAME support. Please give it a try in Test & Development config to see would it work for you or not. Feedback is welcomed. Thank you!
jcrowe wrote:Has this been resolved with the new RC? I have been running with thick provisioning while waiting for this to be resolved. I would love to put LSFS under load with a couple database servers, without worrying that I will have to migrate it to a new drive every few weeks or so.
Here is my test setup and results:
I set up a HA lsfs 300GB drive, and moved 3 fairly high IO VM's on to it. After the VM's were moved to the drives, it showed 50GB used in VMWare, and 7 .spspx files were created (for a total of around 21GB's actually used). The Starwinds console showed that I was averaging about 50 iops per HA member. At this rate, it created a new .spspx file about every hour, and did not clean up any old ones. It is now up to 19 files created, which puts actual space used higher than space used if it was a thick drive.

Is garbage collection a scheduled task, and if so, can the frequency be changed? This is also probably not a very good gauge of a real world scenario, as I have only a few high IO VM's on one drive. Will this smooth out if other lower IO VM's are also hosted on this drive?

Re: Dedupe .spspx keeps growing

Posted: Sun May 11, 2014 5:46 pm
by jcrowe
As an update to this, I moved the first VM that I moved to the lsfs drive back off the drive. The first VM was responsible for the first 3 or so .spspx files, so once it was removed from the drive, I would have assumed that those files would be released. It's now been 24 hours and not only are those files not removed, but new files keep being added.

Re: Dedupe .spspx keeps growing

Posted: Thu May 15, 2014 1:05 pm
by Bohdan (staff)
Developers are working on this. I'll let you know as soon as the improvements are available.