LSFS and growth on disk

Software-based VM-centric and flash-friendly VM storage + free version

Moderators: anton (staff), art (staff), Max (staff), Anatoly (staff)

Tim
Posts: 93
Joined: Mon Jul 18, 2005 7:27 pm

Tue Jul 01, 2014 3:24 pm

I have read about how LSFS works and think I understood most of it.

I know that nothing ever gets deleted, the writes go to the head of the 'log'.
This will cause space used on disk to grow, eventually even past the set virtual disk size.

So what I would like to know is how to perform maintenance so the the LSFS files on disk only contain active data?
This will effectively reduce the LSFS files on disk to smallest size that contains all the required data.

Thanks
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Wed Jul 02, 2014 8:20 am

If you want to keep only active data you need to use *.img files instead of LSFS.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
Tim
Posts: 93
Joined: Mon Jul 18, 2005 7:27 pm

Wed Jul 02, 2014 9:06 am

Ok let me reword that question.

How do I stop LSFS files on disk from growing out of control?
If nothing is ever deleted then a 100GB virtual disk could, with enough activity, turn into 1TB on disk?
Please correct me if I'm wrong.

Tim
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Mon Jul 07, 2014 1:26 pm

Right now the unused blocks reprovisioning is initiating by drop of the workload on hte SAN. In one of the nearest builds we will add ability to manually trigger that process.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
robnicholson
Posts: 359
Joined: Thu Apr 14, 2011 3:12 pm

Mon Aug 04, 2014 3:55 pm

Right now the unused blocks reprovisioning is initiating by drop of the workload on hte SAN
How does one monitor that auto-defragmentation is actually ever running? I guess that load on our SANs will drop overnight but that's just a guess. Maybe a PowerShell script to query the LSFS to show the level of fragmentation? Something simple like:

Get-StarWindLSFSStatistics -Target <name> FL

UsedBlocks: 5,434,341
OverwrittenBlocks: 1,300,321
BlockSize: 512
DefragmentationRunning: no

I notice that StarWind is splitting the LSFS volume into 5GB blocks.

Cheers, Rob.
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Sat Aug 09, 2014 11:58 am

How does one monitor that auto-defragmentation is actually ever running?
Good question!
We need to add this thing into GUI. Right now you can just check the total size of the virtual disk files.
Also, we will add the possibility to run Defrag manually.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
robnicholson
Posts: 359
Joined: Thu Apr 14, 2011 3:12 pm

Mon Aug 11, 2014 4:49 pm

Additional question - when you use the "Create clustered storage wizard", are the LSFS devices created with auto-defragmentation turned on or off?

One doesn't know because a) it doesn't ask you during the wizard - just asks if you want it deduplicated or not and b) there doesn't appear to be any way to know whether auto-defragmentation is on or off in the GUI.

I've no problem with a wizard assuming some common options (after all that's what wizards often do compared to the manual approach) but one does need to know either way. I would suggest "auto defragmentation" should be on.

Cheers, Rob.
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Thu Aug 14, 2014 1:48 pm

It`s actually turned on by default.
I think we`ll just take away ability to choose from users since AutoDefrag is the thing that need to be turned on always.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
robnicholson
Posts: 359
Joined: Thu Apr 14, 2011 3:12 pm

Thu Aug 14, 2014 7:31 pm

I think we`ll just take away ability to choose from users since AutoDefrag is the thing that need to be turned on always.
I agree - you'd have to be slightly mad to not have it turned on ;-)

Cheers, Rob.
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Thu Aug 14, 2014 8:03 pm

That's a Company issue. We should not be exporting leverages allowing such a critical influence on the system. We'll fix that in the upcoming builds. Thanks!
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
Francesco
Posts: 25
Joined: Sun Jul 13, 2014 12:31 pm

Tue Aug 19, 2014 2:13 pm

So much for thin provisioning.
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Wed Aug 20, 2014 7:29 am

For deduplication and snapshots to be more precise.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
Francesco
Posts: 25
Joined: Sun Jul 13, 2014 12:31 pm

Wed Aug 20, 2014 12:49 pm

When do you think you'll have a fix for this uncontrolled growth?
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Thu Aug 21, 2014 11:05 am

I hope we`ll see it next week.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
Francesco
Posts: 25
Joined: Sun Jul 13, 2014 12:31 pm

Thu Aug 21, 2014 1:35 pm

Great, the sooner the better!

After the upgrade, will StarWind automatically shrink the disk files or will we have to recreate them and move the data?
Post Reply