After Update from 5.6 to 5.7 DeDup Disk not active..

Public beta (bugs, reports, suggestions, features and requests)

Moderators: anton (staff), art (staff), Max (staff), Anatoly (staff)

Mezzenine
Posts: 2
Joined: Sat Jul 23, 2011 9:08 pm

Sat Jul 23, 2011 9:26 pm

Hi,

today I update form version 5.6 free to version 5.7 free and I had in 5.6 two DeDup Disk created. After the update was finished one DeDup Disk was fine and the other was shown as not active. So I forced removed the target and tried to create a new one with an existing disk. While trying this I get the following error: "Device test failed for DDDisk4".
Now, what can I do to get the data located on this disk back. On this disk all my VM-Templates are stored :cry:.

Thx for Help
Mezzenine
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Mon Jul 25, 2011 10:02 am

It seems like you need to perform next actions:
1.Remove your target (do not delete *.spbitmap , *.spdata and *.spmetadata that were dedicated to this target);
2.Run cmd as Adminiastrator
3.Type [path to StarWind installation folder]\StarPackConverter.exe [path to file dedicated to target without extension] [path to file dedicated to target without extension] [path to file dedicated to target without extension]. For example: If I had my files with the name Disk1 in root of E:\ drive and StarWind is installed in C:\Program Files\StarWind Software\StarWind, it`ll look like this:

Code: Select all

C:\Program Files\StarWind Software\StarWind\StarPackConverter.exe E:\Disk1 E:\Disk1 E:\Disk1

4.Create target using new converted files.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
User avatar
anton (staff)
Site Admin
Posts: 4008
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Mon Jul 25, 2011 9:52 pm

As deduplication thing is still experimental with V5.6 I'm moving this topic to "Beta" section of the forum. FYI.
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
Mezzenine
Posts: 2
Joined: Sat Jul 23, 2011 9:08 pm

Tue Jul 26, 2011 7:49 am

Hi guys,

I already solved my problem, the solution later in this post.

First of all, thank you to Anatoly for his advice. But it didn't work. After, I did this what you wrote in your post I got the message: "The disk has already version 4, nothing to convert".

The solution for this was, I created two new deDup disk, took an Hex Editor an compared all three files for the new disks, so I got all values that has to be the same in each file type. Then I compared my existing disk with one of the new created disk and I saw that the file header of the existing disk was totally different form that I created new. Now I take the Hex-Editor and modified all Values which was different from the file was created new and here we go, it works.


It is my opinion, there is a buck in the conversion tool.

Mezzenine
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Tue Jul 26, 2011 8:31 am

Nice workaround, thanks!

I`ll pass this to our developers!


Thanks again!
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
User avatar
anton (staff)
Site Admin
Posts: 4008
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Tue Jul 26, 2011 10:08 am

Outstanding!!! You've really impressed me.
Mezzenine wrote:Hi guys,

I already solved my problem, the solution later in this post.

First of all, thank you to Anatoly for his advice. But it didn't work. After, I did this what you wrote in your post I got the message: "The disk has already version 4, nothing to convert".

The solution for this was, I created two new deDup disk, took an Hex Editor an compared all three files for the new disks, so I got all values that has to be the same in each file type. Then I compared my existing disk with one of the new created disk and I saw that the file header of the existing disk was totally different form that I created new. Now I take the Hex-Editor and modified all Values which was different from the file was created new and here we go, it works.


It is my opinion, there is a buck in the conversion tool.

Mezzenine
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
ajuergens
Posts: 8
Joined: Mon Aug 15, 2011 10:56 pm

Mon Aug 15, 2011 11:29 pm

The StarPackConverter suggestion failed for me as well. I do not have any previous dedupe disks since I'm new to Starwind Dedupe, so I can't do a compare with Hex Editor.

I've tried a number of config variations, but always seem get these errors logged:

Create SP object:
.data file path ( Y:\DDTEST\ddtest49 ),
.metadata file path ( Y:\DDTEST\ddtest49 ),
compressed ( no ), .bitmap type ( flat ), .metadata entry Type ( basic ), BlockSize ( 4096 ), SizeInBlocks ( 536870912 ), SHAType ( 2 SHA256), Threads ( 1 ), Packets ( 1 ), .metadata Cache ( 0 MB ), .data Cache ( 0 MB ).
8/15 14:56:33.208 4d0 DDDisk: *** CreateDDStorageThreadProc: Destroying SP object ...
8/15 14:56:33.208 4d0 DDDisk: *** CreateDDStorageThreadProc: SP object destroyed!
8/15 14:56:44.813 1c8 S: SymId: 'DDDisk1': Assigned target name: 'iqn.2008-08.com.starwindsoftware:127.0.0.1-ddtest49', alias 'ddtest49'
8/15 14:56:44.844 1c8 CACHE: *** SWCache_Create: Cache parameters: Mode = 1, Flags = 22, Size = 10 MB, SectorSize = 4096, BlockExpiryPeriod = 5000, DiskSizeInSectors = 1
8/15 14:56:44.844 1c8 CACHE: *** SWCache_FlushAllData: Cache flushing is in progress... About 0 blocks are to be processed.
8/15 14:56:44.844 1c8 CACHE: *** SWCache_FlushAllData: Cache flushing is finished.
8/15 14:56:44.844 1c8 DDDisk: *** DDDisk_Create: SP object create failed, ( error 87 ).
8/15 14:56:44.844 1c8 DDDisk: *** BuffersPoolFree: Invalid parameters passed!
8/15 14:56:44.844 1c8 DDDisk: *** SscPort_Create: Failed to create DD disk device 'DDDisk1', path 'Y:\DDTEST\ddtest49', error (0xc0000001)!
8/15 14:56:44.844 1c8 SCSI: Failed to create 'DDDisk1' device.
8/15 14:56:44.844 1c8 Srv: * Device test failed for 'DDDisk1'.
8/15 14:56:44.844 1c8 conf: Device test failed for 'DDDisk1'.

Any help or known prereqs for dedupe is greatly appreciated...I feel like I'm missing something very simple but can't seem to find any support on this since it's beta.

Thank you.
User avatar
Alex (staff)
Staff
Posts: 177
Joined: Sat Jun 26, 2004 8:49 am

Tue Aug 16, 2011 10:20 am

ajuergens,
Please switch log level to 3 and send us the log of adding new device.
To switch log level go to %Program Files%StarWind Software/StarWind and edit file StarWind.cfg with Nodepad. There is an option LogLevel=1. You should change 1 to 3 and restart the service.
Best regards,
Alexey.
ajuergens
Posts: 8
Joined: Mon Aug 15, 2011 10:56 pm

Tue Aug 16, 2011 3:46 pm

Thank you for you reply. I attached the portion of the log file that appears to include the whole dedupe target portion. Thank you again.
ajuergens
Posts: 8
Joined: Mon Aug 15, 2011 10:56 pm

Tue Aug 16, 2011 3:58 pm

Sorry...the site is not allowing any variation of a .txt file...is there a specific file type I need to use to upload?

Otherwise, my log exceeds the 60000 character limit.

Thanks.
User avatar
Alex (staff)
Staff
Posts: 177
Joined: Sat Jun 26, 2004 8:49 am

Tue Aug 16, 2011 4:06 pm

Please compress the log with ZIP or whatever and send it by e-mail to support@starwindsoftware.com
Best regards,
Alexey.
ajuergens
Posts: 8
Joined: Mon Aug 15, 2011 10:56 pm

Tue Aug 16, 2011 4:37 pm

Thank you...I sent the log to support.
User avatar
anton (staff)
Site Admin
Posts: 4008
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Tue Aug 16, 2011 9:35 pm

Thank you very much for cooperation. We'll try to solve everything ASAP.
ajuergens wrote:Thank you...I sent the log to support.
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
ajuergens
Posts: 8
Joined: Mon Aug 15, 2011 10:56 pm

Mon Aug 22, 2011 8:01 pm

I was wondering if you were able to get any insight on the errors I'm receiving (leads, thoughts, etc.)?

Thank you.
User avatar
anton (staff)
Site Admin
Posts: 4008
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Mon Aug 22, 2011 8:09 pm

We've completely re-worked deduplication engine from the scratch as V1 had some design flaws. So I guess your issues are gone now. Wait for V5.8 beta as it's going to include updated snapshot / recovery point capable dedupe.
ajuergens wrote:I was wondering if you were able to get any insight on the errors I'm receiving (leads, thoughts, etc.)?

Thank you.
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
Post Reply