Data Recovery, recovering Hard Drive data, RAID data recovery

YES we can recover your data, even if others can’t!

As a member of a worldwide consortium called the TSC or Technical Services Consortium, we are part of a family of companies that offer many of the same services, but in different geographical areas. Because we are not competing with each other, we have developed some amazing business relationships with folks that would normally be our competitors. This has allowed us to gain knowledge in areas where we were weak and to share knowledge where we are strong. As the only member of the consortium offering data recovery services, we often get called in to help with data loss situations.

Recently one of our TSC partners in the Netherlands, Sprague Europe, was approached by a well-known University in Germany. The University had had a catastrophic failure with a small RAID 5 server and the hard work of hundreds of students was in jeopardy. RAID server data recovery

Initially the University had contacted a well-respected but smaller data recovery company in the Netherlands to help. They were able to image one of the 3 drives used in the RAID 5 array, but unfortunately, all attempts at resurrecting either of the remaining two drives was met with failure.

With RAID 5 and it’s built in redundancy, we only needed to image one of the two non-responsive drives to be able to rebuild the RAID. Both drives had developed light rings on their disks and the heads were physically destroyed by travelling over the damaged areas and had become stuck in the head loader ramps. With each recovery attempt, these rings would increase in depth and width, and soon no recovery would be possible. The smaller Dutch data recovery company had exhausted their supply of parts drives and realizing the chances for success were decreasing with each attempt, they advised the University to send it to Kroll Ontrack, the largest data recovery company in the world. Ontrack had a branch in Germany and off the case went.

But again, all attempts to recover the data were met with failure and the University was almost ready to concede defeat. But as luck would have it, the head of the University’s Computer Centre was an old colleague with one of our friends at Sprague and in a last ditch effort he called Sprague for advice. Our friend at Sprague suggested Memofix “may” be able to help.

Unlike most data recovery service providers, Memofix does not charge an extra fee for working on hard drives that have been previously worked on by other data recovery companies. In fact we cherish those data recovery cases because it gives us a chance to show just how good we are. Over the years we have recovered approximately 70% of the recoveries that have been previously attempted by our competitors.

western digital data recoveryWhen I first saw the request and the summary of what had been attempted, I was skeptical if we could do any better than the two professional data recovery companies that had already tried, especially when one of them was a “world leader” in data recovery and cost did not appear to be a constraint. I spoke with the original data recovery company that tried the 1st attempts. They told me that both defective drives had heads that were bent, distorted, and stuck in the head ramp loaders. They also told me that they had gotten both defective hard drives to function for a very short period of time after replacing the head assembly. Things were looking a little more promising.

When it comes to recovering data, there is one MAJOR factor that influences the chance of recovering data and that is the condition of the disks. If the disks are in good shape, a recovery is usually going to be possible. If the disks are badly scored and ringed, then it will be next to impossible to get a set of heads to function inside the drive without damaging them almost instantaneously. For a disk to get that badly damaged usually means the drive has been running/spinning in a crashed state for a long time. The fact that these drives had their heads stuck in the loading ramps is good news, as they could no longer damage the disks. The second fact that made us hopeful was that the drives were manufactured by Western Digital and Memofix has one of the best Western Digital data recovery techs that we have ever met and we do know a lot of data recovery techs.

So we decided that we may have a chance of successfully recovering at least some of the data and consequently the case was sent to us for a final data recovery attempt.

Our initial evaluation confirmed that we would need to get one of two defective drives imaged. After much scrutiny it was determined that one of the defective drives had shifted disks. When heads are replaced, there is a procedure for adjusting the disks which can sometimes help in getting access to a non-responsive hard drive. I suspect one of the data recovery service providers had attempted this procedure or something similar. This procedure can sometimes make things worse, so we decided to concentrate on the more pristine of the two drives.

Our Western Digital data recovery specialist got right to work. His first task was to get the drive functional enough to read off the drives system area, a normally inaccessible storage area on the drive used for its own housekeeping and the storing of drive specific settings. The system area tells the drive how many heads are present and what settings to use with each head. Without this road-map, recovery may not be possible.

bent heads comparison
Bent Heads vs Good Heads

We quickly determined that two of the disk surfaces had physical damage and we would worry about those surfaces last. Modifying the system area allowed us to configure the drive to ignore the 2 damaged heads/surfaces. We then physically removed the 2 heads (corresponding to the damaged surfaces) from a good parts head stack. This would prevent further damage to those disk surfaces as well as preventing read interference from the heads going over the damaged areas. We then used this head assembly to get the drive to initialize and we started to image off the good surfaces. After approximately 20 hours of imaging, the heads assembly became too contaminated with crash debris to function and we had to modify a new set of heads to continue. After two days we had managed to image 6 of the 8 disk surfaces. We were now ready to go after the two damaged disk surfaces.

At this stage, our greatest danger was the inherent risk of developing new crashes & destroying our chances of imaging off the last two disk surfaces. Consequently, the drive was imaged only while it could be monitored by a dedicated human watching and listening for any potential new crashes. Imaging of these last two surfaces took almost a week and in the process we consumed five sets of heads and still had some areas where nothing could be read because of the damage to the hard drives’ disks.

With the best drive images we could obtain, we began to analyze what we had. Once we determined the correct RAID 5 configuration settings we were able to use the RAID’s parity to virtually rebuild the missing disk and to de-stripe the 3 drive RAID 5 volume onto a single drive. Then it was a matter of repairing some minor file system structure damage, mounting up the volume, and copying the data to a new target hard drive.

In the end, we were able to recover over 99% of all the students’ data. But there wouldn’t have been any data recovery had it not been for one individual at the University refusing to take NO for an answer.

Consequently, I think the real takeaway point, has to be the fact that not all data recovery companies have the same abilities and just because the world’s largest data recovery company says it can’t be done, doesn’t mean Memofix, the world’s most determined data recovery company, can’t prove them wrong.

We are Memofix, and YES we can recover your data, even if others can’t!

Deleted SSD Files … Gone Forever?

It wasn’t long after the introduction of the PC that computer enthusiasts figured out that if you deleted a file on your hard drive, it could generally still be recovered. This was possible because deleting a file only deleted its index entry while the file itself remained intact and undamaged. Armed with this knowledge, many IT professionals rescued deleted files and won the accolades of their panicked customers in the process. But the rules have changed with the modern SSD or Solid State Drive and in most cases, if a file is deleted from an SSD, the file is deleted forever!

data recovery Ontario
To understand why, it helps to understand a little more about SSDs.

Unlike a hard drive which can simply write over existing data, an SSD must 1st erase existing data before it can write new data. The process of erasing a data block is very slow in comparison to writing or reading a data block, and as a result 1st generation SSDs became considerably slower over time. To address this concern, newer SSDs started preemptively erasing recently freed blocks during their idle time. This process is referred to as garbage collection and is found in all current SSDs.

However, initially SSDs did not understand or communicate with operating systems like Windows, consequently when Windows deleted a file and marked the space as free for re-use, the SSD knew nothing about it. As far as the SSD was concerned, this space was written to and was thus in-use. To overcome this build-up of unknown and thus unavailable space, SSD manufacturers introduced a feature called TRIM. TRIM allows the operating system to communicate and inform the SSD of free data blocks as they become available. The SSD will then add these blocks to its list of blocks to be preemptively erased. Unfortunately in the real world, these blocks are erased and prepared for re-use almost immediately. Consequently, a deleted file is now totally unrecoverable within moments of being deleted.

Even if you do a quick format on an SSD, the data will be gone almost instantaneously and forever! Previously with hard drives, it was still possible to recover the original data files even if you formatted your hard drive. See our Recovering Data After a Format blog post for more information on that topic.

There are exceptions where deleted SSD data can still be recovered. This is usually because the SSD, operating system or storage configuration does not support TRIM. Below are some examples where TRIM is not supported and hence, deleted files may still be recoverable:

  • Using an older 1st generation SSD or Solid State Drive
  • Running Windows versions before Vista and MAC OSX versions prior to 10.6.8
  • Using an SSDs inside an external USB or Firewire enclosures, and most NAS boxes.
  • File system has become corrupted and the volume is no longer recognized or accessible.
  • SSD formatted with FAT16 or FAT32
  • PCI Express SSDs generally do not support TRIM
  • Encrypted volumes do not usually support TRIM
  • SSD RAID arrays do not typically support TRIM.

Solid Sate Drives are becoming much more common as the prices comes down and their benefits become apparent, but as always, there are tradeoffs, and understanding the implications is always important. If we can help resolve your data loss situation or if you just want a second opinion, please don’t hesitate to contact us at 1-800-MEMOFIX or [email protected].

 

CryptoLocker holding your Data hostage?

If you haven’t heard of the CryptoLocker virus then you really should read on. This rather nasty virus is usually acquired by opening an email attachment which then embeds it’s secret code deep inside your computer. It then starts to silently encrypt ALL your data files including but not limitied to pictures, word documents, spreadsheets, pdf, emails etc. The virus encrypts your files using a virtually unbreakable RSA encryption algorithm and then demands a ransom of $100 to $500 USD in exchange for decrypting your files. Furthermore, if you don’t pay by a strict time limit, they permanently throw away the decryption key.

After the initial data encryption on your system hard drive, the virus searches out and encrypts data files on ANY online storage device, whether that is a powered on external hard drive, a USB stick, a NAS or network attached storage device, or heaven forbidden every shared folder on a network.

The first indication you are infected, is when you are greeted with a popup ransom note similar to the one displayed below. To do the most damage, the ransom note doesn’t appear until the encryption has completed, which can be anywhere from a few hours to a few days depending on how much data the virus has access to.

cryptolocker

 

This particular virus has been around for a few years and appears to becoming even more rampant, to the point that copycat viruses are now popping up. We have received numerous enquiries for assistance in recovering the data, but I’m sorry to say we can’t help other than to offer advice.

The good news is that the virus can be kept at bay by any user who is very vigilant about not opening any email attachments unless they are known to be 100% safe and from a trusted source. The best advice we can give is to suggest everyone keep a backup of your data on an offline or powered off external hard drive. That way nothing can touch it.

The bad news is that once you are infected, there is NO way to decrypt the data without the decryption key. Even with present computing speeds, brute force methods would take over 1000 years to crack it.

Unfortunately, and against any moral compass, we would recommend that you pay the ransom and hope the kidnappers will be honorable enough to decrypt your data. We have heard and read stories on the web of people paying the ransom and getting their data decrypted successfully. But unfortunately, we have also heard stories of people paying the ransom and getting nothing.

If you have had any experience with this virus, please comment and share your knowledge with all our readers.

Emergency RAID & Server Data Recovery (647) 448-5302

During the holidays many companies use the down time as an opportunity to update and perform maintenance on their data servers and RAID boxes. This is also a crucial time for data loss to occur, and a time where caution and safety should be of the utmost importance.

At Memofix, we understand that mistakes can happen, hard drives can crash, and servers do become corrupt, so we want you to know, whether you’re in Toronto or anywhere in Canada, we are ready and able to help 24-7, 365 days of the year. If you face a serious data loss & need our emergency data recovery services to ensure your business is back up as soon as possible, please call or text David Foster @ (647) 448-5302 to discuss your situation and how we can help … any time any day.

Happy Holidays to All! … from David Foster & my amazing team at Memofix Data Recovery

 

What is a CRASHED hard drive?

We hear the words “my hard drive has crashed” at least a hundred times a month and yet it is seldom what we discover when we open the lid of someones “crashed” hard drive. The picture below shows two Seagate 500 GB hard drives we recently received for data recovery. Both drives were declared crashed by their owners! However only one appears to be physically crashed.

data recovery toronto

The drive on the left is in pristine condition. The disks are extremely shiny and consistent across the entire surface of the disk surface. The clients problem was determined to be a bad PCB or printed circuit board.

The drive on the right is not so pristine and has physically CRASHED! The smooth shiny disk surface has been scored and ringed by constant contact with the heads while the disks were spinning. This amount of damage could only occur if the drive was left running for a long period after the initial contact damage. Click on the picture for a closer more shocking look.

The drive on the left should be recoverable. The drive on the right is NOT recoverable.

If you require a price estimate on our data recovery services, follow this link for a quick reply … Canada’s Data Recovery Experts

Toronto’s Weekend RAID Warriors

 

It was a beautiful Friday afternoon and the start of the long weekend was only hours away. The boys in the lab all had plans of some sort or another, but then Bob walked in. And RAID away I knew someone’s plans would be changing.

data recovery server

Bob Giannoulis, the head of our Client Services, had just spent the last 20 minutes discussing a huge data loss situation with a potential customer. The customer, one of North America’s largest providers of programmable digital mobile content, had lost a critical server. The live data content stored and constantly refreshed from a big old server was sitting in a huge data centre just a few kilometers from our lab. Their product was used by everyone from government and recreational complexes to big businesses and even Vegas casinos.

Unfortunately, most of these clients had performance contracts which penalized any delay or loss of access to online content. Consequently, our client was under extreme stress as several of his larger clients were threatening to terminate their contracts or pursue legal actions or both.

The client was running a RAID 5 setup with 14 hard drives. On Wednesday evening during a thunderstorm the RAID server went down momentarily with a single failed hard drive, but thanks to the redundancy of RAID 5, the server recovered and continued to operate, albeit in a degraded and much slower state. An automatic email message informed our client’s IT people about their hard drive failure and the fact the spare drive was also down. Within an hour or two their tech arrived to replace the defective hard drive and start the 7-8 hour RAID rebuilding process.

After about an hour into the rebuild, things started to go bad! A 2nd hard drive began to physically crash and within minutes the rebuild was aborted in mid process. The IT technician, already driving home, gets a 2nd email message concerning the catastrophic failure of their RAID server and quickly returns to the data center. The server is now totally down and none of their digital content servers can “call home”. No worries, he’ll just swap out the failed drive and re-start the rebuild process. But the rebuild apparently wouldn’t start, likely due to the fact there were now 2 disk drives down. More hands are called in, and with sparse options they decide to restore a backup of the RAID server to a new set of drives and use one of these drives from the back up set to rebuild the downed RAID array. As Friday morning arrives, the IT teams latest attempts are deemed a failure and the pressure to get the server up is not letting up.

I think it’s worth noting that RAID of any type is NOT a replacement for a good backup. Yes the R in RAID stands for redundant but the redundancy is very delicate and often short lived. You see, the redundancy in RAID 5 is based on being able to replicate the data from ONE failed hard drive, but once one drive fails the odds greatly increase that a second drive will fail shortly after. It makes sense when you consider most RAID arrays are built with identical drives, bought on the same day from the same supplier. They are semi-clones of each other, so as a critical component begins to fail on one drive, it’s just as likely to begin to fail on another hard drive. Add in the extra stress of rebuilding the complete array and it’s pretty clear that disaster is lurking just around the corner.

This is about the spot where Memofix Data Recovery Services comes back into the picture … just after 4pm on the Friday of the Canada Day long weekend a panic stricken gentlemen and a young nerdy guy walk into our facility and hand deliver their RAID server to us. They look tired, frazzled and beaten. This is our first challenge … to give them hope! We know if the data they need is still there, and if they didn’t do too much to the RAID array, we should be able to get it back! The client’s nerdy young guy is their lead IT tech and he’s mentally quick and thankfully possesses a solid memory of each step that was taken in their own efforts to resurrect the RAID server. Our tech and the nerdy young guy are quickly sharing the details of the situation and it’s not long before our confidence and positivity lifts the spirits of our once saddened clients. We are given the approval to do whatever we can to get their data back by Tuesday morning.

SAS drives for RAID 5 data recovery

With no further ado, we are left alone in our lab to try and resurrect this fallen giant of a storage device. It consists of fourteen 300 GB SAS hard drives and a few extra hard drives still to be sorted out. As always, we began by creating duplicate images of all the working drives before turning our attention to the failed disk drives. Often when a RAID reports a hard drive being down or offline it’s not actually dead or defective, so we 1st diagnose the two drives to see if either is accessible. We are hoping if we can get just one of the two drives working we’ll be able to rebuild the RAID array.

Briefly applying power to the 1st drive initiates a horrible screeching noise that we’ve heard way too often. This drive is likely badly crashed and a quick inspection under class 100 cleanroom conditions reveals it to be true. There are a series of deep rings across the top disk surface and most likely similar damage below. This drive will not be recoverable. Yikes!

Diagnosing the second drive, we are relieved to find the drive in a functional state with no painful noises being heard. However, the drive has triggered its built-in SMART monitoring system to report problems but the drive is still accessible. We quickly determine the cause of the SMART errors is due to one of the heads being defective and unable to read. Inspecting the hard drive’s three disks under class 100 cleanroom conditions shows no visible or apparent disk damage and removing the heads and inspecting them under a microscope shows no damage as well. This is good.

Checking our database of parts drive shows we have 3 of these exact model drives to use for parts and it isn’t long before our best cleanroom technician has the drive happily but slowly imaging along. It’s almost 8pm now and the imaging will likely take 5-6 hours. We decide to use this time to fuel up on some food and get some rest. The plan is for our best RAID file system specialists to return to the lab on Saturday morning and assuming the imaging is complete, continue with the recovery.

Our tech arrives at 8:30 am and as expected all the imaging has completed. There are a few read errors on the drive that required new heads but otherwise everything looks good. Now the task is to determine the original RAID configuration such as the proper drive order, the stripe size and the parity scheme. Sometimes the configuration is easy to determine, but due to the repeated attempts to self-fix the array we have our work cut out for us. By 1 pm we are fairly certain we have the correct parameters and we attempt to mount the RAID array virtually. But something is not right and we spend another 4 hours before we successfully mount the RAID 5 array virtually.

With the RAID 5 array now properly setup, we can mount the clients DATA volume. But nothing is straight forward here and our attempts to copy off the data using the DATA volumes own NTFS file system prove futile, especially on many of the identified critical files. Our tech has spent the better part of the day working on the world’s biggest jigsaw puzzle and he’s getting mentally tired so we decide to call it quits for the day.

Sunday morning arrives and our RAID specialist digs into the new problem. There appears to have been some overwrite or corruption of the volume’s MFT or Master File Table which acts as an index pointing to the location of files. Again, several more hours are spent searching through the RAID array for matching fragments of the MFT that we can use to repair the damaged areas. We are successful in finding the final missing remnants buried deep within some temporary system files. The MFT is now repaired, the DATA volume mounted and the copying of the data begins. Our tech now heads home but continues to monitor the case remotely. The copy completes during the holiday Monday and he tests a large sample of the data and ensures it loads error free. We can now declare this successful and a quick call to the client has them meeting up with our tech at our lab to pick up the data. If smiles were dollars we would be rich!

As a service provider of last resort, we tend to see the worst scenarios and this was no different. Nobody likes to call in outside help, especially if your reputation is built on data security and you have a potential data loss situation. But if you find yourself in a similar situation do the right thing and bring in the professionals. At the very least we will stop any further damage by capturing protected images of all the hard drives before any more modifications are made.

Memofix provides users with a 24-7-365 day cell number for contacting us off hours or on weekends. If disaster should strike you at an inopportune time please call me, David at (647) 448-5302 to arrange an emergency intervention.

* note: the actual business description has been misrepresented to protect our client’s identity