To follow on to the discussion about TB storage (which I cross-posted in the Archiving section), here are a few thoughts and my recommendations based upon my experience. Since the thread was about Aperture, I thought it valuable to start this as that thread seemed to be drifting towards drives and data storage more than Aperture.
But first, here's something I put together so people will take seriously (with a little tounge in cheek on the concept) the topic of the proper archiving of images, as there are two types of archivers -- those that HAVE had a drive fail on them, and those that WILL have a drive fail on them.
The 12 Steps of the Photo Archivers Anonymous
[*]Step 1 - Admit you have a problem and are not backing up images[*]Step 2 - Understand that you do not know how to best resolve your problem[*]Step 3 - Agree to establish a system that works specifically for your workflow[*]Step 4 - Review the size and scope of your current archive, and know what you're dealing with[*]Step 5 - Contact/research friends/colleagues/services who might be able to help[*]Step 6 - Choose who's system you'll use and acquire the equipment, then schedule a time to begin[*]the problem solving and archiving[*]Step 7 - Document your workflow so if you forget, you can refer back to your own diagram and thoughts[*]Step 8 - Get your drives up and running, and test it (nightly backups, etc) before beginning the[*]full out organization[*]Step 9 - Start with your new system from the 1st day of a month forward, and begin the move to your new system, verifying each copy to ensure they're properly copying (an application like zsCompare will do this just fine)[*]Step 10 - Locate and integrate stray image folders into your image archiving system, updating and fine tuning your own workflow documentation as you use it to be more clear and concise[*]Step 11 - Review and research ways to tweak your system to improve on it to your own specific needs as you better learn how it works[*]Step 12 - Spread the gospel of proper image archiving, and pay forward your knowledge, as it is only through the teaching of a system that you begin to truly understand how it works, and how you can continue to improve on it's functionality and clarity, and to continue to practice the gospel of proper image archiving.[/list]
Once you get to step 12, there are other 12-step programs to make your system archiving, image databasing, and copyright registration safe and secure. This one, however, is the most important - if you have no archive, you are SOL, and out of business. Did you know that of all the businesses that fail each year, a full 5% of them fail not because of bad products, no customers, or even poor customer service, the sole reason they fail is as the result of catastrophic data loss.
I put together a set of PDF's from the ASMP/NPPA/PhotoPlus talks I've done. It illustrates graphically my entire workflow, from ingestion to final archiving.
In there, you'll also find an Excel file outlining how you can justify drive costs over the external drives from Maxtor/etc. Feel free to forward/share it on. In addition, the Excel spreadsheet does the math for you. The spreadsheet has been pre-populated with my actual costs/#'s for the drives/systems. While you can (and should) change ALL the prices, to start with, the one number to change based upon your own real-world experiences, is the number of drives you go through in a year. (in red/pink). While I entered "8", my actual drive consumption is more like 12 a year (i.e. I run through a drive every two months for storage, and including a backup copy of that same drive means a total of 12 drives a year). Read through the spreadsheet, and start by just changing the drive-quantity-per-year to see when the benefits of moving towards a drive system would begin to make sense for you.
I've also done some research on the archivability of CD's. Here's the ZIP file on that:
If you think using CD's/DVD's is the solution. Think twice. I've talked with folks from the National Institutes of Standards and Testing (NIST) where they've been working on a study of the archivability of CD's and DVD's. I was sent these links about a little known department and study within NIST. I think you'll find it extremely insightful:
Also as an FYI, the RAID drive is the RAIDTECH 800.
And the DUO and SINGLE BAYDOCK's are the DUODOCK 800 and the BAYDOCK 800. The nice thing about them is that the trays are interchangeable. I have the DUO and one SINGLE on my G5, and another single on another machine, allowing to swap these drive inserts.
I purchased the boxes without drives, which means that I can control the manufacturer of all drives in my drive workflow. I initially purchased a set of 10 drive trays at around $15 each (they sell them individually, and in a 10-pack). You don't need the LCD screen, the basic tray will do. You don't need the trays, but it makes it a little easier.
The back of most MAC's has firewire 800, but only one port (I think). Using these boxes alone, you could daisy-chain them, but I'd recommend against it, using instead a firewire 800 card. Wiebetech sells one, but it's a 2-port, LaCie sells a 3-port, but others do too, or you could get one from Mac Mall.
So, two archives, "IMAGE ARCHIVE 001" and IMAGE ARCHIVE 001 Backup" are always mounted, and when I get to 010, if I need to go back and remount 009, I use the single baydock to remount just that drive.
All my Wiebetech drives are populated with WesternDigital WD2500JB, 250GB drives. These drives were rated highly across all categories for safety and performance, and work well in the RAID enclosure (make sure you use the same drives, with the same RPM in the RAID system!). On the WesternDigital site, these drives are $115 ea, on MacMall they are $114.
The G5 Working Drive is an internal SATA drive. The redundancy drive is a Maxtor from Costco. (250GB for $229).
[*]1 - To clarify the diagram, the RAID drive each night backs up the "Work in Progress" drive, which contains the three blue folders. I use Chronosync to accomplish this. It's an inexpensive program ($50 or less) that functions extremely well, and emails you with the status of all backups.
[*]2 - This system is designed to be most concerned with drive failure. To improve it, the RAID, Redundancy Drive, and one of the two Image Archive drives should be in a fireproof, secure space, and all should be on some form of power line smoothing device to protect against power spikes.
[*]3 - This is NOT a whole system backup solution. Yes, you should be mirroring your boot drives, but unfortunately, most people concerned with backing up their data have not gotten to the point where they also acknowledge the fragility of their boot disk. The diagrams/info are meant to be a 101/201 package of information to get you headed in the right direction.[/list]
Lastly, here are a few excerpts from:
[*]1. Handle discs by the outer edge or the center hole.[*]2. Use a non-solvent-based felt-tip permanent marker to mark the label side of the disc.[*]3. Keep dirt or other foreign matter from the disc.[*]4. Store discs upright (book style) in plastic cases specified for CDs and DVDs.[*]5. Return discs to storage cases immediately after use.[*]6. Leave discs in their packaging (or cases) to minimize the effects of environmental changes.[*]7. Open a recordable disc package only when you are ready to record data on that disc.[*]8. Store discs in a cool, dry, dark environment in which the air is clean.[*]9. Remove dirt, foreign material, fingerprints, smudges, and liquids by wiping with a clean cotton fabric in a straight line from the center of the disc toward the outer edge.[*]10. Use CD/DVD-cleaning detergent, isopropyl alcohol, or methanol to remove stubborn dirt or material.[*]11. Check the disc surface before recording.[/list] Do not:
[*]1. Touch the surface of the disc.[*]2. Bend the disc.[*]3. Use adhesive labels.[*]4. Store discs horizontally for a long time (years).[*]5. Open a recordable optical disc package if you are not ready [*]6. Expose discs to extreme heat or high humidity.[*]7. Expose discs to extremely rapid temperature or humidity [*]8. Expose recordable discs to prolonged sunlight or other sources [*]9. Write or mark in the data area of the disc (the area the laser [*]10. Clean by wiping in a direction going around the disc.[/list] For CDs especially do not:
[*]1. Scratch the label side of the disc.[*]2. Use a pen, pencil, or fine-tip marker to write on the disc.[*]3. Write on the disc with markers that contain solvents. [*]4. Try to peel off or reposition a label.[/list]
Feel free to write with questions...
Happy archiving!
Visit COLORRIGHT to get the colors right in your digital slr.
I have been looking for information like this all weekend. It may be a while before I can afford this kind of archiving system, but you've laid out a total and secure solution very well. Thanks for taking the time to do this.
[ QUOTE ]
Sounds like more of a sales pitch. I buy $99.00 250gb drives and store them.
[/ QUOTE ]
Bill -
What is John selling? He is giving the information freely? He is not selling anything. The same information is going to be included in our local APA chapter pdf about workflows.
If I am selling anything, it's piece of mind -- and, it's free. The excel spreadsheet allows you to enter in ANY drive brand, and ANY RAID/JBOD system you like. If I was selling anything, would it be: A) Western Digital, B) Maxtor, C) Wiebetech, or D) Sanity? Seems I've covered all four in my post, and I've outlined MY system, and populatd the spreadsheet with information from my bills of sale. You can do the same. If you're buying $99 250GB drives, they're either the rebated Newer Technology externals, or another brand. If you feel comfortable with $99 drives, and they're not refurbished, and they're a brand with a reputation for not failing, are well designed for RAID or other higher speed data transfer rates, then by all means, use them, and enter the data into the spreedsheet specific to your situation. I think that's what I said when I said:
[*]While you can (and should) change ALL the prices, to start with, the one number to change based upon your own real-world experiences...[*]Step 3 - Agree to establish a system that works specifically for your workflow[*]Step 6 - Choose who's system you'll use and acquire the equipment...[/list]Further, you'll see I am giving away information from the lecture I gave at PhotoPlus (which people paid for), as well as a whole bunch of research I did on NIST and CD's and DVD's.
Who am I working for? NIST? The Library of Congress? Hard drive manufacturers? Maxtor? Western Digital? Wiebetech? I suggest people buy at Costco, PC/MacMall, Wiebetech, and others to compare prices. Sure, you could consider the LaCie JBOD or OWC JBOD's, Apple's RAID arrays, or numerous others, but either they were too expensive, weren't integrated like I wanted, or just didn't fit my workflow. I posted what works for ME.
Rather than coming to the conclusion that I MUST be selling something because I've posted so much information, try considering that I am trying to be helpful and nothing more. People DO pay good money for data management systems and people to come and install them. I don't do that, I am a full time photographer. The more time I can spend behind the lens and the less time I spend doing archiving, post production, and worrying about my images' storage integrity, the happier I am.
I am sorry, I see my post is not very clear. I meant that you have so much confidence in these products it is like a "sales pitch". I didn't mean to offend. Sometimes I just spout not thinking. I use cheap drives that I store and I need to consider something more stable I think.
Too bad I just spent my wad on a P45 system.
Hello, I hope you read my post explaining what I meant in my post?
Other than that I had a question. I have been looking to update my storage system and I am basing it on your plan.
You have a raid attached to your computer that is seperate from the dual drive and single drive. You back up to the raid, but then what do you do with it? Do you also back up your raid to the dual drive? that is part of the equation I don't understand.
I understand that you back up your finals to the dual drive then archive it. Ok, but your daily backup goes to the server and not the dual. So what becomes of that info and when do you back it up?
Can't you do your daily backups to the dual drive?
Linear Mode
