Best data storage solution for scanned films?

[chaoliang]

I must store many files of scanned films. I need about 80 to 130MB for each image and there will be about 4000 images. What would be an optimum storage solution for this? The data should be safe so that I don't have to do it again in the future.

[Dilitante1]

over 4TB of storage needed, can the images be zipped?

[Maggi]

here at work, we archive our digital negatives on LTO drives

http://www-1.ibm.com/servers/storage/tape/3580/index.html

we have an external 12 tape autoloader ...

[VJ]

Dilitante1: zipping is risky. But if you must compress the files, there is a preference towards multiple archives (1 per file) to minimize the loss when the archive goes corrupt.

Do you need fast access?
(we are now working on a music database which does require easy and fast access too, so chances are it will be a harddrive solution; estimated size is around 6 TB, but we will need some backup solution as well)


Jörg

[chaoliang]

@Dilitante1: Oh yes, I forgot. With LZW it will be about 80MB per image.

[chaoliang]

@Jörg: Not really. This is only to storage the raw scan version of the images. I will then generate a downsized 24-bit colour version of these images for further usage. Those are much smaller and can be stored on CDs.
Hard drives are not optimum for me since I won't use these files often, and storing hard drives out of the computer case is risky.

I thought the most handy solution way might be DVDs but I'm skeptical toward its safety.

[VJ]

Originally posted by chaoliang
@Jörg: Not really. This is only to storage the raw scan version of the images.

Yes, but these are images you don't want to loose. If you put 10 in one archive, and it goes corrupt, you loose 10 images...

I will then generate a downsized 24-bit colour version of these images for further usage. Those are much smaller and can be storaged on CDs.

Be aware of CD degradation! Ok, you could still regenerate them if a CD goes bad, but you might have to take it into account when it comes to usability, maintenance and cost.


Jörg

[chaoliang]

I'm not sure if hard drives are optimum for me since I won't use these files often, and storing hard drives out of the computer case is risky.
CD degradation is exactly what I'm afraid of with a CD/DVD solution.

[Maggi]

any reason not to use tape drives, like the one I linked above ?

[Dilitante1]

eesh, what is the budget for this storage? The tape setup linked above is close to 10k usd, hard drive storage will run 2-2500$ usd with ide drives, scsi drives in a RAID array will run much more.


DVD burns will run less providing you dont need to modify the files while in storage.

[chaoliang]

@ Maggi: No. I've never used this kind of devices but I can imagine that it will work. But then I need a much cheaper alternative as the expensive professional devices. It's for private use only. So I'm thinking about things like streamers. I have not even seen one though.

[Fluff]

It will be properly expensive to buy all that storage. Your best bet is doing it in batches. And backing it up to a suitably reliable tape.

Plus I think it might be worth it to properly calibrate your film scanner to your screen. To make sure you see the results as correctly as possible.

It sounds like it will take a good few weeks.

Have a look at this site

https://www.span.com

there are lots of options there and the guys are quite good.

[chaoliang]

Could you explain a bit more?

[Maggi]

in that case, I'd go the route of using standard IDE drives, but in a drive bay, so that you can easily swap those storage drives back and forth.

those mounting brackets cost next to nothing and that way, you'd benefit from best of all worlds, ie. fairly cheap, fast and reliable storage from IDE drives, easy access from disk changing front bays

[Maggi]

in particular, I'm talking about these HD changer frames

http://www2.alternate.de/html/shop/productDetails.html?artno=AWA%2304&