Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Amazon S3 now supports Object Versioning (aws.typepad.com)
18 points by bbgm on Feb 9, 2010 | hide | past | favorite | 4 comments


Now somebody should re-implement git/mercurial on top of S3.


Normal S3 pricing applies to each version of an object. You can store any number of versions of the same object, so you may want to implement some expiration and deletion logic if you plan to make use of this feature.

Hehe. Users of VMS learned pretty quickly the DCL command to set the number of versions to 3 or so. That way, they would only have "note.txt;32", "note.txt;31" and "note.txt;30" around, instead of running out of disk quota with all the versions down to "note.txt;1".

One of the filesystems for CDs (UDF ?) supports this.


This is a deal breaker IMO. Pushing responsibility onto the application isn't going to work.

What was needed from S3 was something more like filesystem snapshots, where the cost is proportional to the amount of changed data. Or deduplication.

I was hoping S3 would get this right so I could just fling database backups at it and my bill would increase, but only a little. Maybe JungleDisk will work out a way so this can still happen.


I agree - while this new feature from S3 makes sense for a segment of users, just like in normal S3 usage, the complexity is left for the client application to deal with. This is a non starter for most companies.

Full Disclosure - I am an employee of Nasuni. We just (today!) launched a versioned, encrypted filesystem sitting on top of cloud storage (including S3) (http://www.nasuni.com).

You are right to point out that this implementation put the burden on the application developers. The fact that each version is a complete copy of the object means that your storage growth could be massive depending on your write pattern.

For example, take MS Word - the number of changes generated when editing a file means that if you were to use this feature directly you could end up with hundreds of versions of that single object.

This is a good feature that will apply to certain types of S3 users, but those S3 users will not likely fall in the class of generic file/file system application users. Amazon is the only cloud vendor that supports this right now - if you plan on using multiple cloud storage vendors you'd need to consider a design a cloud-neutral application yourself to handle this.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: