Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Are you interpreting the speed up as due to less contention for the NameNode's resources?


Not a hadoop expert, but that seems to be the case, more decentralized caching due to the way IPFS works.


If that's the case you could also boost the replication # of a given folder/file in HDFS and see a similar speed up. There are circumstances where IPFS is nicer by default, but it might not be something that is a clear winner.


I think this is definitely a worthy experiment if you'd like to dig more into it. The poster (I believe) is very thin on details, so more eyes are better.


Unfortunately I don't see the connector code, or the experiment set up.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: