IPFS-Arweave Conversion Module

IPFS Data Format

This is a module that handles the conversion between data stored under Dag-PB format on IPFS and data stored on Arweave.

The Dag-Pb format has the benefits of displaying data in a directory style, with only the root CID specifying the path to the whole directory. An example is shown in the below link. https://ipfs.gateway.radian.community/ipfs/QmR4xu9yhzFDLZqovx8uCmwRA4hHr2SiAXZomiBCJN6J4s

The root of the directory can be discovered with {domain}/ipfs/{CID}, whereas the rest of the folders and files in the directory can be specified with the path {domain}/ipfs/{CID}/{path-to-folder}.

The benefit of this format is that we can design a schema for using fixed paths to the data. For instance, the images can be stored in the folder {domain}/ipfs/{CID}/image with the images path {domain}/ipfs/{CID}/image/0 , {domain}/ipfs/{CID}/image/1 , ... Applications only need to know the root CID and they can display the images of say a user profile.

One shortcoming of such as approach is that this will create an additional CID for the "folder" data, which defines the folder holding Links to other folders or files.

IPFS to Arweave Conversion

As we will discuss in length in the Decentralized Storage section, RADIAN supports the backup of IPFS data to Arweave as this offers permanent storage at a higher cost. There is a code repo, here for example, available for backing up simple CIDs to Arweave specifically for the add API.

We provide here the repo for backing up Dag-PB to Arweave through Bundlr. It is built on the source code provided by the Bundlr team here.