[TBD] Compute to data

Learn how to use edge computing with Nodes

Compute to Data is currently disabled.

Compute is in testing phase with trusted users.

With Nodes, you can send programs over to the data. This is known as edge computing and is especially powerful for data-intensive research. Nodes use Bacalhau, an architecture for fast, cost efficient, and secure computation to run jobs where the data is generated and stored. A major advantage is that you don't need to rewrite your code - you can simply send it over to the data into an arbitrary docker container and WebAssembly (wasm) images as task.

Getting started with Edge computing

First step is to install Bacalhau:

$ curl -sL https://get.bacalhau.org/install.sh | bash

Next step is to head over to their documentation.

Using Edge computing with Nodes

Navigate to Node drive, and click on the "use" icon. From there, copy the CID of the data object you wish to run your compute job on. You can use this CID in Bacalhau. Follow the Bacalhau documentation for edge computing on your data.

[update video below]

Fetching the CID of the Digital Object for Edge Computing