Elevating Bacalhau with NATS.io: Simplifying Connectivity

5 Days of Bacalhau

and

Mar 28, 2024

Bacalhau v1.3.0 marks a major step in making distributed computing simpler thanks to a key network update. Bacalhau is moving from libp2p to NATS, a powerful open-source messaging system designed to streamline communication across complex network environments.

Why NATS?

libp2p served us well, but as Bacalhau's use-cases grew, we needed a networking solution specifically tailored for ease of use, scalability, and security. NATS excels in these areas:

Simplified Configuration: NATS's subject-based addressing eliminates complex hostname and port setups. Nodes communicate based on interests, making the network more dynamic and flexible.
Enhanced Scalability: Easily set up NATS clusters across clouds and regions, providing a foundation for truly global Bacalhau deployments.
Operational Ease: NATS reduces overhead on compute nodes, simplifying network management and bolstering resilience.
Security by Design: NATS is built with security in mind. It supports encrypted connections, ensuring that all data in transit is protected. Furthermore, NATS's authentication mechanisms, including TLS-based and token-based authentication, provide flexible yet secure options for controlling access to the network.

NATS in Bacalhau: Initial Integration

Our initial NATS integration focuses on simplifying communication between orchestrator and compute nodes. By embedding NATS within orchestrators, we streamline the network. Now, compute nodes need only connect to one or a few orchestrators and dynamically discover others at runtime, dramatically cutting down on configuration complexity.

How This Benefits You

Easier Setup: Compute nodes no longer need to be directly accessible by orchestrators, removing deployment barriers in diverse environments (on-premises, edge locations, etc.).
Increased Reliability: Network changes are less disruptive as compute nodes can easily switch between orchestrators if needed.
Future-Proof: This sets the stage for more advanced NATS features like global clusters and multi-orchestrator setups.

How This Affects You

As we integrate NATS into Bacalhau, we aim to keep your experience with Bacalhau's HTTP APIs and CLIs for job submission and queries consistent. This ensures a smooth transition allowing you to continue your work without any disruptions.

For Users Running Bacalhau Networks:

NATS now serves as the primary network protocol, simplifying setup and centralizing public access requirements to orchestrator nodes. This change not only simplifies network configurations but also enhances the overall security and efficiency of Bacalhau deployments.

We understand that adapting to new technologies takes time. Therefore, we’ll keep supporting libp2p as an alternative during the transition, giving you the flexibility to migrate at your own pace:

To maintain use of libp2p, simply launch your network with the -network option set to libp2p.

bacalhau serve --network libp2p

This approach provides a bridge, giving you the necessary time and flexibility to adjust your workflows to NATS, all while continuing to benefit from the ongoing support and enhancements within the Bacalhau ecosystem.

Getting Started with NATS

1. Generate an Authentication Token:

Start by creating a secure token. This token will be used for authentication between the orchestrator and compute nodes during their communications:

bacalhau config set "node.network.authsecret" your_secure_token

Make sure to securely store this token and share it only with authorized parties in your network.

2. Running an Orchestrator Node with Authentication:

With the authentication token set, launch your orchestrator node as follows:

bacalhau serve --node-type=requester

This command sets up an orchestrator node with an embedded NATS server, using the given auth token to secure communications. It defaults to port 4222, but you can customize this using the --network-port flag if needed.

3. Initiating Compute Nodes with Authentication:

Compute nodes can authenticate using one of the following methods, depending on your preferred configuration setup:

Option 1: Read authsecret from the Config:

bacalhau serve --node-type=compute --orchestrators=<HOST>

This method assumes the authsecret is already configured in the Bacalhau settings on the compute node, allowing for a seamless authentication process.

Option 2: Pass authsecret Directly in the Orchestrator URI:

bacalhau serve --node-type=compute --orchestrators=your_secure_token@<HOST>

Here, the authsecret is directly included in the command line, providing an alternative for instances where it's preferable to specify the token explicitly rather than rely on the configuration file.

Both methods ensure that compute nodes, acting as NATS clients, securely authenticate with the orchestrator node(s), establishing a trusted communication channel within your Bacalhau network.

More Authentication Options

We're committed to providing a secure and flexible distributed computing environment. Future Bacalhau versions will expand authentication choices, including TLS certificates and JWT, catering to varied security needs and further strengthening network security.

Looking Ahead with NATS

Global Connectivity and Scalability: NATS opens avenues for Bacalhau to operate smoothly across all scales, from local deployments to international networks. Its self-healing capabilities and dynamic mesh networking form the foundation for a future of resilient and flexible distributed computing.

Unlocking New Possibilities: The integration heralds a new era of possibilities for Bacalhau, from global clusters to multiple orchestrator nodes, tackling the complexities of distributed computing with innovation and community collaboration.

Conclusion

Our shift to NATS is a step toward making distributed computing more accessible, resilient, and scalable. As we start this new chapter, we're excited to explore the advanced features NATS brings to Bacalhau and welcome our community to join us on this transformative journey.

If you’re interested in learning more about distributed computing and how it can benefit your work, there are several ways to connect with us. Visit our website, sign up to our bi-weekly office hour, join our Slack or send us a message.

How to Get Involved

We're looking for help in various areas. If you're interested in helping, there are several ways to contribute. Please reach out to us at any of the following locations.

Commercial Support

While Bacalhau is open-source software, the Bacalhau binaries go through the security, verification, and signing build process lovingly crafted by Expanso. You can read more about the difference between open source Bacalhau and commercially supported Bacalhau in our FAQ. If you would like to use our pre-built binaries and receive commercial support, please contact us!