Announcing Bacalhau 1.7.0: Empowering Enterprises with Enhanced Scalability, Job Management, and Support
(5:35) Bacalhau v1.7.0 makes distributed computing easier with new licensing, partitioned jobs, and simplified authentication.
This post is part one of the 5-days of Bacalhau 1.7.0 series. Be sure to go back and catch any that you missed!
We’re thrilled to announce the release of Bacalhau v1.7.0, taking one more step in our continuing mission to bring robust, scalable distributed computing to developers and enterprises alike. We’ve packed this release with an array of features designed to streamline operations and enhance security, as well as introducing comprehensive support to enable teams and organizations to confidently deploy Bacalhau at scale.
With v1.7.0, we’re rolling out the following:
Self-service licensing configuration
Enhanced job execution with partitioned workloads
Streamlined job management and templates in Expanso Cloud
Simplified authentication via username/password, API key, and single sign-on (SSO)
Self-service Licensing Configuration
Bacalhau v1.7.0 introduces enterprise support options, offering flexible licensing models to meet the needs of any organization. Whether you prefer the fully managed orchestration of Expanso Cloud or on-premises support, we've got you covered:
Self-Service Licensing: Easily purchase support licenses through the Expanso Cloud portal, tailored to your node count.
Tiered Support: Choose the support level that matches your organization's needs, ranging from startups to large enterprises.
Simplified Deployment: Download your license from Expanso Cloud and deploy it to your orchestrator—no need for complex node-level licensing.
Enhanced Job Execution
Process terabytes of data efficiently with our new partitioned execution system. Each node automatically understands its specific workload portion, enabling parallel processing that scales linearly with your infrastructure—all without writing complex coordination code:
Deterministic Partitioning: Distribute work intelligently across compute nodes using environment variables that indicate each execution's position.
Efficient Data Processing: Process large datasets with coordinated distribution, ensuring each node understands its specific workload portion.
S3 Native Partitioning: Amazon Web Services recommends native partitioning, and we natively integrate with it, making it much easier to us!
Simplified Setup and Networking
One thing that we really want to do with Bacalhau is remove (as much as possible) the challenges of setting up a Bacalhau network. We have made some big steps towards that here:
Bacalhau Docker-in-Docker: The Bacalhau and Expanso teams now support a containerized version. This makes it particularly easy to deploy with docker tools (including Docker Compose) and Podman!
Smarter Default Networking: One of the biggest challenges we have seen is people setting up and managing their networking. We have chosen some smarter defaults that should make it simpler to use (or lock down) exactly what you need. This includes native WASM networking as well!
Host Environment Variables: While many jobs are treated as ephemeral, we do want to be able to pass through information about the underlying node so that jobs can act smartly. We have added that natively as well!
Streamlined Job Management and Templates in Expanso Cloud
Expanso Cloud now offers enhanced job submission capabilities through a web interface. The enhancements include:
Job Templates: Choose from predefined templates for common use cases like log processing, data analysis with DuckDB, and Apache Iceberg operations.
Custom Workflows: Create and share custom job templates, simplifying complex distributed computing tasks.
Customizable Placeholders: Reuse templates with different values to streamline common tasks.
The enhanced Expanso Cloud platform dramatically reduces the learning curve for distributed computing. Data scientists and developers can now launch complex distributed workflows in minutes instead of days, using pre-configured templates for common use cases.
Simplified Authentication and Single Sign-On
Bacalhau v1.7.0 features a completely redesigned authentication system:
Standardized Approach: Adopts familiar, widely-used authentication standards.
Enterprise Choice: Whether using username/password, API keys, or single sign-on (SSO), Bacalhau supports the way you want to authenticate.
Fine-Grained Permissions: Bacalhau supports an entire array of nouns and verbs that you can use to provide granular authentication.
Our redesigned authentication system delivers enterprise-grade security without the complexity. SSO, API tokens, and fine-grained permissions make it easy to integrate Bacalhau into your existing security infrastructure while maintaining strict access controls.
Join Us on the Journey: 5 Days of Bacalhau
Stay tuned for our "5 Days of Bacalhau" series, in which we'll delve deeper into these exciting new features:
Day 1: Announcing Bacalhau 1.7.0 (this post)
Day 2: Scaling Your Compute Jobs with Bacalhau Partitioned Jobs
Day 3: Streamlining Security: Simplifying Bacalhau's Authentication Model
Bacalhau is rooted in community-driven advancements. If you have ideas or features that you’d like to see—get involved! Check out Bacalhau v1.7.0 and dive into our community:
GitHub: Contribute to the project.
Slack: Join our community.
Website: Learn more about Bacalhau.
Follow our social media.
We're excited to learn how you leverage the power of Bacalhau v1.7.0 to transform your distributed computing workflows.
Onwards together!
The Bacalhau Team
Get Involved!
Have a unique use case? We’d love to hear about it! Share your projects and ideas, and let’s build the future of distributed systems together.
There are many ways to contribute and get in touch, and we’d love to hear from you! Please reach out to us at any of the following locations.
Commercial Support
While Bacalhau is open-source software, the Bacalhau binaries go through the security, verification, and signing build process lovingly crafted by Expanso. You can read more about the difference between open-source Bacalhau and commercially supported Bacalhau in our FAQ. If you would like to use our pre-built binaries and receive commercial support, please contact us!
