Introduction to Bacalhau
Overview
Bacalhau is an innovative platform designed to enable fast, cost-efficient, and secure computation by running jobs locally, where the data is generated and stored. Bacalhau aims to streamline existing workflows, allowing users to execute tasks in the form of Docker containers, WebAssembly (wasm) images, or other types of binaries with ease.
Why Choose Bacalhau?
Fast Job Processing
Bacalhau is designed to process jobs rapidly by ensuring they run where the data is originally produced. Its parallel processing capability further speeds up job execution.
Cost-Efficiency
By processing jobs closer to their data source, Bacalhau minimizes or even eliminates data transfer costs. It also leverages idle computational resources at the network edge, thereby optimizing cost-effectiveness.
Enhanced Security
The platform implements security measures before data migration, minimizing the risk of data breaches. A detailed, code-based permission model provides granular control over data access.
Large-Scale Data Handling
Bacalhau is capable of handling massive datasets spanning petabytes. It utilizes a network of open computational resources, making it ideal for significant data processing workloads.
Getting Started with Bacalhau
To begin using Bacalhau:
-
Navigate to the folder where you want to save your job results.
-
Install the Bacalhau client:
curl -sL https://get.bacalhau.org/install.sh | bash -
Submit a simple "Hello World" job:
bacalhau docker run ubuntu echo Hello World -
Download your job result:
bacalhau get 63d08ff0..... # replace with the correct job ID
For more detailed setup instructions, explore the Getting Started tutorial.
Further Learning
To gain a deeper understanding of Bacalhau, consider the following resources:
- Bacalhau Concepts
- Explore diverse use cases for Bacalhau.
- Check out Bacalhau Examples to see practical applications.
- Discover video tutorials like Text to Image-Stable Diffusion GPU.
Documentation
The Bacalhau documentation is a comprehensive guide containing all necessary information to maximize the platform's utility.
Developers Guide
Developers can explore resources on running Bacalhau locally, contributing code, and utilizing OpenAPI features within the platform.
Running Locally
Start a local instance of Bacalhau using the devstack command, following the detailed instructions in the running locally guide.
OpenAPI and Python Libraries
Bacalhau supports OpenAPI for endpoint documentation, and provides two Python libraries: bacalhau-apiclient for API calls and bacalhau-sdk for high-level workflow integration.
Community and Contribution
Bacalhau thrives on community support. For issues, feature requests, or contributions, join discussions on GitHub or participate in the Slack community.
Open Source Commitment
Bacalhau is developed as an open-source project under the Apache-2.0 license, while specific trademarks are reserved under separate terms. This structure allows for wide collaboration and innovation within the community.
Through its comprehensive features and supportive community, Bacalhau represents a pioneering approach to distributed computation over data, enhancing efficiency and security across diverse computational tasks.