In this guide we will see how to run batch batch jobs on Linode using Daestro.

Table of Contents

• Prerequisites
• Linode API Key
• Create Cloud Auth in Daestro
• Compute Environment
• Job Queue
• Job Definition
• Running Job

Prerequisites

• Daestro account: If you don’t have one, you can sign up here
• Linode account: If you don’t have one, you can sign up at their website

Linode API Key

To allow Daestro to manage instances on your behalf, you need to generate a Personal Access Token. This token acts as a secure key that grants Daestro specific, limited permissions to your Linode account.

1. Log in to your Linode Cloud Manager.

2. Click on your Profile name at the top right of the page.

3. From the dropdown menu, select API Tokens.

4. Click the Create a Personal Access Token button.

5. Configure your new token:

   • Label: Give your token a descriptive name that you can easily identify, such as daestro-integration-token.
   • Expiry: It’s highly recommended to set this to Never to ensure Daestro’s access doesn’t expire and disrupt your running jobs.
   • Scopes: These settings define what the token is permitted to do. To ensure Daestro works correctly, you must set the following permissions:
     • Set to Read Only access:
       • Account
       • Images
     • Set to Read/Write access:
       • IPs
       • Linodes
       • Volumes
       • VPCs

6. Once the permissions are set, click the Create Token button.

7. CRITICAL: Copy Your Token Now! Linode will display your new Personal Access Token. This is the only time it will be shown in full. Make sure to copy the token and save it in a secure location like a password manager. If you navigate away without saving it, you will have to create a new token.

Create Cloud Auth in Daestro

1. Login to your Daestro account
2. Go to Cloud Auth then Add Cloud Auth page.
3. Select Linode from the given Options

   

4. Give it proper name
5. Add the API Access token that we got in previous step
6. You can save Cloud Auth by clicking on “Add Cloud Auth” button

Compute Environment

Let’s define the instance type that we want to run our job on. We do that by creating a compute environment.

1. Go to the Compute Environments page in Daestro Console
2. Click on the “Add New” button
3. Select your Cloud Auth
4. Select the Instance Family then Instance Type that you want to run your job on

   

5. Give this compute environment a name, e.g. “DO-2-cpu-optimized”
6. Click on the “Add Compute Environment” button

Job Queue

Job queues define how and when jobs are executed.

1. Go to the Job Queue page in Daestro Console
2. Click on the “Create Job Queue” button
3. Fill in the details and click on the “Create Job Queue” button
4. After job queue is created, add the compute environment to the job queue

Job Definition

Job definition is the blueprint for the job. Here we define the docker image that we want to run and all the attributes to the container that we want to pass on.

1. Go to the Job Definition page in Daestro Console
2. Fill in the details for the job definition
3. Click on the “Create Job Definition” button

Running Job

You can submit jobs either from Daestro Console or use the API.