Skip to main content

Install a Delegate on Amazon ECS or AWS Fargate

Last updated on

Closed Beta

Delegate 3.x is currently in closed beta and available only to select users. Access is determined by the product team. See Feature Parity for current supported use cases.

This guide walks you through installing Delegate 3.x on Amazon Elastic Container Service (ECS) or AWS Fargate. The delegate runs as a container in your ECS cluster and connects to Harness to execute CI builds and other tasks. For supported connectors, CI steps, secret managers, and module support by deployment type, see the Feature Parity page.

info

To learn more about Delegate 3.x, including architecture and how it compares to the legacy delegate, see the Delegate 3.x Overview.

Important considerations

Before deploying the delegate on ECS or Fargate, review the following information:

  • Feature parity with Kubernetes: Delegate 3.x on ECS targets the same capabilities as Kubernetes delegates, including CI builds, CD deployments, and Database DevOps tasks. Go to the Feature Parity page to verify support for your specific connectors and pipeline steps.
  • Manual updates required: Delegates deployed on ECS do not auto-update. You must manually update the delegate by deploying a new task definition with the latest image. Harness recommends updating every 3 to 6 months to balance security and feature updates.
  • Infrastructure limits on Fargate: When using AWS Fargate, tasks that exceed the specified CPU or memory limits will be terminated by AWS. This is a limitation of Fargate infrastructure. If you need more flexibility with resource limits, consider using ECS on EC2 instances or a Kubernetes-based deployment.
  • Docker image compatibility: Delegate 3.x uses a different Docker image than legacy delegates. Ensure you use the correct image format for Delegate 3.x deployments.
  • Network requirements: The delegate requires outbound HTTPS (443), HTTP (80 for package managers), SSH (22 for Git), and Git protocol (9418) connectivity. The security group must allow these outbound connections.

Get Harness credentials

Before installation, obtain your Account ID, Delegate Token, and Harness URL from the Harness platform.

  1. Open Delegate settings: In the left nav, go to Project Settings, then under Project-level Resources, click Delegates.

  2. Create a new delegate: Click + New Delegate and choose Docker as your delegate type.

  3. Copy the credentials from the docker run command:

    • ACCOUNT_ID → Your Account ID
    • DELEGATE_TOKEN → Your Delegate Token
    • MANAGER_HOST_AND_PORT → Your Harness URL (e.g., https://app.harness.io)

tip

Keep these values ready — you'll use them in the task definition.


Choose your deployment type

Delegate 3.x supports two ECS deployment types: Fargate (serverless) and EC2 (container instances). Choose based on your requirements:

FeatureFargateECS on EC2
Infrastructure managementFully managed (serverless)Requires managing EC2 instances
Docker-in-Docker❌ Not supported✅ Supported via Docker socket
Privileged containers❌ Not supported✅ Supported
Ephemeral storageUp to 200 GiBUnlimited (depends on instance)
Task startup time30-60 secondsFaster (10-20 seconds)
Use casesCD deployments, DB DevOps, CI builds without DockerCI builds with Docker, advanced container workflows
CostPay per task (vCPU + memory)Pay for EC2 instances (even when idle)

Recommendation:

  • Use Fargate for most deployments (simpler, no instance management)
  • Use EC2 if you need Docker-in-Docker for building container images in CI pipelines

Deploy a delegate to Amazon ECS

Use these steps to deploy a delegate to an ECS cluster running on EC2 instances. The delegate runs as an ECS service and connects to your AWS resources.

Prerequisites

  • An active AWS account with permissions to create ECS resources
  • AWS CLI installed and configured
  • An existing ECS cluster or permissions to create one

Step 1: Create an ECS cluster

If you don't already have an ECS cluster, create one using the AWS Console or CLI.

Using AWS Console:

  1. Go to the Amazon ECS Console.
  2. Click Clusters in the left navigation, then click Create Cluster.
  3. Choose EC2 Linux + Networking as the cluster template.
  4. Configure your cluster:
    • Cluster name: Enter a name (e.g., harness-delegate-cluster)
    • EC2 instance type: Select an instance type with at least 2 GB RAM (e.g., t3.small or larger)
    • Number of instances: Start with 1 instance
    • Networking: Use your default VPC and subnets, or create new ones
  5. Click Create and wait for the cluster to be ready.

Using AWS CLI:

aws ecs create-cluster --cluster-name harness-delegate-cluster

Step 2: Create the task definition

The task definition specifies how the delegate container should run, including environment variables, resource limits, and the Docker image.

  1. Copy the following JSON into a file named task-definition.json:

    {
    "family": "harness-delegate-task",
    "containerDefinitions": [
    {
    "name": "harness-delegate",
    "image": "us-docker.pkg.dev/gar-prod-setup/harness-public/harness/delegate:3.0.0",
    "cpu": 1024,
    "memory": 2048,
    "essential": true,
    "environment": [
    {
    "name": "HARNESS_ACCOUNT_ID",
    "value": "PUT_YOUR_ACCOUNT_ID"
    },
    {
    "name": "HARNESS_TOKEN",
    "value": "PUT_YOUR_DELEGATE_TOKEN"
    },
    {
    "name": "HARNESS_URL",
    "value": "PUT_YOUR_HARNESS_URL"
    },
    {
    "name": "HARNESS_NAME",
    "value": "ecs-delegate"
    }
    ],
    "logConfiguration": {
    "logDriver": "awslogs",
    "options": {
    "awslogs-group": "/ecs/harness-delegate",
    "awslogs-region": "us-east-1",
    "awslogs-stream-prefix": "delegate"
    }
    }
    }
    ],
    "requiresCompatibilities": ["EC2"],
    "networkMode": "bridge",
    "cpu": "1024",
    "memory": "2048"
    }
  2. Replace the placeholder values:

    FieldDescription
    PUT_YOUR_ACCOUNT_IDYour Harness account ID from the Get Harness credentials step
    PUT_YOUR_DELEGATE_TOKENYour delegate token from Harness
    PUT_YOUR_HARNESS_URLYour Harness URL (e.g., https://app.harness.io)
    awslogs-regionThe AWS region where your ECS cluster is located
    Security Best Practice

    For production deployments, store the HARNESS_TOKEN in AWS Secrets Manager instead of plaintext in the task definition. Replace the environment variable with a secrets array:

    "secrets": [
    {
    "name": "HARNESS_TOKEN",
    "valueFrom": "arn:aws:secretsmanager:REGION:ACCOUNT_ID:secret:harness/delegate-token"
    }
    ]

    For more information, go to Specifying sensitive data in the AWS documentation.

  3. Create CloudWatch Logs group (required for logging):

    aws logs create-log-group --log-group-name /ecs/harness-delegate --region YOUR_AWS_REGION

    Replace YOUR_AWS_REGION with your AWS region (e.g., us-east-1, us-west-2).

  4. Register the task definition:

    aws ecs register-task-definition --cli-input-json file://task-definition.json

Step 3: Create the ECS service

Create a service to run and maintain the delegate task.

Using AWS CLI:

aws ecs create-service \
--cluster harness-delegate-cluster \
--service-name harness-delegate-service \
--task-definition harness-delegate-task \
--desired-count 1 \
--launch-type EC2

Using AWS Console:

  1. Go to your ECS cluster in the AWS Console.
  2. Click Create under the Services tab.
  3. Configure the service:
    • Launch type: EC2
    • Task Definition: Select harness-delegate-task
    • Service name: harness-delegate-service
    • Number of tasks: 1
  4. Click Create Service.

Step 4: Verify the delegate

  1. Go to your Harness account.

  2. Navigate to Project Settings > Delegates.

  3. Verify that your delegate (named ecs-delegate) appears in the list with a Connected status.

    Delegate connected in Harness


Deploy a delegate to AWS Fargate

Use these steps to deploy a delegate to AWS Fargate. Fargate is a serverless compute engine for containers that removes the need to manage EC2 instances.

Prerequisites

  • An active AWS account with permissions to create ECS and IAM resources
  • AWS CLI installed and configured
  • VPC with subnets: Minimum of 2 subnets in different Availability Zones, each with outbound internet access (public subnets via Internet Gateway, or private subnets via NAT Gateway)
  • Security group: Must allow outbound traffic on ports 443, 80, 22, and 9418

Step 1: Create an ECS cluster

If you don't have an ECS cluster, create one for Fargate.

Using AWS Console:

  1. Go to the Amazon ECS Console.
  2. Click Clusters in the left navigation, then click Create Cluster.
  3. Choose Networking only (Fargate) as the cluster template.
  4. Configure your cluster:
    • Cluster name: harness-delegate-fargate-cluster
  5. Click Create.

Using AWS CLI:

aws ecs create-cluster --cluster-name harness-delegate-fargate-cluster

Step 2: Create an IAM execution role

Fargate requires an IAM execution role that grants ECS permission to pull container images and write logs.

  1. Create a file named trust-policy.json with the following content:

    {
    "Version": "2012-10-17",
    "Statement": [
    {
    "Effect": "Allow",
    "Principal": {
    "Service": "ecs-tasks.amazonaws.com"
    },
    "Action": "sts:AssumeRole"
    }
    ]
    }
  2. Create the IAM role:

    aws iam create-role \
    --role-name ecsTaskExecutionRole \
    --assume-role-policy-document file://trust-policy.json
  3. Attach the required policy:

    aws iam attach-role-policy \
    --role-name ecsTaskExecutionRole \
    --policy-arn arn:aws:iam::aws:policy/service-role/AmazonECSTaskExecutionRolePolicy
    IAM permissions required

    The ecsTaskExecutionRole needs the following permissions:

    • ECR: Pull container images (ecr:GetAuthorizationToken, ecr:BatchGetImage, ecr:GetDownloadUrlForLayer)
    • CloudWatch Logs: Create log groups and streams (logs:CreateLogGroup, logs:CreateLogStream, logs:PutLogEvents)
    • Secrets Manager (if using secrets): Retrieve secrets (secretsmanager:GetSecretValue)

Step 3: Create the task definition

  1. Copy the following JSON into a file named fargate-task-definition.json:

    {
    "family": "harness-delegate-fargate-task",
    "networkMode": "awsvpc",
    "requiresCompatibilities": ["FARGATE"],
    "cpu": "1024",
    "memory": "2048",
    "executionRoleArn": "arn:aws:iam::PUT_YOUR_AWS_ACCOUNT_ID:role/ecsTaskExecutionRole",
    "containerDefinitions": [
    {
    "name": "harness-delegate",
    "image": "us-docker.pkg.dev/gar-prod-setup/harness-public/harness/delegate:3.0.0",
    "essential": true,
    "environment": [
    {
    "name": "HARNESS_ACCOUNT_ID",
    "value": "PUT_YOUR_ACCOUNT_ID"
    },
    {
    "name": "HARNESS_TOKEN",
    "value": "PUT_YOUR_DELEGATE_TOKEN"
    },
    {
    "name": "HARNESS_URL",
    "value": "PUT_YOUR_HARNESS_URL"
    },
    {
    "name": "HARNESS_NAME",
    "value": "fargate-delegate"
    }
    ],
    "logConfiguration": {
    "logDriver": "awslogs",
    "options": {
    "awslogs-group": "/ecs/harness-delegate-fargate",
    "awslogs-region": "us-east-1",
    "awslogs-stream-prefix": "delegate"
    }
    }
    }
    ]
    }
  2. Replace the placeholder values:

    FieldDescription
    PUT_YOUR_AWS_ACCOUNT_IDYour 12-digit AWS account ID
    PUT_YOUR_ACCOUNT_IDYour Harness account ID
    PUT_YOUR_DELEGATE_TOKENYour delegate token from Harness
    PUT_YOUR_HARNESS_URLYour Harness URL (e.g., https://app.harness.io)
    awslogs-regionThe AWS region where your cluster is located
    Security Best Practice

    For production deployments, store the HARNESS_TOKEN in AWS Secrets Manager instead of plaintext. Replace the environment variable with a secrets array as shown in the ECS section above.

  3. Create CloudWatch Logs group (required for logging):

    aws logs create-log-group --log-group-name /ecs/harness-delegate-fargate --region YOUR_AWS_REGION

    Replace YOUR_AWS_REGION with your AWS region (e.g., us-east-1, us-west-2).

    info

    The ecsTaskExecutionRole must have permissions to write logs to CloudWatch. If you encounter a ResourceInitializationError related to log creation, ensure the log group is created manually as shown above.

  4. Register the task definition:

    aws ecs register-task-definition --cli-input-json file://fargate-task-definition.json

Step 4: Create the service

Create a service configuration file to define networking and launch settings for Fargate.

  1. Copy the following JSON into a file named fargate-service.json:

    {
    "cluster": "harness-delegate-fargate-cluster",
    "serviceName": "harness-delegate-fargate-service",
    "taskDefinition": "harness-delegate-fargate-task",
    "launchType": "FARGATE",
    "desiredCount": 1,
    "networkConfiguration": {
    "awsvpcConfiguration": {
    "subnets": [
    "PUT_YOUR_SUBNET_ID"
    ],
    "securityGroups": [
    "PUT_YOUR_SECURITY_GROUP_ID"
    ],
    "assignPublicIp": "ENABLED"
    }
    },
    "platformVersion": "LATEST",
    "schedulingStrategy": "REPLICA"
    }
  2. Replace the placeholder values:

    FieldDescription
    PUT_YOUR_SUBNET_IDThe subnet ID where the task should run. Use a public subnet if assignPublicIp is ENABLED, or a private subnet with NAT Gateway if DISABLED
    PUT_YOUR_SECURITY_GROUP_IDA security group ID that allows outbound traffic to the internet (required for the delegate to communicate with Harness)
    Security Best Practice

    For production deployments, use "assignPublicIp": "DISABLED" and place the task in a private subnet with a NAT Gateway. This ensures the delegate only has outbound connectivity to Harness and is not exposed to the public internet. The example above uses ENABLED for simplicity in getting started.

  3. Find your subnet and security group IDs:

    List available subnets:

    aws ec2 describe-subnets --query "Subnets[*].[SubnetId,VpcId,AvailabilityZone,CidrBlock]" --output table

    List security groups:

    aws ec2 describe-security-groups --query "SecurityGroups[*].[GroupId,GroupName,VpcId]" --output table
  4. Create the service:

    aws ecs create-service --cli-input-json file://fargate-service.json

Step 5: Verify the delegate

  1. Check the service status:

    aws ecs describe-services \
    --cluster harness-delegate-fargate-cluster \
    --services harness-delegate-fargate-service
  2. Go to your Harness account.

  3. Navigate to Project Settings > Delegates.

  4. Verify that your delegate (named fargate-delegate) appears in the list with a Connected status.

    Delegate connected in Harness


Configure the delegate

After the delegate is installed, you can configure additional settings using environment variables in the task definition.

Common environment variables

VariableDescriptionRequired
HARNESS_ACCOUNT_IDYour Harness account IDYes
HARNESS_TOKENDelegate token for authenticationYes
HARNESS_URLHarness platform URLYes
HARNESS_NAMEName for the delegateNo (defaults to harness-delegate)
HARNESS_TAGSComma-separated list of tags for the delegate (e.g., aws,ecs,production)No

For more configuration options, go to Configure a Delegate.


Configure advanced settings

Security contexts

When the delegate executes CI/CD tasks, you can configure security contexts for task containers. These settings control container privileges and security options.

info

Security contexts are configured through the Harness platform when defining pipeline steps, not in the delegate's task definition itself.

FieldDescriptionFargateEC2
privilegedRun container in privileged mode with extended permissions❌ Not supported✅ Supported
read_only_root_filesystemMount the container's root filesystem as read-only✅ Supported✅ Supported
run_as_userUID to run the container process as✅ Supported✅ Supported
run_as_groupGID to run the container process as✅ Supported✅ Supported
add_capabilityLinux capabilities to add (e.g., NET_ADMIN, SYS_ADMIN)✅ Supported✅ Supported
drop_capabilityLinux capabilities to drop (e.g., ALL)✅ Supported✅ Supported

Example security context configuration:

When configuring a pipeline step in Harness, you can specify security settings that will be applied to the task containers:

  • Privileged containers: Required for Docker-in-Docker workflows (EC2 only)
  • Read-only root filesystem: Enhances security by preventing writes to the root filesystem
  • User/Group IDs: Run processes as non-root users for better security
  • Capabilities: Fine-grained control over Linux capabilities (e.g., add NET_ADMIN for network configuration)

Volume types

Delegate tasks can use different volume types for storing data and sharing files between containers.

EmptyDir volumes

Ephemeral storage that exists for the lifetime of the task. Useful for sharing data between containers in the same task.

FieldDescriptionFargateEC2
empty_dirEphemeral storage volumeUp to 200 GiBUnlimited (depends on instance)
size_mibOptional size in MiBMinimum 21 GiB (21,504 MiB) if specifiedN/A

Example use case: Sharing workspace files between build steps.

HostPath volumes

Bind mount from the host filesystem (EC2 only). Useful for accessing Docker socket or host directories.

FieldDescriptionFargateEC2
host_pathPath on the host to mount❌ Not supported✅ Supported
read_onlyMount as read-only❌ Not supported✅ Supported

Example use case: Mounting Docker socket (/var/run/docker.sock) for Docker-in-Docker builds.

EFS volumes

Amazon Elastic File System volumes for persistent, shared storage across multiple tasks.

FieldDescription
filesystem_idEFS filesystem ID (e.g., fs-12345678)
root_directoryRoot directory within EFS (e.g., /cache)
transit_encryptionEnable TLS encryption for data in transit
access_point_idEFS access point ID for IAM-based access control
iamUse IAM authorization for EFS access

Example use cases:

  • Persistent build caches shared across pipeline executions
  • Shared artifacts between different stages
  • Long-term storage for test results and reports

EFS volume configuration:

To use EFS volumes, ensure:

  1. The EFS filesystem is in the same VPC as your ECS tasks
  2. The security group allows NFS traffic (port 2049) from ECS tasks to EFS
  3. The task role has permissions: elasticfilesystem:ClientMount, elasticfilesystem:ClientWrite (if IAM authorization is enabled)

Update the delegate

To update the delegate to a new version:

  1. Update the image field in your task definition JSON file to the latest delegate version:

    "image": "us-docker.pkg.dev/gar-prod-setup/harness-public/harness/delegate:3.0.0"

    Check the Harness release notes for the latest version number.

  2. Register the new task definition:

    For ECS (EC2):

    aws ecs register-task-definition --cli-input-json file://task-definition.json

    For Fargate:

    aws ecs register-task-definition --cli-input-json file://fargate-task-definition.json
  3. Update the service to use the new task definition:

    For ECS (EC2):

    aws ecs update-service \
    --cluster harness-delegate-cluster \
    --service harness-delegate-service \
    --task-definition harness-delegate-task \
    --force-new-deployment

    For Fargate:

    aws ecs update-service \
    --cluster harness-delegate-fargate-cluster \
    --service harness-delegate-fargate-service \
    --task-definition harness-delegate-fargate-task \
    --force-new-deployment

Troubleshooting

Delegate does not appear in Harness

  • Verify that the HARNESS_ACCOUNT_ID, HARNESS_TOKEN, and HARNESS_URL values are correct.
  • Check CloudWatch Logs for error messages:
    aws logs tail /ecs/harness-delegate --follow
  • Ensure the security group allows outbound HTTPS traffic (port 443).

Task fails to start on Fargate

Common causes:

  • Execution role ARN is incorrect: Verify that the execution role ARN in your task definition matches the actual role in your AWS account.
  • Subnets lack internet access: Check that your subnets have a route to the internet (either via an Internet Gateway for public subnets or NAT Gateway for private subnets).
  • CloudWatch Logs permissions error: If you see ResourceInitializationError: failed to validate logger args or AccessDeniedException: User is not authorized to perform: logs:CreateLogGroup, the execution role lacks permissions to create log groups.

Solution for CloudWatch Logs error:

Create the log group manually before starting the service:

aws logs create-log-group --log-group-name /ecs/harness-delegate-fargate --region us-east-1

Then force a new deployment:

aws ecs update-service \
--cluster YOUR_CLUSTER_NAME \
--service YOUR_SERVICE_NAME \
--force-new-deployment \
--region us-east-1

To diagnose task failures:

View stopped task details to see the exact error:

aws ecs describe-tasks \
--cluster YOUR_CLUSTER_NAME \
--tasks $(aws ecs list-tasks --cluster YOUR_CLUSTER_NAME --service-name YOUR_SERVICE_NAME --desired-status STOPPED --region us-east-1 --query 'taskArns[0]' --output text) \
--region us-east-1 \
--query 'tasks[0].stoppedReason'

Delegate disconnects frequently

  • Ensure the task has sufficient CPU and memory resources.
  • Check for network connectivity issues between the ECS task and Harness.

CloudWatch Logs rate limit errors

If you're running many concurrent tasks and see ThrottlingException or ResourceAlreadyExistsException errors related to log groups:

Problem: AWS CloudWatch Logs has API rate limits:

  • CreateLogGroup: 5 requests per second
  • CreateLogStream: 50 requests per second
  • PutLogEvents: 800 requests per second per log group

Solution: Use a shared log group instead of creating individual log groups per task. Update your task definition:

{
"logConfiguration": {
"logDriver": "awslogs",
"options": {
"awslogs-group": "/ecs/harness-delegates",
"awslogs-region": "YOUR_AWS_REGION",
"awslogs-stream-prefix": "delegate"
}
}
}

Then create the shared log group once:

aws logs create-log-group --log-group-name /ecs/harness-delegates --region YOUR_AWS_REGION

This allows multiple delegate tasks to write to the same log group, avoiding rate limit issues.


For additional help, contact Harness Support.