troubleshooting-astro-deployments

Astro Deployment Troubleshooting

This skill helps you diagnose and troubleshoot production Astronomer deployments using the Astro CLI.

For deployment management, see the managing-astro-deployments skill. For local development, see the managing-astro-local-env skill.

Quick Health Check

Start with these commands to get an overview:

# 1. List deployments to find target
astro deployment list
 
# 2. Get deployment overview
astro deployment inspect <DEPLOYMENT_ID>
 
# 3. Check for errors

Viewing Deployment Logs

Use -c to control log count (default: 500). Log flags cannot be combined — use one component or level flag per command.

Component-Specific Logs

View logs from specific Airflow components:

Log Level Filtering

Filter by severity:

Search Logs

Search for specific keywords:

Complete Investigation Workflow

Step 1: Identify the Problem

Look for:

Status: HEALTHY vs UNHEALTHY
Runtime version compatibility
Resource limits (CPU, memory)
Recent deployment timestamp

Step 2: Check Error Logs

Look for:

Recurring error patterns
Specific DAGs failing repeatedly
Import errors or syntax errors
Connection or credential errors

Step 3: Review Scheduler Logs

Look for:

DAG parse errors
Scheduling delays
Task queueing issues

Step 4: Check Worker Logs

Look for:

Task execution failures
Resource exhaustion
Timeout errors

Step 5: Verify Configuration

Look for:

Missing or incorrect environment variables
Secrets configuration (AIRFLOW__SECRETS__BACKEND)
Connection configuration

Common Investigation Patterns

Recurring DAG Failures

Follow the complete investigation workflow above, then narrow to the specific DAG:

Resource Issues

Configuration Problems

Import Errors

Environment Variables Management

List Variables

Create Variables

Update Variables

Delete Variables

Note: Variables are available to DAGs as environment variables. Changes require no redeployment.

Key Metrics from `deployment inspect`

Focus on these fields when troubleshooting:

status: HEALTHY vs UNHEALTHY
runtime_version: Airflow version compatibility
scheduler_size/scheduler_count: Scheduler capacity
executor: CELERY, KUBERNETES, or LOCAL
worker_queues: Worker scaling limits and types
- min_worker_count, max_worker_count
- worker_concurrency
- worker_type (resource class)
resource_quota_cpu/memory: Overall resource limits
dag_deploy_enabled: Whether DAG-only deploys work
current_tag: Last deployment version
is_high_availability: Redundancy enabled

Investigation Best Practices

Always start with error logs - Most obvious failures appear here
Check error logs for patterns - Same DAG failing repeatedly? Timing patterns?
Component-specific troubleshooting:
- Worker logs → task execution details
- Scheduler logs → DAG processing and scheduling
- Webserver logs → UI issues and health checks
- Triggerer logs → deferrable operator issues
Use --keyword for targeted searches - More efficient than reading all logs
The inspect command is your health dashboard - Check it first
Environment variables in inspect output - May reveal configuration issues
Log count default is 500 - Adjust with -c based on needs
Don't forget to check deployment time - Recent deploy might have introduced issue

Troubleshooting Quick Reference

Symptom	Command
Deployment shows UNHEALTHY	`astro deployment inspect <ID>` + `--error` logs
DAG not appearing	`--error` logs for import errors, check `--scheduler` logs
Tasks failing	`--workers` logs + search for DAG with `--keyword`
Slow scheduling	`--scheduler` logs + check `inspect` for scheduler resources
UI not responding	`--webserver` logs
Connection issues	Check variables, search logs for connection name
Import errors	`--error --keyword "ImportError"` + `--scheduler` logs
Out of memory	`inspect` for resources + `--workers --keyword "memory"`

managing-astro-deployments: Create, update, delete deployments, deploy code
managing-astro-local-env: Manage local Airflow development environment
setting-up-astro-project: Initialize and configure Astro projects

Astro Deployment Troubleshooting

This skill helps you diagnose and troubleshoot production Astronomer deployments using the Astro CLI.

For deployment management, see the managing-astro-deployments skill. For local development, see the managing-astro-local-env skill.

Quick Health Check

Start with these commands to get an overview:

# 1. List deployments to find target
astro deployment list
 
# 2. Get deployment overview
astro deployment inspect <DEPLOYMENT_ID>
 
# 3. Check for errors

Viewing Deployment Logs

Use -c to control log count (default: 500). Log flags cannot be combined — use one component or level flag per command.

Component-Specific Logs

View logs from specific Airflow components:

Log Level Filtering

Filter by severity:

Search Logs

Search for specific keywords:

Complete Investigation Workflow

Step 1: Identify the Problem

Look for:

Status: HEALTHY vs UNHEALTHY
Runtime version compatibility
Resource limits (CPU, memory)
Recent deployment timestamp

Step 2: Check Error Logs

Look for:

Recurring error patterns
Specific DAGs failing repeatedly
Import errors or syntax errors
Connection or credential errors

Step 3: Review Scheduler Logs

Look for:

DAG parse errors
Scheduling delays
Task queueing issues

Step 4: Check Worker Logs

Look for:

Task execution failures
Resource exhaustion
Timeout errors

Step 5: Verify Configuration

Look for:

Missing or incorrect environment variables
Secrets configuration (AIRFLOW__SECRETS__BACKEND)
Connection configuration

Common Investigation Patterns

Recurring DAG Failures

Follow the complete investigation workflow above, then narrow to the specific DAG:

Resource Issues

Configuration Problems

Import Errors

Environment Variables Management

List Variables

Create Variables

Update Variables

Delete Variables

Note: Variables are available to DAGs as environment variables. Changes require no redeployment.

Key Metrics from `deployment inspect`

Focus on these fields when troubleshooting:

status: HEALTHY vs UNHEALTHY
runtime_version: Airflow version compatibility
scheduler_size/scheduler_count: Scheduler capacity
executor: CELERY, KUBERNETES, or LOCAL
worker_queues: Worker scaling limits and types
- min_worker_count, max_worker_count
- worker_concurrency
- worker_type (resource class)
resource_quota_cpu/memory: Overall resource limits
dag_deploy_enabled: Whether DAG-only deploys work
current_tag: Last deployment version
is_high_availability: Redundancy enabled

Investigation Best Practices

Always start with error logs - Most obvious failures appear here
Check error logs for patterns - Same DAG failing repeatedly? Timing patterns?
Component-specific troubleshooting:
- Worker logs → task execution details
- Scheduler logs → DAG processing and scheduling
- Webserver logs → UI issues and health checks
- Triggerer logs → deferrable operator issues
Use --keyword for targeted searches - More efficient than reading all logs
The inspect command is your health dashboard - Check it first
Environment variables in inspect output - May reveal configuration issues
Log count default is 500 - Adjust with -c based on needs
Don't forget to check deployment time - Recent deploy might have introduced issue

Troubleshooting Quick Reference

Symptom	Command
Deployment shows UNHEALTHY	`astro deployment inspect <ID>` + `--error` logs
DAG not appearing	`--error` logs for import errors, check `--scheduler` logs
Tasks failing	`--workers` logs + search for DAG with `--keyword`
Slow scheduling	`--scheduler` logs + check `inspect` for scheduler resources
UI not responding	`--webserver` logs
Connection issues	Check variables, search logs for connection name
Import errors	`--error --keyword "ImportError"` + `--scheduler` logs
Out of memory	`inspect` for resources + `--workers --keyword "memory"`

managing-astro-deployments: Create, update, delete deployments, deploy code
managing-astro-local-env: Manage local Airflow development environment
setting-up-astro-project: Initialize and configure Astro projects

troubleshooting-astro-deployments

Documentation

Documentation

Astro Deployment Troubleshooting

Quick Health Check

Viewing Deployment Logs

Component-Specific Logs

Log Level Filtering

Search Logs

Complete Investigation Workflow

Step 1: Identify the Problem

Step 2: Check Error Logs

Step 3: Review Scheduler Logs

Step 4: Check Worker Logs

Step 5: Verify Configuration

Common Investigation Patterns

Recurring DAG Failures

Resource Issues

Configuration Problems

Import Errors

Environment Variables Management

List Variables

Create Variables

Update Variables

Delete Variables

Key Metrics from deployment inspect

Investigation Best Practices

Troubleshooting Quick Reference

Related Skills

Documentation

troubleshooting-astro-deployments

Documentation

Astro Deployment Troubleshooting

Quick Health Check

Viewing Deployment Logs

Component-Specific Logs

Log Level Filtering

Search Logs

Complete Investigation Workflow

Step 1: Identify the Problem

Step 2: Check Error Logs

Step 3: Review Scheduler Logs

Step 4: Check Worker Logs

Step 5: Verify Configuration

Common Investigation Patterns

Recurring DAG Failures

Resource Issues

Configuration Problems

Import Errors

Environment Variables Management

List Variables

Create Variables

Update Variables

Delete Variables

Key Metrics from deployment inspect

Investigation Best Practices

Troubleshooting Quick Reference

Related Skills

Key Metrics from `deployment inspect`

Key Metrics from `deployment inspect`