aws-lambda-python-integration

AWS Lambda Python Integration

Patterns for creating high-performance AWS Lambda functions in Python with optimized cold starts and clean architecture.

Overview

AWS Lambda Python integration with two approaches: AWS Chalice (full-featured framework) and Raw Python (minimal overhead). Both support API Gateway/ALB integration with production-ready configurations.

When to Use

Use this skill when:

• Creating new Lambda functions in Python
• Migrating existing Python applications to Lambda
• Optimizing cold start performance for Python Lambda
• Choosing between framework-based and minimal Python approaches
• Configuring API Gateway or ALB integration
• Setting up deployment pipelines for Python Lambda

Instructions

1. Choose Your Approach

2. Project Structure

AWS Chalice Structure

my-chalice-app/
├── app.py                    # Main application with routes
├── requirements.txt          # Dependencies
├── .chalice/
│   ├── config.json          # Chalice configuration
│   └── deploy/              # Deployment artifacts
├── chalicelib/              # Additional modules
│   ├── __init__.py
│   └── services.py
└── tests/
    └── test_app.py

Raw Python Structure

3. Implementation Examples

See the References section for detailed implementation guides. Quick examples:

AWS Chalice:

Raw Python:

Core Concepts

Cold Start Optimization

Key strategies:

1. Initialize at module level - Persists across warm invocations
2. Use lazy loading - Defer heavy imports until needed
3. Cache boto3 clients - Reuse connections between invocations

See Raw Python Lambda for detailed patterns.

Connection Management

Create clients at module level and reuse:

Environment Configuration

Best Practices

Memory and Timeout Configuration

• Memory: Start with 256MB for simple handlers, 512MB for complex operations
• Timeout: Set based on expected processing time
  • Simple handlers: 3-5 seconds
  • API with DB calls: 10-15 seconds
  • Data processing: 30-60 seconds

Dependencies

Keep requirements.txt minimal:

Error Handling

Return proper HTTP codes with request ID:

See Raw Python Lambda for structured error patterns.

Logging

Use structured logging for CloudWatch Insights:

See Raw Python Lambda for advanced patterns.

Deployment Options

Quick Start

Validation Checkpoint: Always run serverless print or sam validate before deploying to catch configuration errors early.

Serverless Framework:

AWS SAM:

AWS Chalice:

Validation Checkpoint: Test locally with chalice local or sam local invoke before deploying to production.

For complete deployment configurations including CI/CD, environment-specific settings, and advanced SAM/Serverless patterns, see Serverless Deployment.

Constraints and Warnings

Lambda Limits

• Deployment package: 250MB unzipped maximum (50MB zipped)
• Memory: 128MB to 10GB
• Timeout: 15 minutes maximum
• Concurrent executions: 1000 default (adjustable)
• Environment variables: 4KB total size

Python-Specific Considerations

• Cold start: Python has excellent cold start performance; avoid heavy imports at module level
• Dependencies: Keep requirements.txt minimal; use Lambda Layers for shared dependencies
• Native dependencies: Must be compiled for Amazon Linux 2 (x86_64 or arm64)

Common Pitfalls

1. Importing heavy libraries at module level - Defer to function level if not always needed
2. Not handling Lambda context - Use context.get_remaining_time_in_millis() for timeout awareness
3. Not validating input - Always validate and sanitize event data
4. Printing sensitive data - Be careful with logs and CloudWatch

Error Recovery: If deployment fails, check CloudWatch logs for initialization errors and run sam logs to diagnose issues.

Security Considerations

• Never hardcode credentials; use IAM roles and environment variables
• Validate all input data
• Use least privilege IAM policies
• Enable CloudTrail for audit logging

References

For detailed guidance on specific topics:

• AWS Chalice - Complete Chalice setup, routing, middleware, deployment
• Raw Python Lambda - Minimal handler patterns, module caching, packaging
• Serverless Deployment - Serverless Framework, SAM, CI/CD pipelines
• Testing Lambda - pytest, moto, SAM Local, localstack

Examples

Example 1: Create an AWS Chalice REST API

Input:

Process:

1. Initialize Chalice project with chalice new-project
2. Configure routes for CRUD operations
3. Set up DynamoDB integration
4. Configure deployment stages
5. Deploy with chalice deploy

Output:

• Complete Chalice project structure
• REST API with CRUD endpoints
• DynamoDB table configuration
• Deployment configuration

Example 2: Optimize Cold Start for Raw Python

Input:

Process:

1. Analyze imports and initialization code
2. Move heavy imports inside functions (lazy loading)
3. Cache boto3 clients at module level
4. Remove unnecessary dependencies
5. Use provisioned concurrency if needed

Output:

• Refactored code with lazy loading
• Optimized cold start < 100ms
• Dependency analysis

Example 3: Deploy with GitHub Actions

Input:

Process:

1. Create GitHub Actions workflow
2. Set up Python environment and dependencies
3. Run pytest with coverage
4. Package with SAM
5. Deploy to dev/prod stages

Output:

• Complete .github/workflows/deploy.yml
• Multi-stage pipeline
• Integrated test automation

Version

Version: 1.0.0