Organizing Files and Directory Structures for AWS Deployment

Proper organization of application artifacts is a foundational requirement for successful CI/CD and automated deployments in AWS. This guide covers how to structure source code, configuration files, and dependencies to ensure compatibility with services like AWS CodeDeploy, Elastic Beanstalk, and AWS SAM.

Learning Objectives

• Design a standard root directory structure for multi-tier applications.
• Identify mandatory configuration files and their specific locations (e.g., appspec.yml, .ebextensions).
• Manage dependencies and environment-specific configurations within the package.
• Package Lambda functions and containerized applications for deployment.

Key Terms & Glossary

• Artifact: A compiled or packaged version of the source code (e.g., .zip, .war, .jar, container image) ready for deployment.
• AppSpec File: A configuration file used by AWS CodeDeploy to manage the lifecycle of a deployment.
• ebextensions: A folder containing configuration files (.config) used to customize AWS Elastic Beanstalk environments.
• Lambda Layer: A distribution mechanism for libraries and other dependencies that can be shared across multiple Lambda functions.
• Environment Variables: Key-value pairs used to pass configuration data to applications without changing the code.

The "Big Idea"

In AWS, structure is contract. Services like CodeDeploy or Elastic Beanstalk expect specific files in specific locations to perform automation. If the directory structure is incorrect, the automation "contract" is broken, leading to deployment failures. Organizing your project isn't just about tidiness; it is about providing the metadata the AWS cloud needs to provision and configure resources correctly.

Formula / Concept Box

Hierarchical Outline

1. Application Root Structure
   • Source Code: Core logic (e.g., src/ or app/).
   • Tests: Unit and integration tests (e.g., tests/).
   • Configuration: Environment-specific settings.
2. Service-Specific Artifacts
   • CodeDeploy (EC2/On-Premise): Requires appspec.yml and a scripts/ folder for lifecycle hooks.
   • Elastic Beanstalk: Uses .ebextensions/*.config for resource tweaks.
   • Serverless (SAM): Requires template.yaml and often a layer/ directory for shared code.
3. Dependency Management
   • Language-Specific: package.json (Node), requirements.txt (Python), pom.xml (Java).
   • Vendoring: Packaging dependencies directly into the zip file for Lambda if not using Layers.

Visual Anchors

Deployment Artifact Flow

Folder Structure for CodeDeploy

Definition-Example Pairs

• Lifecycle Hook: A specific point in a deployment where you can run custom scripts.
  • Example: Using the BeforeInstall hook in CodeDeploy to delete old files on an EC2 instance before copying the new version.
• Staging Variables: Values used to provide different configuration settings to different stages of a deployment.
  • Example: Passing a different Database URL to the dev stage versus the prod stage in Amazon API Gateway.
• Artifact Packaging: The act of bundling all necessary files (code + libs) into a single deliverable.
  • Example: Creating a .zip file for a Python Lambda function that includes the requests library inside the root folder.

Worked Examples

Example 1: Structuring a Multi-Tier Application

You are deploying a web application with a frontend (React) and a backend (Node.js). To avoid confusion, separate them into distinct directories within your repository.

Proposed Structure:

[!NOTE] Keeping these separate allows for independent CI/CD pipelines for the frontend and backend.

Example 2: Configuring Elastic Beanstalk Extensions

To install a specific Linux package (like git) on your Beanstalk instances, you must use a configuration file in the .ebextensions folder.

File: .ebextensions/01_packages.config

This file must be located in the .ebextensions/ folder at the root of the source bundle.

Checkpoint Questions

1. Where must the appspec.yml file be located in a CodeDeploy source bundle?
2. What is the purpose of the .ebextensions folder in an Elastic Beanstalk application?
3. True or False: A Lambda deployment package must always include its dependencies unless using Lambda Layers.
4. Which AWS service uses a template.yaml file to define serverless resources?
5. How do you manage sensitive environment variables (like API keys) across different deployment environments?

▶Click to see answers

1. The root directory.
2. To customize the EC2 environment and provision additional AWS resources.
3. True.
4. AWS SAM (Serverless Application Model).
5. Use AWS AppConfig, Secrets Manager, or Parameter Store (Systems Manager).