Skip to content
Putting technology to work.
Insights to guide decisions and action.

Search articles

OpenAI models officially launch on AWS Marketplace — Contract architecture for running OpenAI on AWS 2026

Table of contents · 7 items

OpenAI announced that "OpenAI models, Codex, and Managed Agents come to AWS," making OpenAI's flagship model family, Codex, and Managed Agents officially available via AWS Marketplace. For Japanese enterprise clients wishing to consolidate governance, contracting, and billing under AWS, this marks a pivotal turning point where "OpenAI can finally clear internal approval."

Previously, customers looking to adopt OpenAI in production had to "contract directly with OpenAI while simultaneously battling internal regulations regarding outbound data transfers via AWS," making internal approval an extraordinarily high hurdle. This article outlines key architectural considerations for designing custom development offerings to "adopt OpenAI via AWS Marketplace."

What changed — Shifts from a custom development perspective

Here are the shifts highlighted in the official announcement that impact custom development.

DimensionPrevious (through early 2026)New (late April 2026 onward)Impact on custom development
Contract channelDirect contract with OpenAI was mandatoryCan be contracted via AWS MarketplaceCan be consolidated into existing AWS invoices
Data perimeterVia OpenAI infrastructureCan select pathways that remain entirely within the customer's AWS regionCross-border data concerns are significantly mitigated
IAM integrationSeparate system (OpenAI Org / API keys)Unified authentication via AWS IAM rolesAuditing and offboarding are unified through AWS
Codex deploymentDirectly via OpenAICodex execution environment running on AWSEasier to pass enterprise internal approval
Managed AgentsHosted by OpenAIManaged Agents operated within AWSData remains within the customer's VPC boundary
Billing currency and tax handlingDirectly in USDJPY invoicing possible via AWS MarketplaceAccounting workflows are dramatically simplified

In particular, the capability to "call OpenAI using AWS IAM roles" structurally resolves the persistent custom development headache of "how to store and distribute OpenAI API keys." Representing an OpenAI equivalent to the "design without static API keys" covered in HashiCorp Vault 2.0 and Identity Federation, this removes the single greatest barrier to enterprise adoption.

Why "OpenAI via AWS" resonates with Japanese enterprises

Examining the internal approval structures of domestic enterprises illuminates the profound impact of this shift.

Internal approval aspectHurdle under the previous schemeResolution under the new scheme
Contracts and billingAccounting teams resisted direct USD contracts with OpenAICan be processed as a line item on existing AWS contracts
Cross-border data transferConcerns that "data is transmitted to the US the moment it reaches OpenAI"Option available to keep data within AWS regions
Audit logsRequired separate collection and retention mechanismsConsolidated into CloudWatch / CloudTrail
OffboardingRequired individual revocation of API keysCompleted by revoking AWS IAM roles
Terms of service reviewDual reviews of OpenAI terms + AWS termsStandard AWS Marketplace terms of service

Particularly in regulated sectors like finance, insurance, and healthcare, "cross-border data transfer" and "contract centralization" were the highest hurdles for internal approval. Routing through AWS Marketplace clears both barriers, making OpenAI adoption viable even for industries that had previously ruled it out.

Adoption architecture for "OpenAI on AWS" to build for clients

Here is the standardized architecture we developed for adopting OpenAI on AWS.

┌─────────────────────────────────────────────────────┐
│  顧客 AWS アカウント                                   │
│                                                       │
│   ┌──────────────────┐   ┌──────────────────────┐   │
│   │ AWS Marketplace  │   │ OpenAI Models /      │   │
│   │ 経由の OpenAI 契約 │←─│ Codex / Managed      │   │
│   └──────────────────┘   │ Agents(AWS 内)       │   │
│           ↑               └──────────────────────┘   │
│           │                          ↑               │
│   ┌───────┴──────────┐      ┌────────┴─────────┐    │
│   │ IAM ロール        │      │ VPC 内のアプリ     │    │
│   │ + Identity        │←────│ (Lambda / ECS)   │    │
│   │ Center 連携       │      └──────────────────┘    │
│   └──────────────────┘                                │
│           ↑                                           │
│   ┌───────┴──────────┐      ┌──────────────────┐    │
│   │ CloudTrail /      │      │ KMS / Secrets    │    │
│   │ CloudWatch Logs   │      │ Manager         │    │
│   │ (全呼び出しを保管) │      └──────────────────┘    │
│   └──────────────────┘                                │
└─────────────────────────────────────────────────────┘

The critical element is that "OpenAI API invocations remain entirely within the customer's VPC boundary." This eliminates internal approval concerns surrounding cross-border data transfers.

Step 1: Contract OpenAI via AWS Marketplace

Purchase OpenAI subscriptions via AWS Marketplace from the customer's AWS account. From a custom development perspective, an arrangement where "the contract is executed under the customer's account while our team manages licensing operations on their behalf" runs smoothly, consolidating payments into the customer's existing AWS invoice.

Step 2: Enable OpenAI invocations via IAM roles

When invoking OpenAI from applications, authenticate using IAM roles rather than API keys. Grant OpenAI invocation permissions to Lambda, ECS, or EC2 service roles, completely eliminating static API keys.

# Terraform で OpenAI 呼び出し用ロールを定義
resource "aws_iam_role" "openai_invoker" {
  name = "openai-invoker-${var.env}"

  assume_role_policy = jsonencode({
    Version = "2012-10-17"
    Statement = [{
      Effect = "Allow"
      Principal = { Service = "lambda.amazonaws.com" }
      Action = "sts:AssumeRole"
    }]
  })
}

resource "aws_iam_role_policy" "openai_invoke" {
  role = aws_iam_role.openai_invoker.id
  policy = jsonencode({
    Version = "2012-10-17"
    Statement = [{
      Effect = "Allow"
      Action = [
        "openai:InvokeModel",
        "openai:InvokeAgent",
        "openai:RunCodexJob"
      ]
      Resource = "*"
      Condition = {
        StringEquals = {
          "aws:RequestedRegion" = var.allowed_regions
        }
      }
    }]
  })
}

Enforcing regional restrictions with Condition prevents cross-border data transfer right at the Terraform level.

Step 3: Capture all invocations in CloudTrail audit logs

OpenAI calls are recorded as DataEvents in CloudTrail. This allows every detail of "who sent what to OpenAI and when" to be audited via standard AWS logs.

# CloudTrail で OpenAI 呼び出しを記録する設定
DataEvents:
  - ResourceType: "AWS::OpenAI::Model"
    Values:
      - "arn:aws:openai:::model/*"
    EventSelector: "All"

This is indispensable for custom development to "fulfill accountability requirements," placing teams in a position to answer immediately with "everything is recorded in CloudTrail" when customers ask whether OpenAI transmissions can be audited after the fact.

Step 4: Manage encryption keys for sensitive data with KMS

Prompts and stored conversation histories are encrypted using customer KMS keys before being handed to OpenAI. With the AWS Marketplace edition, direct integration between KMS and OpenAI allows sensitive internal data to be passed to OpenAI while remaining encrypted.

Comparison with competitors and alternatives

Enterprise customers have multiple options for adopting AI. Here is where "OpenAI via AWS" fits into the landscape.

OptionStrengthsWeaknessesTarget clientele
OpenAI via AWS (this article)Consolidated into existing AWS contracts; IAM integrationUnit pricing is slightly higher than direct OpenAI contractsEnterprises primarily built on AWS
Azure OpenAI ServiceEquivalent Azure integration has long been matureRequires an Azure environmentEnterprises centered around Microsoft 365
AWS BedrockIntegrated offering of Claude, Mistral, and CohereDoes not include OpenAI modelsEnterprises seeking to evaluate multiple providers
Direct contract with OpenAIImmediate access to latest models; lowest unit priceCross-border data concerns; dual contractsStartups
On-premises LLMData never leaves the companyHigh construction costs; lags behind in model recencyEnterprises handling highly sensitive information

OpenAI via AWS occupies a position that seeks the "best of both worlds" among Azure, Bedrock, and direct contracts, serving as the optimal answer especially for enterprises that "already run primarily on AWS and want to utilize the latest OpenAI models."

Five pitfalls easy to stumble into in custom development

Pitfall 1: Incorrect region selection

Designing under the assumption that OpenAI could be used in the Tokyo region, only to discover it was not among supported regions. Verify regional availability before contracting, and if unavailable, align with the customer regarding data transfers to us-east-1.

Pitfall 2: AWS Marketplace contract ownership

In organizations where AWS accounts are partitioned by department, accidents occur where "the contracting department differs from the user department." Configure centralized Marketplace license management in AWS Organizations on Day 1.

Pitfall 3: Managed Agents rollout strategy

Because Managed Agents run on AWS, the risk increases that "a malfunctioning agent could misconfigure customer AWS resources." Minimize scope with dedicated IAM roles and configure "all destructive actions to require approval." This aligns with the philosophy of "never handing destructive operations directly to AI" covered in Guardrails for AI Agents Against Production Database Deletion.

Pitfall 4: Behavioral drift during model updates

OpenAI models change behavior over a span of months. Build an operational cadence of "pinning model versions → running monthly evaluation harnesses → executing planned migrations."

Pitfall 5: Cost ceiling design

Even with low per-token pricing, runaway parallel jobs can burn through millions of yen overnight. Deploy AWS Budgets with alerts + an automated shutdown Lambda upon budget overrun by default.

Summary — "OpenAI on AWS" is a core custom development service line

OpenAI's official entry into AWS Marketplace makes it far easier for custom development offerings that "deploy OpenAI into production for enterprise clients" to clear internal approval hurdles. This represents a major milestone that broadens options for Japanese enterprises, where Azure OpenAI was previously the sole contender.

We package our "OpenAI on AWS Deployment" custom development services aligned with the standard architecture in this article into Starter, Standard, and Enterprise plans. If you want to adopt OpenAI in an AWS-centric corporate environment or switch from direct OpenAI contracts to AWS-based billing, please feel free to reach out via our contact form.

Sources

Share this articleXFacebook
Kakeru Suzuki

Fascinated by the possibilities of technology, has had a deep interest in programming and digital art since student days

Turn this article's theme into your company's next step

Concrete steps forward for your organization.

We organize your desired architecture, legacy systems, and operational requirements to formulate your next steps toward execution.

  • Desired architecture
  • Integration with existing environments
  • Operational requirements
Consult on development & operations initiatives

You can consult with us from the initial conceptual stage. Details from this article will be carried over to the inquiry form.

Receive the latest articles by email