AWS Lambda Web AdapterとFastAPIで作る!Amazon BedrockのストリームAPIを使ったチャットアプリ

$ git clone https://github.com/awslabs/aws-lambda-web-adapter.git
$ cd aws-lambda-web-adapter/examples/fastapi-response-streaming
$ tree .
.
├── README.md
├── app
│   ├── Dockerfile
│   ├── main.py
│   ├── requirements.txt
│   └── static
│       ├── index.html
│       ├── script.js
│       └── style.css
├── imgs
│   ├── demo.gif
│   └── serverless-storyteller-architecture.png
└── template.yaml

botocore.errorfactory.AccessDeniedException: An error occurred (AccessDeniedException) when calling the InvokeModelWithResponseStream operation: You don't have access to the model with the specified model ID.

$ brew install uv
$ uv --version
uv 0.5.2 (Homebrew 2024-11-14)

$ git clone https://github.com/awslabs/aws-lambda-web-adapter.git
$ cd aws-lambda-web-adapter/examples/fastapi-response-streaming

$ uv init --app --python 3.12
Initialized project `fastapi-response-streaming`

$ uv add -r app/requirements.txt
Using CPython 3.12.3 interpreter at: /usr/bin/python3.12
Creating virtual environment at: .venv
...
 + uvicorn==0.23.2
$ cd app/
$ uv run main.py
INFO:     Started server process [18764]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)

INFO:     1.2.3.4:2809 - "POST /api/story HTTP/1.1" 200 OK

FROM public.ecr.aws/docker/library/python:3.12.0-slim-bullseye
COPY --from=public.ecr.aws/awsguru/aws-lambda-adapter:0.8.4 /lambda-adapter /opt/extensions/lambda-adapter

WORKDIR /app
ADD . .
RUN pip install -r requirements.txt

CMD ["python", "main.py"]

$ sam build
$ sam deploy --guided

AWSTemplateFormatVersion: '2010-09-09'
Transform: AWS::Serverless-2016-10-31
Description: >
  Streaming Bedrock Response with FastAPI on AWS Lambda

# More info about Globals: https://github.com/awslabs/serverless-application-model/blob/master/docs/globals.rst
Globals:
  Function:
    Timeout: 300

Resources:
  FastAPIFunction:
    Type: AWS::Serverless::Function
    Properties:
      PackageType: Image
      MemorySize: 512
      Environment:
        Variables:
          AWS_LWA_INVOKE_MODE: RESPONSE_STREAM
      FunctionUrlConfig:
        AuthType: NONE
        InvokeMode: RESPONSE_STREAM
      Policies:
      - Statement:
        - Sid: BedrockInvokePolicy
          Effect: Allow
          Action:
          - bedrock:InvokeModelWithResponseStream
          Resource: '*'
      Tracing: Active
    Metadata:
      Dockerfile: Dockerfile
      DockerContext: ./app
      DockerTag: v1

Outputs:
  FastAPIFunctionUrl:
    Description: "Function URL for FastAPI function"
    Value: !GetAtt FastAPIFunctionUrl.FunctionUrl
  FastAPIFunction:
    Description: "FastAPI Lambda Function ARN"
    Value: !GetAtt FastAPIFunction.Arn