Feature-Fluid Compute Pricing

Open
#72 0 comments 6 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
20/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Stale
Tech stack
aws
Domain
cloud

Research direction

Start by reviewing the linked AWS Lambda roadmap issues and the Vercel Fluid Compute Pricing documentation. The issue does not name files, tests, or an implementation entry point; first establish the intended pricing model, scope, and relationship to those existing issues. Done would require an accepted product and implementation direction, not a self-contained code change.

Written by the indexing model from the issue text.

Description

Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do * not help prioritize the request
    If you are interested in providing additional feedback, please leave a comment

Description
When calling 3rd party services such as LLMs, the lambda sits blocked on the network read, which customers are charged for, while that CPU is very likely doing other useful work. This at least is my understanding, and this doesn't seem right.

Vercel has added a variant of this called 'Fluid Compute Pricing' (on top of Lambda??): https://vercel.com/docs/functions/usage-and-pricing

Lambda should natively support this! And better i'm sure.

Additional context
Some of the other issues might be related to this in theory so happy to see this closed if other use cases take on this fundamental shift;

https://github.com/aws/aws-lambda-roadmap/issues/57
https://github.com/aws/aws-lambda-roadmap/issues/16

Dominant language
No language data
Stars
196
Forks
5
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from aws/aws-lambda-roadmap

All issues in aws/aws-lambda-roadmap

Similar issues

More Cloud issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.