Skip to content

feat!: apps SDK, decorator-native GPU compute with live dev sessions and a new rp CLI#534

Open
KAJdev wants to merge 86 commits into
mainfrom
feat/apps-sdk
Open

feat!: apps SDK, decorator-native GPU compute with live dev sessions and a new rp CLI#534
KAJdev wants to merge 86 commits into
mainfrom
feat/apps-sdk

Conversation

@KAJdev

@KAJdev KAJdev commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

This is the successor to runpod-flash, folded into the core runpod package. I know this is absolutely massive but its a port of all existing flash features plus whole new App, Model, and Secret classes, @app.task decorator for running ephemeral pods, new runtimes, and shims for injecting into custom images. (with 90% test coverage!)

Completes CON-652

app = runpod.App("inference")

@app.queue(gpu="H100", workers=(0, 3), dependencies=["vllm"], model=llama)
def chat(prompt: str): ...

chat.remote("why is the sky blue?") 

For existing Flash users

  • Same control plane. Apps, environments, and builds are the same platform objects (flashApps, flashEnvironments, flashBuilds). Deployed Flash apps keep running, and this client can see and manage them (rp app list, rp undeploy).
  • The decorator surface maps directly. @remote(...) shapes become @app.queue, @app.api, and @app.task, with full config parity
  • migration should be as simple as: rename decorators, pip install runpod, rp deploy. A migration guide should land in docs alongside the release.
  • new Secret() and Model() classes, + custom image support

Release checklist

  • runpod/host#2508 merged (autocache runtime images on hosts)
  • PyPI release including runpod.runtimes (e2e 12_custom_image currently pins the branch tarball via RUNPOD_PACKAGE_SPEC)
  • Flash migration guide in docs; deprecation notice on runpod-flash
  • Changelog: runpod config, exec, and project CLI commands removed; rp login and rp init replace them
  • Post-release: verify rp update against the published version, drop the tarball note from the e2e README

Breaking changes

  • CLI: config, exec, and project command groups removed; ssh list-keys and add-key renamed to ssh list and add
  • Python API: additive only. Existing runpod.serverless, Endpoint, and ctl commands are unchanged.

KAJdev added 30 commits July 1, 2026 15:09
@capy-ai

capy-ai Bot commented Jul 9, 2026

Copy link
Copy Markdown

Capy auto-review is paused for this organization because the usage-cycle auto-review limit has been reached. Increase the limit or turn it off in billing settings to resume automatic reviews.

Comment thread runpod/apps/api.py Fixed
Comment thread runpod/apps/targets.py Fixed
Comment thread tests/test_apps/test_model.py Fixed
Comment thread tests/test_apps/test_tasks.py Fixed
Comment thread runpod/apps/discovery.py Dismissed
Comment thread runpod/rp_cli/main.py Dismissed
Comment thread runpod/apps/gpu.py Dismissed
Comment thread runpod/rp_cli/main.py Dismissed
Comment thread runpod/rp_cli/main.py Dismissed
Comment thread runpod/runtimes/task/runner.py Fixed
@KAJdev KAJdev changed the title feat: apps SDK, decorator-native GPU compute with live dev sessions and a new rp CLI feat!: apps SDK, decorator-native GPU compute with live dev sessions and a new rp CLI Jul 9, 2026

@github-advanced-security github-advanced-security AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CodeQL found more than 20 potential problems in the proposed changes. Check the Files changed tab for more details.

@promptless

promptless Bot commented Jul 9, 2026

Copy link
Copy Markdown

Promptless prepared a documentation update related to this change.

Triggered by runpod-python PR #534

This PR introduces the apps SDK (successor to runpod-flash, folded into the core runpod package) and the new unified rp CLI. The draft adds a Flash → apps SDK migration guide, deprecation notices on the existing Flash docs, a nav entry, and a release-gated (commented-out) changelog entry. It's scoped as a release-gated draft since the apps SDK isn't published to PyPI yet.

Review: Apps SDK + Flash → apps SDK migration guide

Comment thread runpod/runtimes/task/runner.py Fixed
Comment thread runpod/apps/tasks.py Dismissed
Comment thread runpod/rp_cli/update.py Dismissed
Comment thread runpod/apps/watch.py Dismissed
@KAJdev

KAJdev commented Jul 9, 2026

Copy link
Copy Markdown
Contributor Author

@capy-ai review

@KAJdev KAJdev requested a review from deanq July 9, 2026 20:32
@KAJdev KAJdev assigned jhcipar and unassigned jhcipar Jul 9, 2026
@KAJdev KAJdev requested a review from jhcipar July 9, 2026 20:33
Comment thread runpod/runtimes/executor.py Dismissed
Comment thread runpod/runtimes/executor.py Dismissed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants