Skip to content
View nataliekung's full-sized avatar
1 follower · 0 following

Achievements

Achievement: Pull SharkAchievement: Arctic Code Vault Contributor

Achievements

Achievement: Pull SharkAchievement: Arctic Code Vault Contributor

Block or report nataliekung

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
nataliekung/README.md

Ray contributor. A fix I wrote for a restart crash that left a whole cluster down was merged into Ray's main codebase. → ray-project/ray#66073 → Write-up: https://gist.github.com/nataliekung/1cc47266a712b8fa1742bcde1ee9b9bc

Inference runtime sandbox (paged KV accounting, continuous batching, benchmarks): https://github.com/nataliekung/inference-runtime-lab

Engineering notes (measured results on inference runtimes, GPU sharing, and the upstream Ray, KubeRay and verl work behind them): https://github.com/nataliekung/engineering-notes

Popular repositories Loading

  1. cracking-the-coding-interview-6th cracking-the-coding-interview-6th Public

    Forked from myyk/cracking-the-coding-interview-6th

    Solutions for "Cracking the Coding Interview (6th Edition)" by McDowell

    Java 1

  2. Spoon-Knife Spoon-Knife Public

    Forked from octocat/Spoon-Knife

    This repo is for demonstration purposes only.

    CSS

  3. verl verl Public

    Forked from verl-project/verl

    verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

    Python

  4. ray ray Public

    Forked from ray-project/ray

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Python

  5. TransferQueue TransferQueue Public

    Forked from Ascend/TransferQueue

    An asynchronous streaming data management module for efficient post-training.

    Python

  6. kuberay kuberay Public

    Forked from kuberay-project/kuberay

    A toolkit to run Ray applications on Kubernetes

    Go