Skip to content

vllm.snapshot.server

Classes:

Functions:

SnapshotBarrierError

Bases: RuntimeError

The controller supplied an invalid snapshot release marker.

Source code in vllm/snapshot/server.py 
43
44
class SnapshotBarrierError(RuntimeError):
    """The controller supplied an invalid snapshot release marker."""

detach_snapshot_streams()

Remove launch-log descriptors from the reusable process image.

Source code in vllm/snapshot/server.py 
111
112
113
114
115
116
117
118
119
120
def detach_snapshot_streams() -> None:
    """Remove launch-log descriptors from the reusable process image."""
    sys.stdout.flush()
    sys.stderr.flush()
    sink = os.open(os.devnull, os.O_WRONLY)
    try:
        os.dup2(sink, sys.stdout.fileno())
        os.dup2(sink, sys.stderr.fileno())
    finally:
        os.close(sink)