Skip to content
m.recipes
Find a configuration
Sign in

Run an AI model on your computer

Get a startup command, then explore measured performance for your task and GPU.

Get your startup command

Choose your operating system and enter a model repository. Launch support is checked separately from performance results.

All tasks · B200 · 179 GB

0 models with qualified results. Speeds compare only within one exact test; use “Same test on other GPUs” to compare hardware.

No qualified results yet · All tasks · B200 · 179 GB

13 original reports are kept as evidence but do not qualify for comparison; each report states why. This does not show that the model or GPU cannot run it.

Check model launch supportView original reportsMeasured alternatives for this taskTest your own GPU

Measured alternatives on other GPUs

Measured on different GPUs with the same or smaller listed capacity. These are references for choosing hardware, not performance or compatibility evidence for your selected GPU.

  1. WeVisOne-VL-2B

    tencent · 6 tested configurations · 1 GPU

    • RTX PRO 6000 Blackwell Server Edition · 96 GBBF16 · 32K → 2K tokens · No cache reuse
      Output throughput · includes prefill · 1 request
      153tok/s
      Best measured · 16 concurrent requests
      319tok/s
      Observed GPU occupancy
      85.3GiB
      First token
      753 ms
      Use this recipe · 16 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
      Test details · 6 concurrency levels

      Total output tokens divided by the full request window, including prefill and queueing.

      Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

      Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

      Engine
      vllm · vLLM 0.28.0
      Protocol
      wbench-search-http-v1
      Dataset
      migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=isolated:repeats=3
      Workload
      32768in-2048out
      ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
      C1153.4413.39 s753 ms85.25343.41d2914dd8 ↗
      C2208.6519.64 s1.1 s85.25360.41d2914dd8 ↗
      C4259.1933.21 s1.6 s85.25398.91d2914dd8 ↗
      C8295.3759.5 s2.1 s85.254221d2914dd8 ↗
      C12311.3386.14 s2.7 s85.25432.41d2914dd8 ↗
      C16319.17112.4 s3.3 s85.254381d2914dd8 ↗
    • 5 other test configurations on this GPU
      • BF16 · 32K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        162tok/s
        Best measured · 18 concurrent requests
        857tok/s
        Observed GPU occupancy
        85.3GiB
        First token
        71 ms
        Use this recipe · 18 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 7 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=prefix-reuse:repeats=3
        Workload
        32768in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C1161.5712.72 s71 ms85.25327.8175198c63 ↗
        C2269.4315.21 s86 ms85.25349.1175198c63 ↗
        C4460.4117.83 s106 ms85.25427.3175198c63 ↗
        C8644.4525.52 s127 ms85.25486.9175198c63 ↗
        C16771.0442.77 s184 ms85.25533.9175198c63 ↗
        C17812.7943.14 s195 ms85.25550.4175198c63 ↗
        C18856.6443.41 s196 ms85.25568.9175198c63 ↗
      • BF16 · 64K → 2K tokens · No cache reuse
        Output throughput · includes prefill · 1 request
        101tok/s
        Best measured · 8 concurrent requests
        151tok/s
        Observed GPU occupancy
        85.3GiB
        First token
        2.3 s
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 5 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=isolated:repeats=3
        Workload
        65536in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C1101.2620.26 s2.3 s85.25369.11c5c9cf6f ↗
        C2123.1133.41 s3.6 s85.25404.81c5c9cf6f ↗
        C4140.1964.26 s4.5 s85.254301c5c9cf6f ↗
        C6142.0897.79 s5.3 s85.25430.41c5c9cf6f ↗
        C8150.73122.37 s6.3 s85.25446.71c5c9cf6f ↗
      • BF16 · 64K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        114tok/s
        Best measured · 9 concurrent requests
        433tok/s
        Observed GPU occupancy
        85.3GiB
        First token
        135 ms
        Use this recipe · 9 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 7 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=prefix-reuse:repeats=3
        Workload
        65536in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C1113.5118.06 s135 ms85.25341.315fee1315 ↗
        C2153.326.73 s161 ms85.25369.515fee1315 ↗
        C4281.8629.1 s202 ms85.25483.815fee1315 ↗
        C6293.7441.93 s214 ms85.25459.215fee1315 ↗
        C7340.142.27 s227 ms85.25496.115fee1315 ↗
        C8387.9342.41 s237 ms85.25534.915fee1315 ↗
        C9433.0742.78 s246 ms85.25575.815fee1315 ↗
      • BF16 · 128K → 2K tokens · No cache reuse
        Output throughput · includes prefill · 1 request
        56.1tok/s
        Best measured · 4 concurrent requests
        66.8tok/s
        Observed GPU occupancy
        85.3GiB
        First token
        8 s
        Use this recipe · 4 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 4 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=isolated:repeats=3
        Workload
        131072in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C156.0936.63 s8 s85.25418.912c661c7e ↗
        C262.5267.49 s12 s85.25444.312c661c7e ↗
        C363.59109.31 s13.5 s85.25446.812c661c7e ↗
        C466.75144.63 s15 s85.25461.612c661c7e ↗
      • BF16 · 128K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        71tok/s
        Best measured · 4 concurrent requests
        165tok/s
        Observed GPU occupancy
        85.3GiB
        First token
        268 ms
        Use this recipe · 4 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 4 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=prefix-reuse:repeats=3
        Workload
        131072in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C171.0528.83 s268 ms85.25356.611ff0c98a ↗
        C289.4345.82 s323 ms85.25399.611ff0c98a ↗
        C3135.4345.41 s379 ms85.25470.911ff0c98a ↗
        C4165.2949.61 s420 ms85.2552411ff0c98a ↗

  2. Qwen3.8-27B-NVFP4

    unsloth · 11 tested configurations · 1 GPU

    • RTX PRO 6000 Blackwell Server Edition · 96 GBNVFP4 · 32K → 2K tokens · No cache reuse
      Output throughput · includes prefill · 1 request
      52.8tok/s
      Best measured · 8 concurrent requests
      215tok/s
      Observed GPU occupancy
      87.4GiB
      First token
      3.3 s
      Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
      Test details · 6 concurrency levels

      Total output tokens divided by the full request window, including prefill and queueing.

      Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

      Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

      Engine
      vllm · vLLM 0.28.0
      Protocol
      wbench-search-http-v1
      Dataset
      migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=isolated:repeats=3
      Workload
      32768in-2048out
      ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
      C152.7838.8 s3.3 s87.37337.31aee8b33e ↗
      C287.248.71 s4.9 s87.37343.41aee8b33e ↗
      C4142.1464.91 s7 s87.37375.31aee8b33e ↗
      C6187.6979.85 s8.1 s87.37402.81aee8b33e ↗
      C7202.3185.21 s8.7 s87.37411.81aee8b33e ↗
      C8215.0594.52 s9.3 s87.37421.41aee8b33e ↗
    • 10 other test configurations on this GPU
      • NVFP4 · 32K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        57tok/s
        Best measured · 8 concurrent requests
        374tok/s
        Observed GPU occupancy
        87.4GiB
        First token
        222 ms
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 6 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=prefix-reuse:repeats=3
        Workload
        32768in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C156.9636.17 s222 ms87.37322.61bced0642 ↗
        C2104.1439.34 s355 ms87.37305.91bced0642 ↗
        C4198.4241.3 s704 ms87.37319.31bced0642 ↗
        C6291.1242.23 s1 s87.37342.11bced0642 ↗
        C7333.3243.04 s1.1 s87.37349.11bced0642 ↗
        C8374.0443.82 s1.3 s87.37353.21bced0642 ↗
      • NVFP4 · 32K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        57.1tok/s
        Best measured · 8 concurrent requests
        373tok/s
        Observed GPU occupancy
        86.6GiB
        First token
        231 ms
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 3 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-fixed-http-v3
        Dataset
        synthetic-tokenizer-v3:cache=prefix-reuse:repeats=3
        Workload
        32768in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C157.0935.88 s231 ms86.63319137f29252 ↗
        C4197.841.44 s650 ms86.63330.2137f29252 ↗
        C8372.8843.98 s1.3 s86.63367.3137f29252 ↗
      • NVFP4 · 32K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        56.4tok/s
        Best measured · 8 concurrent requests
        371tok/s
        Observed GPU occupancy
        86.4GiB
        First token
        244 ms
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 3 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-fixed-http-v3
        Dataset
        synthetic-tokenizer-v3:cache=prefix-reuse:repeats=3
        Workload
        32768in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C156.436.51 s244 ms86.35319.11791b887d ↗
        C4196.4541.73 s654 ms86.35315.51791b887d ↗
        C8370.6844.24 s1.3 s86.36348.11791b887d ↗
      • NVFP4 · 64K → 2K tokens · No cache reuse
        Output throughput · includes prefill · 1 request
        44.9tok/s
        Best measured · 4 concurrent requests
        96.8tok/s
        Observed GPU occupancy
        87.4GiB
        First token
        8.6 s
        Use this recipe · 4 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 4 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=isolated:repeats=3
        Workload
        65536in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C144.8645.67 s8.6 s87.37360.51d2ff32ec ↗
        C267.5963.21 s12.7 s87.37379.11d2ff32ec ↗
        C384.9584.07 s14.6 s87.37398.51d2ff32ec ↗
        C496.77105.62 s16.3 s87.37415.81d2ff32ec ↗
      • NVFP4 · 64K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        54.7tok/s
        Best measured · 8 concurrent requests
        340tok/s
        Observed GPU occupancy
        87.4GiB
        First token
        329 ms
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 6 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=prefix-reuse:repeats=3
        Workload
        65536in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C154.7237.56 s329 ms87.37322.41d3f6b770 ↗
        C299.9540.99 s522 ms87.37315.91d3f6b770 ↗
        C4189.0743.34 s971 ms87.37337.81d3f6b770 ↗
        C6264.746.44 s1.3 s87.373641d3f6b770 ↗
        C7303.0847.32 s1.4 s87.37373.41d3f6b770 ↗
        C8339.6148.27 s1.7 s87.37381.21d3f6b770 ↗
      • NVFP4 · 64K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        54tok/s
        Best measured · 8 concurrent requests
        337tok/s
        Observed GPU occupancy
        86.4GiB
        First token
        361 ms
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 3 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-fixed-http-v3
        Dataset
        synthetic-tokenizer-v3:cache=prefix-reuse:repeats=3
        Workload
        65536in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C154.0438.07 s361 ms86.36320.71417f69be ↗
        C4187.1243.81 s879 ms86.36333.21417f69be ↗
        C8336.9548.66 s1.6 s86.36379.71417f69be ↗
      • NVFP4 · 64K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        54.5tok/s
        Best measured · 8 concurrent requests
        339tok/s
        Observed GPU occupancy
        86.6GiB
        First token
        359 ms
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 3 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-fixed-http-v3
        Dataset
        synthetic-tokenizer-v3:cache=prefix-reuse:repeats=3
        Workload
        65536in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C154.5437.55 s359 ms86.63324.917d1a7c8e ↗
        C4188.4843.48 s878 ms86.63350.217d1a7c8e ↗
        C8338.6548.43 s1.6 s86.63396.917d1a7c8e ↗
      • NVFP4 · 128K → 2K tokens · No cache reuse
        Output throughput · includes prefill · 1 request
        31.5tok/s
        Best measured · 2 concurrent requests
        41.3tok/s
        Observed GPU occupancy
        87.4GiB
        First token
        24.9 s
        Use this recipe · 2 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 2 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-search-http-v1
        Dataset
        migration-analysis-v1:sha256=68590c248e43f32c04dfd8062464fd1e4856917795fe307225e5c6112a54fe94:cache=isolated:repeats=3
        Workload
        131072in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C131.5464.93 s24.9 s87.37402.7173fcb7c1 ↗
        C241.27111.14 s34 s87.37426.3173fcb7c1 ↗
      • NVFP4 · 128K → 2K tokens · No cache reuse
        Output throughput · includes prefill · 1 request
        31.5tok/s
        Best measured · 8 concurrent requests
        57.7tok/s
        Observed GPU occupancy
        86.6GiB
        First token
        24.9 s
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 3 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-fixed-http-v3
        Dataset
        synthetic-tokenizer-v3:cache=isolated:repeats=3
        Workload
        131072in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C131.4565.12 s24.9 s86.63415.71448b0777 ↗
        C450.67220.6 s45.8 s86.63469.41448b0777 ↗
        C857.74421.65 s61.9 s86.63494.51448b0777 ↗
      • NVFP4 · 128K → 2K tokens · Prefix cache reuse
        Output throughput · includes prefill · 1 request
        50tok/s
        Best measured · 8 concurrent requests
        287tok/s
        Observed GPU occupancy
        86.4GiB
        First token
        506 ms
        Use this recipe · 8 concurrent requests ↗Evidence report and run availability ↗Same test on other GPUs
        Test details · 3 concurrency levels

        Total output tokens divided by the full request window, including prefill and queueing.

        Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

        Reports combined counts reports, not inference requests. Request successes and failures are listed in each report.

        Engine
        vllm · vLLM 0.28.0
        Protocol
        wbench-fixed-http-v3
        Dataset
        synthetic-tokenizer-v3:cache=prefix-reuse:repeats=3
        Workload
        131072in-2048out
        ConcurrencyMean throughput (tok/s)P95TTFTObserved occupancy (GiB)GPU power (W)Reports combinedView report
        C149.9840.98 s506 ms86.36322.7168d1f2c6 ↗
        C4171.3347.85 s1 s86.36365.5168d1f2c6 ↗
        C8287.3157.12 s1.9 s86.36425.4168d1f2c6 ↗

Occupancy includes engine buffers and reserved KV cache. It is not the minimum VRAM required by the model.

Measured hardware

13 more GPUs without qualified results for this task

GPU not listed? Test your own GPU

Running benchmarks

0Updates automatically

No benchmarks are currently reported as running.

RTX PRO 6000 Blackwell Server Edition · 96 GB · 403 queued · 0 running · 0 awaiting reassignment · 6 succeeded · 3 failed or exhausted

L4 · 24 GB · 91 queued · 0 running · 0 awaiting reassignment · 22 succeeded · 7 failed or exhausted

T4 · 16 GB · 22 queued · 0 running · 0 awaiting reassignment · 3 succeeded · 8 failed or exhausted