Class GpuDetector

Namespace

JD.AI.Core.LocalModels

Assembly

JD.AI.Core.dll

Detects available GPU backends for LLamaSharp inference at runtime.

public static class GpuDetector

Inheritance

object

GpuDetector

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Methods

Detect()

Detects the best available GPU backend. Order: CUDA → Metal (macOS) → CPU fallback.

public static GpuBackend Detect()

Returns

GpuBackend

RecommendGpuLayers(GpuBackend, long)

Returns a recommended GPU layer count based on the backend and model size. Returns -1 for "all layers" when GPU is available.

public static int RecommendGpuLayers(GpuBackend backend, long modelSizeBytes)

Parameters

backend GpuBackend

modelSizeBytes long

Returns

int

Reset()

Resets the cached detection result (for testing).

public static void Reset()