NvTensorRTRTXExecutionProvider cannot be downloaded automatically when following these steps on the Get started page

Aimee Hou 0 Reputation points
2025-11-21T06:08:36.3533333+00:00

I'm following these steps https://learn.microsoft.com/en-us/windows/ai/new-windows-ml/get-started?tabs=python#step-2-download-and-register-eps. After I ran this Python script, the NvTensorRTRTXExecutionProvider was not downloaded automatically by ensure_and_register_certified_async().get() (I have installed CUDA 12.9 and driver 576.88 on RTX 4090),  But the NvTensorRTRTXExecutionProvider can be found by calling find_all_providers() , and only this one provider is present, but the lib path is empty. Could someone help with this issue?

Windows development | Windows App SDK
{count} votes

1 answer

Sort by: Most helpful
  1. Danny Nguyen (WICLOUD CORPORATION) 5,065 Reputation points Microsoft External Staff Moderator
    2025-11-24T05:01:57.5833333+00:00

    Hi,

    NvTensorRTRTXExecutionProvider appears in find_all_providers() but has an empty library_path suggests that Windows ML recognizes the provider type, but doesn’t actually have a usable DLL for it on your system yet.

    As a possible workaround, you might try bypassing the Windows ML auto-download mechanism and working with ONNX Runtime directly:

    
    import onnxruntime as ort
    
    print("ORT version:", ort.__version__)
    
    print("Available providers:", ort.get_available_providers())
    
    print("All providers:", ort.get_all_providers())
    
    

    If NvTensorRTRTXExecutionProvider shows up only in get_all_providers() but not in get_available_providers(), that would confirm the provider is known by name but not actually present/usable in the runtime. In that situation, one option is to install or build the TensorRT RTX EP manually and then register it with:

    
    ort.register_execution_provider_library(
    
        "NvTensorRTRTXExecutionProvider",
    
        "/path/to/the/ep/dll",
    
    )
    
    

    For more details on how ONNX Runtime uses TensorRT on the Python side, see the TensorRT Execution Provider docs:

    Disclaimer: Some links are non-Microsoft website. The pages appear to be providing accurate, safe information. Watch out for ads on the site that may advertise products frequently classifies as a PUP (Potentially Unwanted Products). Thoroughly research any product advertised on the site before you decide to download and install it.

    TensorRT Execution Provider (Python)

    This describes how to work directly with TensorrtExecutionProvider in ONNX Runtime, which is a practical workaround if the Windows ML certified EP (NvTensorRTRTXExecutionProvider) isn’t being downloaded properly.

    1 person found this answer helpful.

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.