build based on 603066b

dev/.documenter-siteinfo.json

@@ -1 +1 @@
-{"documenter":{"julia_version":"1.10.2","generation_timestamp":"2024-04-15T14:20:38","documenter_version":"1.4.0"}}
+{"documenter":{"julia_version":"1.10.3","generation_timestamp":"2024-05-24T10:17:23","documenter_version":"1.4.1"}}

dev/explanation/index.html

@@ -8,4 +8,4 @@
 # memory: 1 4 2 5 3 6</code></pre><p>As a preprocessing step this array is copied to C layout:</p><pre><code class="language-julia hljs"># julia : [1 3 5; 2 4 6]
 # memory: 1 2 3 4 5 6</code></pre><p>Then onnxruntime is invoked producing an output in C layout:</p><pre><code class="language-julia hljs"># julia : [1 3 5; 2 4 6]
 # memory: 1 2 3 4 5 6</code></pre><p>Finally as a post processing step this converted to fortran layout:</p><pre><code class="language-julia hljs"># julia [1 2 3; 4 5 6]
-# memory: 1 4 2 5 3 6</code></pre></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../api/">« API</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="auto">Automatic (OS)</option><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.4.0 on <span class="colophon-date" title="Monday 15 April 2024 14:20">Monday 15 April 2024</span>. Using Julia version 1.10.2.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>
+# memory: 1 4 2 5 3 6</code></pre></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../api/">« API</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="auto">Automatic (OS)</option><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.4.1 on <span class="colophon-date" title="Friday 24 May 2024 10:17">Friday 24 May 2024</span>. Using Julia version 1.10.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>

dev/index.html

@@ -38,4 +38,4 @@
 output_tensor = only(outputs);
 output_array = GetTensorMutableData(api, output_tensor);</code></pre><h1 id="Alternatives"><a class="docs-heading-anchor" href="#Alternatives">Alternatives</a><a id="Alternatives-1"></a><a class="docs-heading-anchor-permalink" href="#Alternatives" title="Permalink"></a></h1><ul><li>Use the onnxruntime python bindings via <a href="https://github.com/JuliaPy/PyCall.jl">PyCall.jl</a>.</li><li><a href="https://github.com/FluxML/ONNX.jl">ONNX.jl</a></li><li><a href="https://github.com/DrChainsaw/ONNXNaiveNASflux.jl">ONNXNaiveNASflux.jl</a></li></ul><h1 id="Breaking-Changes-in-version-0.4."><a class="docs-heading-anchor" href="#Breaking-Changes-in-version-0.4.">Breaking Changes in version 0.4.</a><a id="Breaking-Changes-in-version-0.4.-1"></a><a class="docs-heading-anchor-permalink" href="#Breaking-Changes-in-version-0.4." title="Permalink"></a></h1><ul><li><p>Support for CUDA.jl is changed from version 3 to versions 4 and 5.</p></li><li><p>Support for Julia versions less than 1.9 is dropped. The reason for this is to switch the conditional support of GPUs from being based on the Requires package to being a package extension. As a consequence the ONNXRunTime GPU support can now be precompiled and the CUDA.jl versions can be properly controlled via Compat.</p></li></ul><h1 id="Setting-the-CUDA-Runtime-Version-in-Tests"><a class="docs-heading-anchor" href="#Setting-the-CUDA-Runtime-Version-in-Tests">Setting the CUDA Runtime Version in Tests</a><a id="Setting-the-CUDA-Runtime-Version-in-Tests-1"></a><a class="docs-heading-anchor-permalink" href="#Setting-the-CUDA-Runtime-Version-in-Tests" title="Permalink"></a></h1><p>For GPU tests using ONNXRunTime, naturally the tests must depend on and import CUDA and cuDNN. Additionally a supported CUDA runtime version needs to be used, which can be somewhat tricky to set up for the tests.</p><p>First some background. What <code>CUDA.set_runtime_version!(v&quot;11.8&quot;)</code> effectively does is to</p><ol><li>Add a <code>LocalPreferences.toml</code> file containing</li></ol><pre><code class="nohighlight hljs">[CUDA_Runtime_jll]
 version = &quot;11.8&quot;</code></pre><ol><li>In <code>Project.toml</code>, add</li></ol><pre><code class="nohighlight hljs">[extras]
-CUDA_Runtime_jll = &quot;76a88914-d11a-5bdc-97e0-2f5a05c973a2&quot;</code></pre><p>If your test environment is defined by a <code>test</code> target in the top <code>Project.toml</code> you need to</p><ol><li>Add a <code>LocalPreferences.toml</code> in your top directory with the same</li></ol><p>contents as above.</p><ol><li><p>Add <code>CUDA_Runtime_jll</code> to the <code>extras</code> section of <code>Project.toml</code>.</p></li><li><p>Add <code>CUDA_Runtime_jll</code> to the <code>test</code> target of <code>Project.toml</code>.</p></li></ol><p>If your test environment is defined by a <code>Project.toml</code> in the <code>test</code> directory, you instead need to</p><ol><li>Add a <code>test/LocalPreferences.toml</code> file with the same contents as</li></ol><p>above.</p><ol><li>Add <code>CUDA_Runtime_jll</code> to the <code>extras</code> section of <code>test/Project.toml</code>.</li></ol></article><nav class="docs-footer"><a class="docs-footer-nextpage" href="api/">API »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="auto">Automatic (OS)</option><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.4.0 on <span class="colophon-date" title="Monday 15 April 2024 14:20">Monday 15 April 2024</span>. Using Julia version 1.10.2.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>
+CUDA_Runtime_jll = &quot;76a88914-d11a-5bdc-97e0-2f5a05c973a2&quot;</code></pre><p>If your test environment is defined by a <code>test</code> target in the top <code>Project.toml</code> you need to</p><ol><li>Add a <code>LocalPreferences.toml</code> in your top directory with the same</li></ol><p>contents as above.</p><ol><li><p>Add <code>CUDA_Runtime_jll</code> to the <code>extras</code> section of <code>Project.toml</code>.</p></li><li><p>Add <code>CUDA_Runtime_jll</code> to the <code>test</code> target of <code>Project.toml</code>.</p></li></ol><p>If your test environment is defined by a <code>Project.toml</code> in the <code>test</code> directory, you instead need to</p><ol><li>Add a <code>test/LocalPreferences.toml</code> file with the same contents as</li></ol><p>above.</p><ol><li>Add <code>CUDA_Runtime_jll</code> to the <code>extras</code> section of <code>test/Project.toml</code>.</li></ol></article><nav class="docs-footer"><a class="docs-footer-nextpage" href="api/">API »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="auto">Automatic (OS)</option><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.4.1 on <span class="colophon-date" title="Friday 24 May 2024 10:17">Friday 24 May 2024</span>. Using Julia version 1.10.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>