ProcessCvuOptions Struct

Simple process-CVU backend placement for model pre/post stages. More...

Declaration

struct simaai::neat::ProcessCvuOptions { ... }

Included Headers

#include <GraphOptions.h>

Public Member Attributes Index

std::string	pre_run_target = "AUTO"
std::string	post_run_target = "AUTO"
bool	async = true
	Enable the prepared safe async processcvu submit path for model-managed CVU stages. More...

Description

Simple process-CVU backend placement for model pre/post stages.

Use this when a model needs the pre-MLA CVU work and post-MLA CVU work on different devices. Accepted tokens are "AUTO", "EV74", and "A65" (case-insensitive, with compatibility aliases handled by the internal resolver).

Example:

 Model::Options opt;

 opt.processcvu.pre_run_target = "EV74";

 opt.processcvu.post_run_target = "A65";

Definition at line 253 of file GraphOptions.h.

Public Member Attributes

async

bool simaai::neat::ProcessCvuOptions::async = true

Enable the prepared safe async processcvu submit path for model-managed CVU stages.

Default true keeps multi-stage model routes throughput-first; set false, or use the plugin/env kill switches, to force the synchronous fallback.

Definition at line 261 of file GraphOptions.h.

post_run_target

std::string simaai::neat::ProcessCvuOptions::post_run_target = "AUTO"

Definition at line 255 of file GraphOptions.h.

pre_run_target

std::string simaai::neat::ProcessCvuOptions::pre_run_target = "AUTO"

Definition at line 254 of file GraphOptions.h.

---

The documentation for this struct was generated from the following file:

• GraphOptions.h

---

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.