Skip to main content

TokenSample Struct

Declaration​

struct simaai::neat::genai::TokenSample { ... }

Included Headers​

#include <GenAITypes.h>

Public Member Attributes Index​

std::stringtext
GenerationMetricsmetrics
boolis_final = false
std::stringfinish_reason
std::stringlanguage

Detected or explicitly selected ASR source language on the final sample. More...

std::optional< float >no_speech_prob

Probability that the ASR input contains no speech, set on the final sample. More...

std::optional< float >avg_logprob

Mean log probability over generated ASR tokens, set on the final sample. More...

Jsontool_calls = Json::array()
std::stringreasoning

Reasoning fragment; mutually exclusive with text for generated samples. More...

Definition at line 136 of file GenAITypes.h.

Public Member Attributes​

avg_logprob​

std::optional<float> simaai::neat::genai::TokenSample::avg_logprob

Mean log probability over generated ASR tokens, set on the final sample.

Definition at line 146 of file GenAITypes.h.

finish_reason​

std::string simaai::neat::genai::TokenSample::finish_reason

Definition at line 140 of file GenAITypes.h.

is_final​

bool simaai::neat::genai::TokenSample::is_final = false

Definition at line 139 of file GenAITypes.h.

language​

std::string simaai::neat::genai::TokenSample::language

Detected or explicitly selected ASR source language on the final sample.

Definition at line 142 of file GenAITypes.h.

metrics​

GenerationMetrics simaai::neat::genai::TokenSample::metrics

Definition at line 138 of file GenAITypes.h.

no_speech_prob​

std::optional<float> simaai::neat::genai::TokenSample::no_speech_prob

Probability that the ASR input contains no speech, set on the final sample.

Definition at line 144 of file GenAITypes.h.

reasoning​

std::string simaai::neat::genai::TokenSample::reasoning

Reasoning fragment; mutually exclusive with text for generated samples.

Definition at line 149 of file GenAITypes.h.

text​

std::string simaai::neat::genai::TokenSample::text

Definition at line 137 of file GenAITypes.h.

tool_calls​

Json simaai::neat::genai::TokenSample::tool_calls = Json::array()

Definition at line 147 of file GenAITypes.h.

The documentation for this struct was generated from the following file:

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.