Skip to main content

TokenSample Struct

Declaration​

struct simaai::neat::genai::TokenSample { ... }

Included Headers​

#include <GenAIValueTypes.h>

Public Member Attributes Index​

std::stringtext
GenerationMetricsmetrics
boolis_final = false
std::stringfinish_reason
std::stringlanguage

Detected or explicitly selected ASR source language on the final sample. More...

std::optional< float >no_speech_prob

Probability that the ASR input contains no speech, set on the final sample. More...

std::optional< float >avg_logprob

Mean log probability over generated ASR tokens, set on the final sample. More...

Jsontool_calls = Json::array()
std::stringreasoning

Reasoning fragment; mutually exclusive with text for generated samples. More...

Definition at line 40 of file GenAIValueTypes.h.

Public Member Attributes​

avg_logprob​

std::optional<float> simaai::neat::genai::TokenSample::avg_logprob

Mean log probability over generated ASR tokens, set on the final sample.

Definition at line 50 of file GenAIValueTypes.h.

finish_reason​

std::string simaai::neat::genai::TokenSample::finish_reason

Definition at line 44 of file GenAIValueTypes.h.

is_final​

bool simaai::neat::genai::TokenSample::is_final = false

Definition at line 43 of file GenAIValueTypes.h.

language​

std::string simaai::neat::genai::TokenSample::language

Detected or explicitly selected ASR source language on the final sample.

Definition at line 46 of file GenAIValueTypes.h.

metrics​

GenerationMetrics simaai::neat::genai::TokenSample::metrics

Definition at line 42 of file GenAIValueTypes.h.

no_speech_prob​

std::optional<float> simaai::neat::genai::TokenSample::no_speech_prob

Probability that the ASR input contains no speech, set on the final sample.

Definition at line 48 of file GenAIValueTypes.h.

reasoning​

std::string simaai::neat::genai::TokenSample::reasoning

Reasoning fragment; mutually exclusive with text for generated samples.

Definition at line 53 of file GenAIValueTypes.h.

text​

std::string simaai::neat::genai::TokenSample::text

Definition at line 41 of file GenAIValueTypes.h.

tool_calls​

Json simaai::neat::genai::TokenSample::tool_calls = Json::array()

Definition at line 51 of file GenAIValueTypes.h.

The documentation for this struct was generated from the following file:

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.15.0.