Repository navigation
Lessons in a voice chat: wait for the model's answer; autoplayDelay (0.11.2) - #40
Merged
Merged
Conversation
…nglish (0.11.2) In MulmoChat's Japanese voice mode the model said "Here comes the sound" in English, as the instruction quoted it, and the first note played before it: the card appeared after the earlier speech had ended, so it played at once, and the model's answer to the render came a moment later and paused it. - A voice host's card now waits up to 3.5 s (REPLY_MS) for that answer, counted from when the card appeared or from the end of the speech it appeared during, then until the voice has been quiet for 1.5 s. - renderScore takes autoplayDelay (seconds, 0-30): the player waits that long after it appears instead of waiting for the answer, in any host. - The instruction asks for a few words in the language the model speaks with the user, with no quoted example. - A host that never passes isAudioPlaying is no longer taken for a quiet voice host: Vue turned the missing boolean prop into false. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
A card that appeared during speech counted the delay again from the end of that speech (a 10 s delay, speech ending at 8 s: played at 18 s). The delay now counts from the card's appearance, with QUIET_MS after the voice kept separately. The new test failed before the fix (10000 instead of 2000). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Found in MulmoChat's Japanese voice mode with 0.11.1:
Why the first note came early
The card appeared after the earlier speech had ended, so the view played at once. The model's answer to the render's result came a moment later and paused the music.
Changes
isAudioPlaying), a new card waits up to 3.5 s (REPLY_MS) for the model's answer to the render. The wait counts from when the card appeared, or from the end of the speech it appeared during. After the answer, it waits until the voice has been quiet for 1.5 s, as before.autoplayDelay(renderScore, seconds 0–30): the player waits that long after it appears instead of waiting for the answer, in any host. It is passed inpresentationand documented in the tool description, the guide and the plugin README. A score that carries it gets the same "options of the renderScore call" hint asviewandautoplay.notifyWhenDonerender asks for a few words in the language the model speaks with the user, with no quoted example.isAudioPlayingis no longer taken for a voice host. Vue turned the missing boolean prop intofalse; it now defaults toundefined, and such a host plays at once as before.Checks
quietWaitwith the answer wait andautoplayDelay;autoplayDelaypassed through and range-checked).autoplayDelay: 2without a voice → 2 s;autoplayDelay: 1with a voice → 1 s.Both packages are 0.11.2; the plugin's peer stays
jinglescript ^0.11.0.🤖 Generated with Claude Code
work in jinglescript