Smart AI STT Auto Scripture & LLM APIs - #3579

Merged

vassbo merged 292 commits into

ChurchApps:devfrom

josephomills:feat/ai-auto-scripture

Sep 9, 2026

This pull request is big! We're only showing the most recent 250 commits

Commits on Aug 10, 2026

AI scripture: accept voice commands spoken without an imperative
josephomills
committed
e84a925
AI scripture: stop the streaming driver clipping the tail of the last word
josephomills
committed
f5ba8ba
AI scripture: decode each utterance in one batch on a fresh stream
josephomills
committed
685dab5
AI scripture: match voice commands across segment boundaries
josephomills
committed
7b465fe
AI scripture: keep the model deletable when the addon is unavailable
josephomills
committed
0fb5ba8
AI scripture: pin the Nemotron model download to exact content hashes
josephomills
committed
4d7aefe
AI scripture: move locale strings under their own parent key
josephomills
committed
16d70aa
AI scripture: group the feature under electron/ai and frontend/ai
josephomills
committed
082dce5

Commits on Aug 11, 2026

Fixed mac console Spotify error
vassbo
committed
d4e65a5
Trying to fix cloud sync sometimes getting stuck
vassbo
committed
087c6c5
Sentry fixes
vassbo
committed
dfc25c3
Optimized audio
vassbo
committed
8c8c2d4
Tweak
vassbo
committed
a21e193
Fixed Whisper not loading
vassbo
committed
f7b8e99
Fixing text stretching #3594
vassbo
committed
2e4ce4e
Clear all don't stop mics
vassbo
committed
b9c1093
Microphone actions #3598
vassbo
committed
4bf57c4
Updated language
vassbo
committed
43aa3b3
AI scripture: local quote matching core
josephomills
committed
bccbea7
AI scripture: detect recited verses without an AI key
josephomills
committed
e2225ab
Backup: don't crash the app when a store file doesn't exist yet
josephomills
committed
06d1743
AI scripture: fix whisper test after model dir and types moves
josephomills
committed
ea0ee02
AI: general channels drop the scripture prefix
josephomills
committed
ba9dc14
AI: split general locale strings from the scripture ones
josephomills
committed
b2b4c86
AI: organize the feature into layer and engine folders
josephomills
committed
c3a0abf

Commits on Aug 13, 2026

Reworked system
vassbo
committed
70b96e9
Audio fixes (#3606)
vassbo
authored
e75418b
Video seek improvements
vassbo
committed
543ea8a
Fixed video randomly paused when audio is playing
vassbo
committed
3ce8f61
Fixed "Mute when video plays" not working
vassbo
committed
1dbbe3a
Per network output audio meter
vassbo
committed
c84e74b
Fixed video playback issues
vassbo
committed
bbe522c

Commits on Aug 14, 2026

Fix chords stage display (#3608)
kshairrick
authored
18f95a6
Auto set bitrate
vassbo
committed
6247a5e
AI: type-only import for the provider model table
josephomills
committed
cd92654
Audio tweak
vassbo
committed
57f8d6b
Fixed video sync
vassbo
committed
04d130d
Fixed double click crop in overlays/templates
vassbo
committed
97f5a48
AI: repair the reworked speech-to-text transport
josephomills
committed
13029a2
AI: make the model setup layer report and manage what is actually on disk
josephomills
committed
b19722a
AI: run scripture detection on the generic speech-to-text stream
josephomills
committed
e7cbf16
AI: drop the deprecated scripture pipeline and dedupe the settings UI
josephomills
committed
48fb49a
AI: restore stable error codes on LLM provider failures
josephomills
committed
1d1ba26
Main thread no longer blocking audio signal
vassbo
committed
bfe39da
Fixed metronome not audable initially
vassbo
committed
89f606d
Fix renderer boot crash from module-scope ShowObj construction
josephomills
committed
4bd9f27
Border radius working on cropped media
vassbo
committed
f7965f4
AI: the ring only stretches and casts a shadow for the floating bubble
josephomills
committed
51bc759
AI: the expanded bubble transcript follows the speech
josephomills
committed
4bd5376
AI: wrap bubble transcript lines instead of truncating
josephomills
committed
23d2036
AI: cut whisper speech-to-text latency
josephomills
committed
cba948a
AI: nemotron streams partial text while an utterance is still open
josephomills
committed
1d8e8c3
AI: hear dictation-style punctuation and switch mics without a restart
josephomills
committed
cd32175
dB volume instead of linear
vassbo
committed
7a76058
Timer seek add #3603
vassbo
committed
8328a9f
AI: stitch decode seams so words neither repeat nor go missing
josephomills
committed
8cc0939
AI: stop whisper hallucinating over silent audio
josephomills
committed
7131e1b
AI: 'None' as the default LLM provider - explicit speech-to-text-only mode
josephomills
committed
b8f4d50
Fix cloud sync silently uploading nothing when a store file is missing (#3609)
hansli112
authored
fb60f02
AI: keep the no-provider hint generic
josephomills
committed
c8d37f1
AI: auto-pick the system default microphone, not the first listed device
josephomills
committed
b86dd24
Fixing provider shows content sometimes replaced by cloud data
vassbo
committed
73b3190
Trying to fix output position issues #3495
vassbo
committed
91e6054
Merge remote-tracking branch 'origin/dev' into feat/ai-auto-scripture
josephomills
committed
813e1ef
AI scripture: percentage confidence threshold for auto mode
josephomills
committed
5f32cc6
AI: the bubble absorbs the scripture drawer panel
josephomills
committed
4e4e69c

Commits on Aug 15, 2026

Commits on Aug 16, 2026

Commits on Aug 17, 2026

Output position updates #3495
vassbo
committed
fffa823
Updated bug report
vassbo
committed
8c4a7ca
Action to disable slides #3607
vassbo
committed
d570a83
Fixed ICS import issues #3601
vassbo
committed
6db4092
AI: filter whisper's repetition-loop hallucinations
josephomills
committed
689c629
Manage multiple calendars
vassbo
committed
ee6a8f5
AI scripture: smarter voice commands - 'the next verse says', a lone 'next' & 'another one'
josephomills
committed
f724048
AI scripture: default display cooldown 5s
josephomills
committed
3282a22
AI: bubble layers sit under the app tooltip layer
josephomills
committed
54ac24b
AI scripture: borrow the bible search's forgiveness - archaic stems & diacritics
josephomills
committed
8d11cf1
AI scripture: follow the wording being read - same verse, other translation
josephomills
committed
dacbcea

Commits on Aug 18, 2026

Commits on Aug 19, 2026

Commits on Aug 20, 2026

AI settings: turning AI off also turns AI Scripture off
josephomills
committed
88e9292
Scripture history across translations, with the drawer following along (#3628)
josephomills
authored
42c2c5a
Auto backup: run once per interval, and stop the Backups folder growing forever (#3630)
josephomills
authored
8adcc35
Updated Dutch language
vassbo
committed
abf5809
RTMP encoder tweaks
vassbo
committed
2659e02
RTMP updated encoders
vassbo
committed
6e7cb7f
Improved RTMP encoding #3625
vassbo
committed
76fd49f
AI settings: loading settings enforces the AI requirement
josephomills
committed
fd31add
Output audio tweak
vassbo
committed
6a3596c
AI search: the entries regroup - general first, scripture after
josephomills
committed
f6ed499
Camera previews auto pause
vassbo
committed
97c660b
Merge remote-tracking branch 'origin/dev' into feat/ai-auto-scripture
josephomills
committed
1686233
Fixed infinite loop when playing unsupported video format
vassbo
committed
6db3b65
Updated MP4Box decoding
vassbo
committed
047fd9f
Fixed request test issue
vassbo
committed
a9c3b16
Fixed type imports
vassbo
committed
d530dd4
Reduced dev startup time by ~70%
vassbo
committed
6724d67
Improved video playback
vassbo
committed
fdead8a
Shows drawer search: lyrics snippet preview + shared snippet/highlight fixes (#3632)
josephomills
authored
9297dee
Merge remote-tracking branch 'origin/dev' into feat/ai-auto-scripture
josephomills
committed
269ad16

Commits on Aug 21, 2026

Merge remote-tracking branch 'origin/dev' into ai-auto-scripture
vassbo
committed
e1c6485
Remove deleted file
vassbo
committed
717b1db

Commits on Sep 3, 2026

Commits on Sep 4, 2026

Cleanup - still lots to do
vassbo
committed
4f0db9c
Cleanup backend
vassbo
committed
a70d8b9
Cleanup
vassbo
committed
a9092ed
Cleanup
vassbo
committed
eab4f07
Cleanup quoteMatcher
vassbo
committed
10ceffc
LLMs should be used for voice commands
vassbo
committed
3ee0e9e
Updated confidence score
vassbo
committed
99f7e3d
Fix
vassbo
committed
077ccad
Cleanup backend
vassbo
committed
32e79b6
Cleanup frontend
vassbo
committed
d8133ae
Generalized LLM Talk
vassbo
committed
43218cc
Updates
vassbo
committed
51ef801
Floating style update
vassbo
committed
9e445f0
Updates
vassbo
committed
7e0cdaa

Commits on Sep 6, 2026

Commits on Sep 7, 2026

Detection updates
vassbo
committed
6019f06
Detect standalone verse from outputted chapter
vassbo
committed
71f8e84
Increased auto play prevention after manual output update
vassbo
committed
b7674fa
Reduced detection memory footprint
vassbo
committed
0adc988
Rename classes
vassbo
committed
c8aadb0
Detection improvements
vassbo
committed
e361e88
Detection updates
vassbo
committed
37a74ff
Detection fixes
josephomills
committed
45bee89
Update sherpa-onnx to 1.13.7
josephomills
committed
2b7f291
Streaming Nemotron decode
josephomills
committed
3f32f66
Multilingual Nemotron 3.5 model
josephomills
committed
f03ab0d
Tests for the STT helpers
josephomills
committed
03e2a61
Fix HRule style prop
josephomills
committed
66a8468
Transcript confidence caps detection confidence
josephomills
committed
68133df
Trim the streaming driver
josephomills
committed
7856d1c
Drop HRule style prop
josephomills
committed
1daa902
Ignore very short chunks in quote matching
josephomills
committed
f230c24
Keep decoding past the length ceiling
josephomills
committed
b50b771
Glue late punctuation to the previous word
josephomills
committed
c82e8e1
Discount a match only when its words were heard badly
josephomills
committed
4ecc2e0
Weigh a quote by how much of the verse it covers
josephomills
committed
875a801
Follow spoken verse numbers while reading
josephomills
committed
51f0e5a
A close match in another chapter counts as ambiguous
josephomills
committed
4b5eac3

Commits on Sep 8, 2026

Merge remote-tracking branch 'origin/dev' into port/stt-rework
josephomills
committed
bd98c98
Merge remote-tracking branch 'origin/dev' into ai-auto-scripture
vassbo
committed
b2da336
Improvements
vassbo
committed
612d113

Commits on Sep 9, 2026

Chat system
vassbo
committed
e63d954
Removed Whisper
vassbo
committed
a35b18b
Open model in system
vassbo
committed
a0f7e4f
LLM fix
vassbo
committed
576fb56
API Bible warning
vassbo
committed
4433389
Multi translation setup
vassbo
committed
f9d3d71
Async bible caching
vassbo
committed
4c5b297
Cleanup backend
vassbo
committed
9b6a8df
Fixed audio processor in prod
vassbo
committed
7f51a4c
Cleanup
vassbo
committed
6377d6d
Component cleanup
vassbo
committed
45d4f82