0
Fork 0
mirror of https://github.com/zeronsh/comet.git synced 2026-11-16 18:57:19 +00:00
Commit graph

7 commits

Author SHA1 Message Date
Wing
cd0ec07d46 The new app icon on macOS, Windows and Linux
macOS gets a Zeron.icon that follows the system's looks on macOS 26 and later,
with an icns for earlier versions and the dmg. Compiling it takes Xcode 26.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: zeronsh[bot] <346184242+zeronsh[bot]@users.noreply.github.com>
2026-11-05 14:07:47 -07:00
Wing
cc7da5c2aa
Zeron Cloud, provider switching, and the phone model picker (#966)
Cloud chats on machines of their own (delegation, sleep/wake, durable delete), a credential vault, Stripe billing with Cloud's own portal, per-account Cloud availability, the edge's Cloud model list, provider switching between turns, the phone's tabbed model picker, and desktop/phone/engine polish.
2026-10-22 03:18:13 -07:00
Laurent
3b2f78027a
fix: send cursor model defaults for plus subscriptions (#920)
* fix(cursor): send account catalog defaults with model selections

* fix(dev): prevent release updates from replacing local builds

* fix(cursor): fill defaults on model switches, skip Max Mode, avoid refresh waits

- Mid-session model switches (in-place reconfigure via steer) now get the
  same catalog defaults as a fresh run; they previously still sent bare ids.
- Runs reuse the already-loaded catalog instead of waiting on a refresh
  every 60s; only a cold catalog is fetched.
- Never send a default from a Max Mode variant: the backend rejects the
  variant the catalog marks default for Grok 4.7 (500k, "Invalid
  parameters" — verified live) while the bare id runs, so those models keep
  sending the bare id as before. Every non-Max default in a live catalog was
  verified to run.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Wing <contact@winglee.io>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 13:40:31 -07:00
neo773
e54c3a8610
Let dropped files from any folder attach on macOS (#812)
* Let dropped files from any folder attach on macOS

Files dropped into a chat from outside a project folder (Downloads,
Desktop, …) failed to attach. The app was signed with only the microphone
entitlement.

Sign the app with the user-selected and Downloads file entitlements, as Zed
does (zed-industries/zed#43609), and rename Dictation.entitlements to
Zeron.entitlements now that it covers more than dictation.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* Sign ad-hoc macOS packages with Zeron.entitlements too

Ad-hoc builds signed with voice.entitlements (microphone only), so they
missed the file-access entitlements. One entitlements file now covers
every signing path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: wing-anara <wing_13@live.com>
2026-10-11 13:28:33 -07:00
José Gurruchaga
4a5fb8b443
Internal session plumbing and packaging cleanup (#819)
* test(codex): document and probe native voice capabilities

* feat(proto): define local voice session contracts

* fix(harness): bound realtime media and prioritize control messages

* feat(codex): attach realtime voice to an idle thread runtime

* feat(engine): own voice leases and enforce subscription eligibility

* feat(mcp): create standalone sessions on selected hosts

Add chat/side kinds with compatible defaults, resolve projects within the selected device, and validate that host's harness and model catalogs before writing. Route transcript reads to the chat host and preserve send baselines across waits so missing session rows and delayed replies cannot return an old response.

Cover invalid requests, remote catalogs, mixed batches, wait races, two-engine execution and interrupt delivery. Add an isolated MCP stdio smoke fixture.

* feat(doc): persist canonical voice transcripts once

* docs(mcp): document standalone and remote session workflows

* feat(audio): add native capture and streaming playback

* feat(audio): handle echo cancellation and voice interruptions

* feat(ui): coordinate voice ownership over local engine RPC

* feat(ui): extract the Bezel orb into a native Zeron component

* feat(ui): replace the composer with a central orb during voice sessions

* feat(mcp): constrain voice orchestration to subscription policy

* build(voice): add microphone permissions and offline audio CI

* test(voice): verify lifecycle, billing boundaries and rollout gates

* fix(voice): preserve text transport and idle billing boundaries

* feat(codex): connect subscription voice through native WebRTC

* feat(engine): activate native voice ownership and preserve delegated work

* feat(ui): enable native voice with central orb and retained drafts

* fix(mcp): keep voice delegation on subscription-backed Codex

* test(voice): document native transport and add opt-in connectivity smoke

* fix(voice): close audit races and validate project subscription context

* Fix Codex voice initialization and macOS microphone permissions

* Allow Codex voice agents to delegate through upstream MCP

* Make voice a persistent orchestrator with a dedicated stage

* Add call controls and elapsed time to the voice stage

* Remove decorative rings around the voice orb

* Add voice selection menu and simplify stage artwork

* Remove voice status labels beneath the orb

* Fix dictation and realtime voice integration after rebase

* Move Codex voice style selection into Voice settings

* Restore window dragging from the voice stage titlebar

* Open the voice stage immediately when starting a call

* Smooth voice orb motion and speaking transitions

* Remove the green audio pulse from the voice microphone control

* Show the live voice orb above the orchestrator chat composer

* Use full chat IDs in MCP reply instructions

* Correlate MCP replies by message IDs instead of remote timestamps

* Keep the voice stage open when launched from Settings

* test(voice): add a split-host Codex voice compatibility probe

* feat(voice): package a standalone desktop media runtime

* feat(proto): define client-media voice control contracts

* refactor(codex): separate voice signaling from local audio

* feat(engine): own remote voice sessions with ephemeral leases

* feat(rpc): route versioned voice controls to execution hosts

* feat(voice): coordinate local media with remote Codex control

* feat(ui): start voice on a selected remote Codex host

* test(voice): cover cancelled preparations and stale session controls

* test(voice): prepare desktop rollout validation and offline CI

* feat(ios): add a pinned native WebRTC compatibility endpoint

* feat(mobile): expose remote voice sessions through UniFFI

* feat(ios): bridge native audio lifecycle to remote voice calls

* feat(ios): add remote voice controls and registered host selection

* test(voice): cover relay and iOS lifecycle and prepare live acceptance

Add half-open and native callback regressions, stage-only diagnostics, complete runtime notices, and development test instructions. Keep real Mac/Fedora/iPhone acceptance opt-in for user validation.

* refactor(orb): share the thinking-orb engine through zeron-orb

Move the renderer-agnostic engine, presets, motion and a new OrbAnimator
(clock, audio response, state crossfades) into crates/orb. The GPUI widget
now delegates to the animator, so desktop and mobile paint identical frames.

* feat(voice): rebuild iOS remote voice around the desktop orb and phone-call audio

- Share the call view (phase, caption, levels, speaking, orb state) in
  voice-session; the client derives speaking because client media has no
  host meter. Keep owner-event headroom so level meters never overflow it.
- Title remote orchestrator chats "Voice session" like local ones.
- UniFFI: typed call state and end reasons instead of JSON, a distinct
  denied-microphone failure, and OrbRenderer frames from zeron-orb.
- iOS: OrbView paints the desktop orb; start voice from the New session bar
  (live strip while a call runs), the session nav bar and the iPad sidebar;
  full-screen call stage with caption, transcript (flagged when Codex waits
  for an answer), mute, route picker and hang-up.
- Phone-call audio: proximity sensor moves output to the earpiece, headsets
  win, calls survive screen lock, headset loss re-routes instead of ending.
  Install the WebRTC audio configuration globally so it is not reverted when
  the audio unit starts.

* fix(voice): install the macOS voice runtime under codex-resources/voice

Codex's helper only initializes from a codex-resources/voice directory and
exits with code 23 on initializeRuntime anywhere else, which the desktop
reported as "Voice could not connect". Bundle the runtime at
Contents/Resources/codex-resources/voice, reject other locations up front,
and report a helper that cannot start as an unavailable runtime.

Ship the runtime byte-for-byte with OpenAI's Developer ID signatures instead
of re-signing it ad hoc.

* fix(ios): reopen the call stage from the live strip and redo voice settings

The live strip in the bottom bar is a plain UIControl, which never sends
.primaryActionTriggered, so tapping it did nothing; listen for touchUpInside.
UI tests cover reopening the stage after the transcript and after minimizing.

Voice settings now follow the Settings list style: the resting orb, the
devices Codex can run on with their status, the voice as a pop-up menu, and
what to expect during a call.

* fix(ios): resume the orb animation when the app becomes active again

At willEnterForeground the app still reports .background, so the display
link never restarted and the orb stayed frozen after returning from Home.

* fix(ios): guard voice preview state in Release builds

* feat(voice): veil streamed caption words in on desktop and iPhone

Move the transcript's renderer-agnostic streaming veil into zeron-veil so
the voice call caption can use the same chunk fades on both platforms. A
new CaptionVeil keeps the veil aligned with the ellipsized tail and fades
the previous utterance out when the speaker turn changes; reduced motion
shows text directly. Desktop recolors GPUI runs; iOS gets UTF-16 spans
through CaptionFader and paints an attributed caption on a display link.
The desktop transcript keeps its behavior; the iOS transcript is untouched.

* fix(ui): step the voice stage aside when opening any session

Opening a session only hid the stage indirectly, when the selection changed,
so clicking the thread already under the stage (or the one you came from
Settings) did nothing. open_chat now hides the stage explicitly; the call
keeps running in the background.

* feat(voice): reuse host orchestrator chats across calls

* fix(voice): reserve orchestrator atomically and preserve rotation retries

* feat(voice): rotate the orchestrator transcript after 1000 entries

* feat(voice): package remote media runtime for Linux and Windows

* feat(voice): use the installed Codex helper everywhere and stop bundling it

Remote voice now plays audio through the client's own standalone Codex
installation, like local voice, instead of a runtime packaged inside
Zeron. The resolver moves to zeron-voice-media and is shared by the
harness and the desktop media endpoint; ZERON_VOICE_MEDIA_DIR remains a
development override. macOS, Linux and Windows packages no longer
contain Codex binaries, GStreamer/GLib or the Visual C++ runtime, so
Zeron takes on none of their redistribution or update obligations.
package-voice-runtime.py stays as a development projection tool.

Missing-runtime messages point to Codex's official installer, since npm
installs lack the voice runtime.

Notices and disclosures:
- THIRD_PARTY_NOTICES: full MIT chain for the orb (Bezel,
  gpui-thinking-orbs, thinking-orbs), Codex NOTICE, OpenAI trademark and
  non-affiliation statement, and WebRTC for iOS.
- The iOS app carries the orb's MIT notice; the Linux tarball now ships
  LICENSE and THIRD_PARTY_NOTICES.md.
- Microphone purpose strings on macOS and iOS state that voice sessions
  stream audio to OpenAI; dictation stays on device.
- Docs describe the voice data flow, and the acceptance checklist lists
  the legal and privacy decisions that block a public release.

* feat(ios): show the voice call in the Dynamic Island and on the Lock Screen

* fix(voice): hide the voice trigger when this device has no Codex

The microphone in the sidebar footer only shows when Codex is installed and
enabled on this device, following the same catalog the composer offers. It
re-reads after Settings → Agents changes and when returning to a window that
hides it. A start without Codex now asks for an install instead of a retry.

* test(voice): seed the real rotation threshold in the remote rotation test

* feat(voice): sound the start and end of a call on desktop and iPhone

A call sounds as it is placed, before the microphone opens, and again when
the user hangs up or a connected call ends. A failure to connect stays quiet
and explains itself. Nothing sounds in between. The iPhone plays them as
system sounds, so they follow the ringer switch.

* perf(voice): skip the rate limits round trip before each call

The pre-call probe read account/rateLimits/read, a ~1 s backend round
trip, and ran twice per call (prepare and negotiate). Its result was never
shown: the native backend makes the final usage decision. Dropping it
saves about 1.7 s per call on desktop and iPhone.

* perf(voice): release the orchestrator runtime 5 minutes after hang-up

The voice orchestrator's Codex runtime and MCP servers hold ~200 MB. Its
idle window was the generic 30 minutes, counted from the runtime's start,
so a call ending late in the window left a runtime reaped right after the
hang-up. It now idles 5 minutes, restarted at each hang-up.

Hang-ups wake the reaper directly, so even a short call restarts the
window, and a reap armed before a call began rechecks for it instead of
cutting the call.

* fix(voice): enable client-owned remote voice by default

* fix(harness): read whole resumed histories and report why stdout failed

509818ed capped every JSON-RPC line at 8 MiB on the transport shared by
text chats. A resumed long chat returns its history in one response
(54-71 MiB measured), so resume failed and was reported as an exit even
though Codex was alive. Lift the cap (voice bounds its own messages) and
keep the read error's cause for every waiting and later request.

* fix(harness): name the rejected request in JSON-RPC errors again

dca9a05f made peer rejections structured but dropped the method from
their message, so chats showed 'JSON-RPC rejection -32600: …' without
saying which request failed. Prefix the method again and render it as
upstream did, keeping the code available for auth detection.

* test: skip POSIX mode check on Windows hosts

* fix: launch Codex batch shims from plain paths and answer account/read in fake

* refactor(engine): remove the superseded local session RPC surface

The client-media protocol replaced these methods; nothing calls them anymore.

* refactor(harness): restore the shared JSON-RPC transport

Return the stdio transport every agent uses to its upstream behavior
(unbounded writes, no timeouts or polling timers) and keep only an
additive notification route that is registered while a subscriber
exists.

* fix(ui): let the full-window stage show the window glass

On translucent appearances the stage painted an opaque fill unlike the
new-thread page. Drop the fill there and fade out the page it covers.

* fix(ui): show the full-window stage over Settings

Settings replaces the workspace layout and never mounted the stage, so
opening it from there did nothing. Mount it beside the settings sidebar
and fade the page it covers.

* fix(voice-session): keep the live caption on the newest turn

Turns arrive interleaved: a user final often lands after the answer has
started streaming. Keep each turn's text separately and caption the
newest one, so a late final never takes the caption back and deltas
never restart it. Desktop and mobile now share this state.

* ci: build the desktop UI only in the UI workflow

The offline-linux job compiled zeron-ui without the WebKitGTK and
JSON-GLib packages its build script requires, so it failed every run.
Drop its UI step; the UI workflow already runs those lib tests and now
also runs the orb geometry test.
2026-10-06 23:47:32 -07:00
Gaël Cado
80b946b153
Add opt-in on-device dictation to the desktop composer (#591)
* feat(voice): add local Parakeet v3 capture and transcription backend

* feat(ui): add opt-in dictation settings and composer controls

* build(macos): package microphone permissions and voice attribution

* docs: describe desktop dictation behavior and runtime limits

* fix(ui): clarify dictation states and cancellation controls

* fix(ui): keep composer model controls right aligned

* feat(ui): give Voice a dedicated settings page

* fix(voice): support all native microphone sample formats

* fix(voice): retain model cleanup after interrupted downloads

* fix(ui): preserve dictation while pasted references resolve

* fix(ui): cancel dictation with Escape across composer controls

* fix(ui): refresh dictation state after empty undo and redo

* fix(ui): preserve dictated words on blank recognition results

* fix(voice): clarify retries while native inference finishes

* test(ui): verify repeated Send preserves unfinished dictation

* style(ui): format settings modules

* feat(voice): add microphone selection and streamline Voice settings

* feat(ui): visualize live dictation with a waveform and recording clock

* fix(ui): preserve waveform paint opacity

* feat(ui): morph composer controls into dictation track

* test(voice): exercise real inference on every desktop release target

* fix(voice): keep device choices fresh and cancellation accessible

* ci(voice): verify Linux release packages on x86 and ARM

* ci(voice): keep model and package probes out of permanent CI

* fix(voice): detect missing ALSA before activating Linux installs

* fix(voice): capture audio while Parakeet loads

Run capture independently of serialized model loading and inference. Retain stopped audio until the model is ready, close capture before reporting load failure, and hold admission through native work and stream teardown.

Cover loading, cancellation, device startup, rapid Stop, admission, and recording limits with deterministic coordinator tests.

* test(ui): verify and measure nonblocking dictation startup

Cover selected-draft preservation, delayed final results, single Send delivery, and late results after loading failures or finalization timeouts.

Add transcript-free debug timing from dictation activation to the Listening state and clarify asynchronous capture cancellation.

* docs(voice): explain concurrent capture and startup timing

Document audio retention during loading, cancellation and model-removal limits, race coverage, and the native startup timing procedure.

* fix(ui): stop Shell saves from reverting settings chosen elsewhere

The Shell republished its whole cached UiSettings on every save
(navigation, pane resize) and only refreshed a hand-kept list of fields
first. Anything missing from that list was silently reverted: leaving
Settings → Voice turned dictation off, and the microphone choice,
compact transcript, fit-content code fences, and diff split/wrap toggles
had the same bug.

Replace the list with a three-way merge against the store snapshot the
Shell last synced: fields the Shell changed win, every other field keeps
the store's value. The merge destructures UiSettings exhaustively, so a
new field fails to compile until it is merged too.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* feat(voice): hold to talk, default Cmd+D, shortcut on the Voice page

Dictation is now hold to talk. Holding the microphone (pointer, or
Enter/Space while it is focused) or the shortcut records; releasing
transcribes. A pointer release outside the button still counts. For the
shortcut, letting go of its key or any of its modifiers ends the hold,
because macOS does not deliver key-up for Command chords. A release
within 300 ms explains hold to talk instead of transcribing a blip, and a
release that only answered the permission prompt records nothing.
Assistive-technology Click still starts and then finishes, since it
cannot hold.

The default shortcut is Cmd/Ctrl+D (unbound elsewhere). Its rebinding row
moves from Settings → Shortcuts to Settings → Voice through a reusable
ShortcutField that shares the Shortcuts page's chip and conflict rules.
Settings → Shortcuts re-reads the stored keymap while not recording, so
its own commits cannot revert a binding changed on the Voice page.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(voice): harden capture, worker and download against edge cases

- Keep the capture flags outside the sample lock. The capture loop polled
  them under the mutex every 10 ms, so the real-time callback's try_lock
  could fail and drop a buffer of speech.
- Catch a native panic on the worker. A panicking job killed the only
  worker thread, leaving every later session "unavailable" until restart.
- Keep loaded weights when a session fails for a microphone or recording
  reason; dropping them made the next attempt reload 670 MB.
- Time out a download request whose response headers never arrive.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(ui): dictation review fixes for focus, shortcuts and Windows

- Enter/Space hold on the focused microphone no longer moves focus to the
  editor, which sent its key-up (and auto-repeat spaces, or Enter-to-send)
  to the draft and left the microphone live.
- A key release caused by focus leaving no longer pulls focus back, and an
  unparseable stored shortcut falls back to the default when matching its
  release, as apply_keymap already does.
- Another source can take over a hold whose release went missing, so the
  microphone or shortcut can always end it.
- Dictation cannot start while a queued row is acquiring its edit lease,
  which would replace the draft and silently drop the transcript.
- With dictation off (the default) ⌘D propagates to any other binding of
  the chord instead of being swallowed in the composer.
- The Voice page's shortcut row is always shown, conflicts with a feature
  page's shortcut name that page, and recording stops if the window closes
  so Appshots' capture shortcut is never left suspended.
- Show Settings → Voice on Windows; the PR ships the Windows backend and
  only Appshots is macOS/Linux-only.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* fix(ui): give the composer microphone its siblings' hover

At rest the microphone snapped to a different surface colour on hover;
it now uses the paperclip's eased ink wash. While live it dims like Send,
and its focus ring and tooltip match the neighbouring composer buttons.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Wing <contact@winglee.io>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-01 15:16:51 -07:00
Gaël Cado
0a80fc15c8
Add desktop Appshots with queue-safe delivery and iOS presentation (#216)
Capture application windows on macOS and Linux, stage source-labelled cards, and preserve Appshot context through attachment upload and queue editing. Add dedicated keyboard-accessible settings, bounded native capture and enrichment, stable queue thumbnails, and native iOS presentation.

Co-authored-by: wing-anara <wing@anara.com>
2026-09-12 17:11:25 -07:00