0
Fork 0
mirror of https://github.com/oblien/openship.git synced 2026-11-18 06:55:56 +00:00
Commit graph

137 commits

Author SHA1 Message Date
Hydra
3561b6ca0a ci(release): split Docker journeys across four complete shards 2026-11-12 22:23:56 +02:00
Hydra de lerne
739728ce11
fix(migration): preserve project services and reuse domain routing (#1740) 2026-11-12 21:06:52 +02:00
Hydra
a18878316c docs: prepare critical v0.9.12 release notes 2026-11-12 18:30:02 +02:00
Hydra de lerne
db8a5cf4f4
fix(mail): complete local backups and portable server restores (#1734)
* fix(mail): complete local backups and portable server restores

* test(mail): report engine diagnostics on round-trip failure

* fix(mail): stop Postfix writers before container snapshots

* fix(mail): apply Postfix shutdown in the daemon action renderer

* test(mail): install GNU tar on the remote fixture host
2026-11-12 17:03:11 +02:00
Hydra de lerne
4ab89b9510
fix(build): keep environment values out of Dockerfiles and logs (#1674)
* fix(build): keep environment values out of Dockerfiles and logs

* test(build): exercise secret transport in deployment CI

* test(build): align cloud fixture file and command identities

* fix(build): validate secrets before allocating build resources
2026-11-11 16:54:35 +02:00
Saim Shafique
ea0d015b86
Preserve mail logs and ban history safely across engine updates (#1705)
* fix(mail): persist mail logs, fail2ban database and ignoreip across engine updates

Mail engine updates recreate the container (docker rm -f + docker run),
so anything not on a bind mount is lost: /var/log (mail.log, dovecot and
fail2ban logs), fail2ban's SQLite database, and operator ignoreip
customisations in /etc/fail2ban.

- Bind-mount /var/log and /var/lib/fail2ban from the host mail state dir.
  Deliberately not /etc/fail2ban: a seed-once mount would hide later image
  changes (same trap as #392's master.cf).
- Render operator ignoreip additions (OPENSHIP_MAIL_F2B_IGNOREIP, passed
  through engine.env) into a jail.d override on every boot, as baked
  jail.local value + operator value, so image defaults are never dropped.
- Run cron under supervisord so logrotate's daily job actually fires for
  the now-persisted logs; logrotate is installed explicitly (only a
  Recommends of rsyslog) and build-gated.

Fixes #1701

* Preserve existing mail state before replacement and repair supervised log rotation

---------

Co-authored-by: Hydra <abdelhamedmo59@gmail.com>
2026-11-11 16:54:11 +02:00
Saim Shafique
0df888e864
fix(updates): report image services with an unknown deployed digest instead of up to date (#1706)
* fix(updates): report image services with an unknown deployed digest instead of up to date

When the active service_deployment row has no image_digest — a carried
service loses it when a per-service update upserts the row — the feed
compared digests only when both were known and fell back to the equal
ref strings, so the service read as up to date and `?behind=1` dropped
the project entirely.

The deployed side is now marked unknown, not current: evaluateDrift
flags image services whose row has no digest, and the feed resolves
those against the live daemon before rendering — the running
container's image ID against the image ID the configured tag resolves
to right now, the same test the deploy pipeline uses before carrying
an unchanged service. A mismatch is behind; matching images recover
the tag's RepoDigest onto the row when the registry comparison agrees;
anything the daemon cannot answer stays unknown and the project is
kept visible with an `unverified` flag instead of being dropped.

Fixes #1702

* fix(updates): narrow the live runtime to DockerRuntime before resolving unknown digests

`resolveDeploymentRuntimeForRead` returns a `RuntimeAdapter`, and
`prepareDeploymentImage` is Docker-only, so the Typecheck job failed
with TS2345 at local-image-drift.ts:79. Guard the call with the same
`instanceof DockerRuntime` check `recordDeploymentArtifacts` uses:
other runtimes leave the services unknown, and the runtime is still
disposed on every path.

---------

Co-authored-by: Hydra <abdelhamedmo59@gmail.com>
2026-11-11 16:04:58 +02:00
Hydra de lerne
a2384998ba
Propose source image updates through reviewed GitHub PRs (#1717)
* feat(updates): propose reviewed image changes in repository PRs

* Reuse deployment image validation and publish source-update API references

* Keep shared and inherited Compose image edits in the source editor

* Offer reviewed source updates for pinned advisory images
2026-11-11 13:55:46 +02:00
Hydra de lerne
430a5ca900
Fix webmail printing and refresh security dependencies (#1718)
* Render mail print metadata as text and isolate print documents

* Update application dependencies for published security advisories

* Require patched Dovecot and Pigeonhole in mail images
2026-11-11 13:35:06 +02:00
Hydra de lerne
99904af0f8
Add platform imports and refresh dashboard and Cloud website (#1713)
* feat: add platform migrations and refresh the Cloud experience

* fix(ci): run MongoDB 8 imports on compatible runners

* docs(web): add Railway and Vercel migration pages

* feat(dashboard): add shared dotenv text editing and top add action

* fix(dashboard): wrap text editor actions on narrow screens
2026-11-11 11:58:09 +02:00
Hydra de lerne
2aef5b840c
Improve deployment speed, verification, and cancellation emails (#1683)
* perf: reuse Docker builders and parallelize independent Compose work

* test: exercise declared dependency gates on the isolated Docker host

* fix: preserve dependency ownership and native cache maintenance

* fix: drain dependency readiness failures through the shared task barrier

* test: align server recovery expectations with source scan recovery

* fix: retain released dependency providers during publication recovery

* Keep route verification and bound parallel deployment work safely

* Send scoped cancellation confirmations through the customer email queue

* Offer help without treating one canceled subscription as account churn

* Invite cancellation feedback and offer direct support

* Preserve native Docker dependency cache across source changes

* Keep runtime dependencies ahead of changing API source

* Split independent Docker regression suites across CI jobs

* Use fresh connections for routing configuration probes

* Show published deployments while final startup verification runs

* Complete verification translations and align test types
2026-11-09 13:51:19 +02:00
Hydra de lerne
da49936e06
fix(cli): recover failed updates and gate installed VPS releases (#1662)
* fix(cli): stream release downloads safely and gate real VPS updates

* fix(cli): recover update retries and gate installed release payloads

* test(release): include installed CLI gate in npm policy cases
2026-11-08 14:27:31 +02:00
fatih akyon
3e42fc6614
fix(routing): make static 404 responses opt-in (#1626)
* fix(edge): serve a static site's 404.html for missing paths

* fix(routing): make static SPA fallback explicit and preserve defaults

* test(routing): update static fallback checks and run HTTP coverage

* fix(i18n): complete inbound alias guidance across locales

* test(monitoring): isolate the session in stream fixtures

---------

Co-authored-by: Hydra <abdelhamedmo59@gmail.com>
2026-11-06 10:36:34 +02:00
Hydra de lerne
2250f91684
fix(assistant): use Codex device login on remote hosts (#1600)
* fix(assistant): select Codex sign-in for the assistant host

* fix(assistant): consume released Mindwire 0.1.61
2026-11-04 13:20:37 +02:00
Hydra de lerne
c755d78dca
fix(backups): validate restore uploads before clearing the destination (#1456)
* fix(backups): validate restore uploads before mounting the target

* docs(backup): explain deferred restore error propagation

* test(backups): identify the mail size-history fixture correctly

* fix(backups): verify the daemon received the complete restore upload

* fix(backups): harden staged restore validation and timeouts
2026-11-04 04:27:04 +02:00
Hydra de lerne
d005eacc25
feat(catalog): add Appwrite and consolidate priority apps (#1594)
* Add OpenTelemetry Collector to the apps catalog

Adds otel-collector as a one-click app template (docker-compose kind,
category: analytics), alongside Grafana and the other observability
apps. Uses the upstream otel/opentelemetry-collector-contrib image
unmodified — its baked-in default config already stands up OTLP gRPC
(4317) and HTTP (4318) receivers plus a debug exporter, so no custom
command/config override is needed to get a usable collector running.

Also wires up brand-mark resolution:
- AppLogo.tsx: catalog logo "otel-collector" → simpleicons "opentelemetry"
- ServiceIcon.tsx: image name → same brand mark, for services created
  from a raw compose file rather than the catalog (both
  "opentelemetry-collector-contrib" and "otel-collector" match)

catalog.json regenerated from apps/catalog/*.json per the drift test in
apps/catalog.test.ts (gen-catalog.ts requires bun, unavailable in this
environment — reproduced its exact merge/sort logic with a plain node
script; verified the new entry lands alphabetically and the rest of the
file is a no-op diff).

* feat: add Beszel to app catalog

* feat(catalog): add Prometheus

One-click Prometheus (prom/prometheus:v3.15.1) for the monitoring stack
requested in #1432. Metrics and config live in named volumes, so scrape
targets added to /etc/prometheus/prometheus.yml survive restarts and
redeploys. Prometheus has no login, so the connection notes point users to
domain password protection.

Refs #1432

* fix(ui): add the Prometheus app logo

The dashboard's APP_LOGO map needs an entry for every catalog app
(app-logo.test.ts). Use the simpleicons prometheus mark, like Grafana.

Refs #1432

* feat(catalog): add Loki

One-click Loki (grafana/loki:3.7.9) for the monitoring stack requested in
#1432. Logs live in a named volume and are kept for 31 days through the
compactor's retention flags. The image is distroless, so there is no shell
healthcheck and the flags are passed with commandArgv. Loki has no login,
so the connection notes point users to password protection.

Refs #1432

* fix(web): ship the Loki logo on the website too

Vendored app logos must be byte-identical in the dashboard and website
public folders (scripts/app-marketplace.test.ts).

Refs #1432

* feat(catalog): add VictoriaMetrics

One-click VictoriaMetrics (victoriametrics/victoria-metrics:v1.154.1) for the
monitoring stack requested in #1432. It is protected by default: basic auth
with username admin and an auto-generated password, passed through
-envflag.enable so it never appears in the command line. Metrics are kept
for one year in a named volume; /health stays open for the healthcheck.

Refs #1432

* feat(catalog): add standalone pgAdmin4 app

Adds pgAdmin4 as its own one-click catalog app, separate from the existing
PostgreSQL + pgAdmin bundle (postgresql.json). This one ships with no
database of its own — it's for administering any reachable PostgreSQL
server, including another Openship-deployed database's private connection,
a managed cloud database, or anything else on the network.

Reuses the exact service shape already proven by postgresql.json's pgadmin
service (same image/version, port, healthcheck): dpage/pgadmin4:9.18,
PGADMIN_DEFAULT_EMAIL + PGADMIN_DEFAULT_PASSWORD (the officially documented,
fully deterministic setup — no random/log-only credential to work around),
surfaced directly in the connection card.

Also maps the pgAdmin4 brand mark in packages/ui/src/AppLogo.tsx: simpleicons
carries no pgAdmin glyph (cdn.simpleicons.org/pgadmin4 404s), so it resolves
to the project's GitHub org avatar, the same pattern already used for
Ollama, vLLM, and Miniflux.

Verified against the real image (dpage/pgadmin4:9.18): booted it standalone
with the same env vars, confirmed the /misc/ping healthcheck responds once
gunicorn finishes initializing (needs the ~60s startPeriod already used by
postgresql.json).

Verified: bun scripts/gen-catalog.ts + bunx vitest run src/apps/catalog.test.ts (46/46 passing),
bun run --cwd packages/ui lint (tsc clean).

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

* feat(catalog): add Listmonk app

Adds Listmonk (newsletter/mailing-list manager) as a one-click catalog app:
a private Postgres instance plus the Listmonk service, non-interactive
install + Super Admin creation on first boot via the officially documented
LISTMONK_ADMIN_USER/LISTMONK_ADMIN_PASSWORD env vars, surfaced directly in
the connection card.

commandArgv runs "./listmonk --install --idempotent --yes && exec
./listmonk" — install is a no-op on redeploy (idempotent flag), so the
same command is safe on every boot, no separate prepare step needed.

Verified against the real image (listmonk/listmonk:v6.2.0), not just docs:
- Ran the exact install+serve command against a live Postgres, confirmed
  the superadmin user is created non-interactively ("creating superadmin
  user 'admin'" in the log).
- The image's default app.address is localhost:9000 (unreachable from
  outside the container) — set LISTMONK_app__address=0.0.0.0:9000, confirmed
  it then actually listens and responds.
- Logged in via POST /admin/login with the exact generated password,
  confirmed an authenticated session (302 + session cookie, 200 on an
  authenticated /api/settings call).
- Confirmed /health returns 200 for the healthcheck.
- bun scripts/gen-catalog.ts + bunx vitest run src/apps/catalog.test.ts: 46/46 passing
  (added minEngine: 0.6.6, required by the schema whenever commandArgv is used).

Continues M3 (Tier B: app + one DB), first of this batch.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

* fix(apps): declare a host port so the app can't collide with others

Without a ports entry the host port equals the container port, so a second
app on the same port fails with 'port is already allocated'.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

* fix(apps): declare a host port so the app can't collide with others

Without a ports entry the host port equals the container port, so a second
app on the same port fails with 'port is already allocated'.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

* fix(apps): use a unique host port, not the container port

In port mode the host port is taken from the ports entry, so 'N:N' still
collides with whatever already holds that port (80, 3000, ...). Match the
other catalog apps and publish on a distinct host port.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

* fix(apps): use a unique host port, not the container port

In port mode the host port is taken from the ports entry, so 'N:N' still
collides with whatever already holds that port (80, 3000, ...). Match the
other catalog apps and publish on a distinct host port.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

* feat(catalog): add Appwrite and Alertmanager with verified community recipes

---------

Co-authored-by: Giovanni Martins <giovannidealmeidamartins@gmail.com>
Co-authored-by: anshori <anshoriacc@gmail.com>
Co-authored-by: Asad Khan <55049186+AsadKhanAb17@users.noreply.github.com>
Co-authored-by: alkomy <alkomy@icloud.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
2026-11-04 04:11:47 +02:00
Hydra de lerne
9ab270c95c
feat(updates): add scoped host patches and observable advisory scans (#1566)
* feat(updates): allow workspace admins to pause runtime advisory checks

* fix(updates): repair upgrade fixture and reuse shared policy guards

* feat(updates): add scoped host patches and observable advisory scans

* fix(updates): report handled host maintenance failures

* fix(updates): load host advisory operations on demand

* refactor(updates): share server patch run lifecycle and logs

* test(cli): align compose sync with namespace isolation

* test(mail): exercise support delivery over verified TLS
2026-11-03 19:37:18 +02:00
Hydra de lerne
1d0cb17d86
fix(compose): review source changes before redeploy and retire removed services safely (#1574) 2026-11-03 17:09:48 +02:00
fatih akyon
c946506a97
build: refresh GeoIP before release tags (#1516) 2026-11-02 15:23:05 +02:00
Hydra
42ffa8a9ef fix(assistant): ship compatible Mindwire runtime for scoped agents 2026-11-02 10:26:09 +02:00
Hydra
2e7d98c7be chore(release): prepare recommended v0.9.6 2026-11-01 16:22:01 +02:00
Hydra de lerne
8488a292e0
fix(db): recover crashed PGlite owners with kernel exclusion (#1528)
* fix(db): recover PGlite locks after Linux PID reuse

* fix(db): retain kernel exclusion across PGlite PID namespaces

* fix(db): retain kernel ownership through process exit handlers
2026-11-01 14:12:48 +02:00
Hydra de lerne
4d6075bd07
fix(migration): deploy stateless single-app project moves (#1534)
* fix(migration): deploy stateless single-app project moves

* fix(ci): replace stale migration assertion and use macOS 15
2026-11-01 12:16:23 +02:00
Hydra de lerne
08b77de44e
fix(deployments): resolve monorepo runtime images per service (#1510) 2026-10-28 12:09:29 +03:00
Muhammad Asad Khan
e49ea41645
feat(cluster): admit and apply project Kubernetes manifests (#1479)
* feat(cluster): admit and apply project Kubernetes manifests

First step toward #1039: the engine for deploying user-supplied Kubernetes
manifests into a k3s cluster project, with no UI or deploy wiring yet.

- parseProjectManifests: multi-document YAML, size and object-count limits,
  errors that name the failing document.
- admitProjectManifests: an allowlist of namespaced kinds (ConfigMap, Secret,
  ClusterIP Service, Deployment, Job, CronJob). Refuses cluster-scoped kinds,
  other namespaces, ownerReferences, finalizers, reserved labels, NodePort,
  host networking/PID/IPC, hostPath, PVCs, privileged containers, hostPort and
  non-default service accounts. Pins objects to the project namespace, stamps
  ownership labels and a content hash, and disables token automount.
- applyProjectManifests: create, skip unchanged, replace changed objects it
  owns (keeping a Service's cluster IP), and prune manifest objects that are
  no longer declared. Openship's own app objects are never replaced.
- Project deletion accepts owned ConfigMap, Job and CronJob objects.

Refs #1039

* fix: preflight manifest changes and protect generated ownership

* fix(cluster): keep manifest deployments out of native release sweeps

---------

Co-authored-by: Hydra <abdelhamedmo59@gmail.com>
2026-10-27 08:19:19 +03:00
Hydra de lerne
2aa69de4ce
fix(builds): keep BuildKit sessions alive during long builds (#1490)
* fix(builds): keep BuildKit sessions alive during long builds

* test(builds): stub the shared daemon request boundary in pipeline tests
2026-10-27 06:17:39 +03:00
Hydra de lerne
b981d89920
fix(catalog): start CockroachDB services securely (#1486)
* fix(catalog): start CockroachDB with persistent TLS and credentials

* style(test): format CockroachDB regression coverage
2026-10-25 22:55:18 +03:00
Hydra
a7556c4b45 fix(updates): restore Compose readiness and preflight security actions
Cover full published-stack upgrades, retained data and signed sessions, cold restart and fresh installation. Reuse runtime preflight in advisory views and expose source-redeploy prerequisites. Refs #1461 and #1462.
2026-10-24 19:51:21 +03:00
Hydra
d9613485a4 ci: verify managed image resolution inside both API images 2026-10-24 16:25:21 +03:00
Hydra de lerne
11c0b508b1
fix(deploy): preserve active build leases during image retention (#1371)
* fix(deploy): preserve active build leases during image retention

* test(backups): identify the mail size-history fixture correctly
2026-10-24 14:39:27 +03:00
Hydra de lerne
3a8373f7eb
fix(backups): protect standalone application volumes (#1455) 2026-10-24 14:00:35 +03:00
Hydra de lerne
c9863267a5
feat: add runtime security advisories and annual Cloud billing (#1453)
* feat: add runtime security advisories and annual Cloud billing

* fix(updates): show runtime advisories in the global update center

* fix(updates): synchronize advisory consent across global views

* refactor(updates): reuse normal refresh and environment flow
2026-10-24 13:37:05 +03:00
Mohamed Farahat
a5eb1081f4
test(adapters): guard restore stdin half-close under bun (#1448) 2026-10-24 06:27:18 +03:00
Mohamed Farahat
2d4194f031
fix(ci): typecheck shared packages and fix db test types (#1445) 2026-10-24 06:24:48 +03:00
Hydra de lerne
8a2d7208cd
ci: finish Docker release coverage using isolated test shards (#1447)
* ci: shard serial Docker release tests across isolated runners

* test(deploy): preserve shared image volumes during release command cleanup

* test(retention): resolve read operations against the fixture daemon
2026-10-24 06:23:47 +03:00
Hydra de lerne
f3a55b7f49
fix(security): ship patched runtimes and add 0.9.4 changelog (#1430)
* fix(security): pin patched Node and Bun runtimes across releases

* fix(build): pass bootstrap selection independently of eval arguments

* test(build): expect the patched default Bun image in detection

* docs: prepare 0.9.4 changelog since 0.9.3
2026-10-23 20:31:37 +03:00
Hydra
2cd519e8ce fix(deploy): reconcile attached infrastructure with completed-build retries 2026-10-23 00:32:24 +03:00
Hydra
52dc66b6b0 fix(edge): refresh route protection integration and private rollback 2026-10-22 18:54:00 +03:00
Hydra
8bf6a87a03 fix(swarm): preserve current host policy and reject unsupported swap caps 2026-10-22 17:16:35 +03:00
Hydra
7753ed94cd Merge remote-tracking branch 'refs/remotes/origin/swarm-combined-main-20261022' into feat/swarm-combined-20261022
# Conflicts:
#	apps/api/src/modules/system/server-management.routes.ts
#	packages/adapters/src/index.ts
#	packages/db/drizzle/meta/_journal.json
2026-10-22 17:12:15 +03:00
Hydra
8e95307699 fix: preserve service swap guarantees across configuration writes 2026-10-22 15:52:58 +03:00
Hydra de lerne
d5f6ce0a1a
Merge pull request #1401 from oblien/feat/deploy-artifact-retry-20261021
feat(deployments): retry completed Docker builds without rebuilding
2026-10-22 04:32:35 +03:00
Hydra
51605e5be9 fix(web): retain preview images across public pages 2026-10-22 04:09:28 +03:00
Hydra
d2b34f4fbd fix(routing): align wizard protection with controller support
Merge the updated Swarm discovery parent and regenerate MCP references. Match the wizard to the existing self-hosted controller gate so hosted BYOC cannot stage unsupported route passwords. Cover hosted BYOC, self-hosted servers, cloud targets, and cluster targets with the real editor.
2026-10-22 01:58:07 +03:00
Hydra
fa2ce8d300 Merge main and regenerate the Swarm MCP reference 2026-10-22 01:43:37 +03:00
Hydra
13819a6f33 test: keep retry and cutover CI additions independently mergeable 2026-10-21 21:58:09 +03:00
Hydra
df292b188b fix: admit safe Compose cutovers and retire after release commit
Stage only independent services with verified spare target capacity. Keep
incumbents untouched until readiness, complete routing, and the durable
release outcome. Restore routes before cancellation cleanup and preserve
both workloads when restoration cannot be verified.

Co-authored-by: Daniel Greer <13854262+greerso@users.noreply.github.com>
2026-10-21 21:53:40 +03:00
Hydra
22eefc7d25 feat(deployments): retry completed Docker builds without rebuilding 2026-10-21 21:46:37 +03:00
Hydra
1247e2c95a fix: keep runtime refresh explicit and honor cleared build caches 2026-10-21 19:22:51 +03:00
Hydra de lerne
64368a0ac9
Merge pull request #1385 from oblien/fix/mail-editor-security-dependencies-20261021
fix(email): update and unify patched editor dependencies
2026-10-21 15:23:31 +03:00