feat(firecrawl): Day 3 - Complete Kubernetes manifests for Firecrawl deployment

- Created PersistentVolumeClaim for PostgreSQL (10GB, nfs-emporium)
- Created ConfigMaps for API and Playwright service configuration
- Created 7 Deployment manifests:
  * firecrawl-api (2 CPU, 4-6GB RAM)
  * firecrawl-api-worker (1 CPU, 3-4GB RAM)
  * firecrawl-api-nuq-worker (1 CPU, 3-4GB RAM)
  * firecrawl-playwright (2 CPU, 4GB RAM, 1GB tmpfs)
  * nuq-postgres (1 CPU, 2GB RAM, 10GB PVC)
  * redis (0.5 CPU, 1GB RAM)
  * rabbitmq (0.5 CPU, 1GB RAM)
- Created 5 ClusterIP Services for inter-service communication
- Created HTTPRoute for external access via Gateway API
  * Primary hostname: spaceship-earth.local.mk-labs.cloud
  * Alias: firecrawl.local.mk-labs.cloud
- All manifests validated with kubectl dry-run=client

Next steps (Day 4): Configure ExternalSecrets for 1Password integration
Next steps (Day 5): Deploy to cluster and verify functionality

Total resources: 8 CPU, 22GB RAM, 10GB storage
This commit is contained in:
Hermes Agent service account
2026-06-06 17:43:22 -05:00
parent e5d24f557a
commit 6023ee25e1
17 changed files with 655 additions and 0 deletions

View File

@@ -0,0 +1,60 @@
apiVersion: apps/v1
kind: Deployment
metadata:
name: firecrawl-api
namespace: firecrawl
labels:
app.kubernetes.io/name: firecrawl
app.kubernetes.io/component: api
app.kubernetes.io/part-of: firecrawl
spec:
replicas: 1
selector:
matchLabels:
app: firecrawl-api
template:
metadata:
labels:
app: firecrawl-api
app.kubernetes.io/name: firecrawl
app.kubernetes.io/component: api
spec:
containers:
- name: api
image: the-seas.local.mk-labs.cloud/library/firecrawl-api:latest
imagePullPolicy: Always
ports:
- name: http
containerPort: 3002
protocol: TCP
envFrom:
- configMapRef:
name: firecrawl-config
- secretRef:
name: firecrawl-secrets
env:
- name: FLY_PROCESS_GROUP
value: "app"
resources:
requests:
cpu: 1000m
memory: 4Gi
limits:
cpu: 2000m
memory: 6Gi
livenessProbe:
httpGet:
path: /v0/health/liveness
port: 3002
initialDelaySeconds: 60
periodSeconds: 10
timeoutSeconds: 5
failureThreshold: 3
readinessProbe:
httpGet:
path: /v0/health/readiness
port: 3002
initialDelaySeconds: 30
periodSeconds: 5
timeoutSeconds: 3
failureThreshold: 3