make dash0 optional for the demos to be published on otel blog

Signed-off-by: Kasper Borg Nissen <kasper.nissen@dash0.com>

Author: kaspernissen

contour/README.md

@@ -1,12 +1,13 @@
 # Contour with OpenTelemetry
 
-Demonstrates Contour ingress controller with OpenTelemetry metrics, tracing, and logs using Dash0.
+Demonstrates Contour ingress controller with OpenTelemetry metrics, tracing, and logs using a local observability stack and/or Dash0.
 
 ## What it does
 
 - Creates a multi-node Kind cluster with Contour/Envoy
+- Deploys local observability stack: Jaeger, Prometheus, and OpenSearch
 - Configures OTLP metrics, distributed tracing, and JSON access logs
-- Deploys OpenTelemetry Collectors (DaemonSet + Deployment) with trace-logs correlation
+- Deploys OpenTelemetry Collectors (DaemonSet + Deployment) with dual export to Dash0 and local stack
 - Includes Node.js demo application with auto-instrumentation
 - Uses Gateway API with HTTPRoute for modern, standards-based routing
 
@@ -16,6 +17,7 @@ Demonstrates Contour ingress controller with OpenTelemetry metrics, tracing, and
 - Kind
 - kubectl
 - Helm 3
+- Optional: Dash0 account with API token
 
 ## Setup
 
@@ -39,6 +41,44 @@ Demonstrates Contour ingress controller with OpenTelemetry metrics, tracing, and
 - **Logs**: JSON structured access logs with automatic trace_id/span_id extraction for correlation
 - **Gateway API**: Modern Kubernetes networking with GatewayClass, Gateway, and HTTPRoute resources
 
+## Accessing Telemetry
+
+The demo sends telemetry to both Dash0 (if configured) and a local observability stack for offline inspection.
+
+### Dash0 (Optional)
+If you configured Dash0 credentials, log in to your Dash0 dashboard to view:
+- **Traces**: Filter by `service.name = "contour"` or `"envoy"`
+- **Metrics**: Search for `envoy_*` and `contour_*` metrics
+- **Logs**: Access logs with correlated trace IDs
+
+### Local Observability Stack
+
+**Jaeger (Traces):**
+```bash
+kubectl port-forward -n default svc/jaeger-query 16686:16686
+```
+Visit: http://localhost:16686
+
+**Prometheus (Metrics):**
+```bash
+kubectl port-forward -n default svc/prometheus 9090:9090
+```
+Visit: http://localhost:9090
+
+**OpenSearch Dashboards (Logs):**
+```bash
+kubectl port-forward -n default svc/opensearch-dashboards 5601:5601
+```
+Visit: http://localhost:5601
+- Username: `admin`
+- Password: `SecureP@ssw0rd123`
+
+To view logs in OpenSearch Dashboards:
+1. Navigate to "Discover" in the left menu
+2. Create an index pattern: `otel-logs*`
+3. Select `@timestamp` as the time field
+4. Explore the logs with trace correlation
+
 ## Load Testing
 
 Generate traffic to test observability:

contour/collector/otel-collector-daemonset-local.yaml

@@ -0,0 +1,162 @@
+mode: daemonset
+image:
+  repository: otel/opentelemetry-collector-contrib
+
+resources:
+  limits:
+    memory: 512Mi
+  requests:
+    memory: 256Mi
+
+clusterRole:
+  create: true
+  rules:
+    - apiGroups: [""]
+      resources: ["nodes/proxy"]
+      verbs: ["get"]
+
+tolerations:
+  - key: node-role.kubernetes.io/control-plane
+    operator: Exists
+    effect: NoSchedule
+
+presets:
+  logsCollection:
+    enabled: true
+  kubernetesAttributes:
+    enabled: true
+  kubeletMetrics:
+    enabled: true
+  hostMetrics:
+    enabled: true
+
+config:
+  processors:
+    # Memory limiter to prevent OOM
+    memory_limiter:
+      check_interval: 2s
+      limit_percentage: 75
+      spike_limit_percentage: 15
+
+    # Transform processor to extract trace_id and span_id from JSON traceparent field (Contour/Envoy logs only)
+    transform/trace-extract:
+      log_statements:
+        - context: log
+          statements:
+            # Parse JSON body if it's a string and contains traceparent
+            - set(attributes["parsed_body"], ParseJSON(body)) where IsString(body) and IsMatch(body, "^\\{.*\\}$") and IsMatch(body, ".*traceparent.*")
+            # Only process logs that have traceparent field
+            - set(trace_id.string, Substring(attributes["parsed_body"]["traceparent"], 3, 32)) where attributes["parsed_body"]["traceparent"] != nil and IsMatch(attributes["parsed_body"]["traceparent"], "^00-[a-f0-9]{32}-[a-f0-9]{16}-[0-9a-f]{2}$")
+            - set(span_id.string, Substring(attributes["parsed_body"]["traceparent"], 36, 16)) where attributes["parsed_body"]["traceparent"] != nil and IsMatch(attributes["parsed_body"]["traceparent"], "^00-[a-f0-9]{32}-[a-f0-9]{16}-[0-9a-f]{2}$")
+            # Update the body only for logs that had traceparent
+            - set(body, attributes["parsed_body"]) where attributes["parsed_body"]["traceparent"] != nil
+
+    # Batch processor for efficient export
+    batch:
+      timeout: 5s
+      send_batch_size: 512
+
+    k8sattributes:
+      extract:
+        metadata:
+          - k8s.namespace.name
+          - k8s.deployment.name
+          - k8s.replicaset.name
+          - k8s.statefulset.name
+          - k8s.daemonset.name
+          - k8s.cronjob.name
+          - k8s.job.name
+          - k8s.node.name
+          - k8s.pod.name
+          - k8s.pod.uid
+          - k8s.pod.start_time
+          - k8s.container.name
+        # Disabled labels/annotations to avoid OpenSearch mapping conflicts
+        # labels:
+        #   - from: pod
+        #     key_regex: (.*)
+        #     tag_name: k8s.pod.label.$${1}
+        # annotations:
+        #   - from: pod
+        #     key_regex: (.*)
+        #     tag_name: k8s.pod.annotation.$${1}
+      filter:
+        node_from_env_var: K8S_NODE_NAME
+      passthrough: false
+      pod_association:
+        - sources:
+          - from: resource_attribute
+            name: k8s.pod.ip
+        - sources:
+          - from: resource_attribute
+            name: k8s.pod.uid
+        - sources:
+          - from: connection
+
+  receivers:
+    kubeletstats:
+      insecure_skip_verify: true # For testing purposes. Remove for production.
+      metrics:
+        container.cpu.usage:
+          enabled: true
+        k8s.node.cpu.usage:
+          enabled: true
+        k8s.pod.cpu.usage:
+          enabled: true
+        k8s.pod.cpu_limit_utilization:
+          enabled: true
+        k8s.pod.cpu_request_utilization:
+          enabled: true
+        k8s.pod.memory_limit_utilization:
+          enabled: true
+        k8s.pod.memory_request_utilization:
+          enabled: true
+
+  exporters:
+    # Forward to deployment collector for local stack export
+    otlp:
+      endpoint: otel-collector-opentelemetry-collector.opentelemetry.svc.cluster.local:4317
+      tls:
+        insecure: true
+
+    # OpenSearch exporter (local logs)
+    opensearch/log:
+      http:
+        endpoint: https://opensearch-cluster-master.default.svc.cluster.local:9200
+        auth:
+          authenticator: basicauth/opensearch
+        tls:
+          insecure_skip_verify: true
+      logs_index: otel-logs
+
+  extensions:
+    basicauth/opensearch:
+      client_auth:
+        username: admin
+        password: "SecureP@ssw0rd123"
+
+  service:
+    extensions:
+      - basicauth/opensearch
+      - health_check
+    pipelines:
+      logs:
+        processors:
+          - memory_limiter
+          - k8sattributes
+          - transform/trace-extract
+          - batch
+        exporters:
+          - opensearch/log
+      metrics:
+        processors:
+          - memory_limiter
+          - batch
+        exporters:
+          - otlp
+      traces:
+        processors:
+          - memory_limiter
+          - batch
+        exporters:
+          - otlp