https://trinidadmarroquin.com/ Recent content in Home on Trinidad Marroquin Hugo en Trinidad Marroquin Wed, 05 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/gitops-owned-vsphere-csi-maintenance-pause/ Wed, 05 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/gitops-owned-vsphere-csi-maintenance-pause/ Field note for pausing vSphere CSI controllers during storage incidents when Argo CD, ApplicationSets, and self-heal keep restoring controller replicas. https://trinidadmarroquin.com/field-notes/kubernetes-retained-pv-missing-pvc-rebind/ Wed, 05 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/kubernetes-retained-pv-missing-pvc-rebind/ Field note for recovering a workload that references a missing PVC when a retained PV still exists and can be rebound explicitly. https://trinidadmarroquin.com/field-notes/vsphere-cdrom-host-device-cleanup-govc/ Wed, 05 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/vsphere-cdrom-host-device-cleanup-govc/ Field note for auditing and cleaning up vSphere VM CD-ROM devices that remain backed by Host Device instead of Client Device, including govc limits around powered-on VMs. https://trinidadmarroquin.com/field-notes/vsphere-csi-cns-extendvolume-triage/ Wed, 05 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/vsphere-csi-cns-extendvolume-triage/ Field note for triaging vSphere CSI CNS ExtendVolume task messages by mapping CNS volume IDs to PVs and PVCs, separating resize state from attachment failures, and avoiding destructive rollback. https://trinidadmarroquin.com/field-notes/vsphere-ha-reset-evidence-kubernetes-nodes/ Wed, 05 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/vsphere-ha-reset-evidence-kubernetes-nodes/ Field note for distinguishing vSphere HA resets from in-guest Kubernetes node reboots by correlating boot IDs, kernel activation, auth logs, Kubernetes events, and vCenter task/event history. https://trinidadmarroquin.com/field-notes/fast-os-template-node-replacement-rehearsal/ Mon, 03 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/fast-os-template-node-replacement-rehearsal/ Field note for rehearsing fast RKE2 node replacement with prebuilt powered-off VMs, one-minor upgrade sequencing, image-cache warming, identity conflict rules, and rollback gates. https://trinidadmarroquin.com/field-notes/longhornctl-workstation-install-operations-boundary/ Mon, 03 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/longhornctl-workstation-install-operations-boundary/ Field note for installing longhornctl on an Ubuntu workstation and keeping its use separate from day-to-day Longhorn health checks through CRDs and the UI. https://trinidadmarroquin.com/field-notes/rke2-calico-stale-port-owners-after-upgrade/ Mon, 03 Aug 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/rke2-calico-stale-port-owners-after-upgrade/ Field note for diagnosing Calico and Typha readiness failures after RKE2 changes when old node-local processes still own health or service ports. https://trinidadmarroquin.com/field-notes/burn-rate-alerting-concepts-for-operators/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/burn-rate-alerting-concepts-for-operators/ Conceptual field note explaining burn-rate alerts, error-budget math, multi-window alerting, common failure modes, and incident review questions for operators. https://trinidadmarroquin.com/field-notes/cert-manager-certificate-lifecycle/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/cert-manager-certificate-lifecycle/ Operational field note for managing Kubernetes certificate lifecycle with cert-manager, including issuers, renewals, ACME challenges, alerts, and failure modes. https://trinidadmarroquin.com/field-notes/cluster-autoscaler-operational-review/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/cluster-autoscaler-operational-review/ Operational review checklist for Kubernetes cluster autoscaler behavior, including pending pods, node groups, scale-up blockers, scale-down safety, and capacity risks. https://trinidadmarroquin.com/field-notes/incident-review-template-for-sre-teams/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/incident-review-template-for-sre-teams/ A practical incident review template for SRE and platform teams focused on impact, detection, mitigation, contributing factors, and follow-up quality. https://trinidadmarroquin.com/field-notes/kubernetes-ingress-operations-checklist/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/kubernetes-ingress-operations-checklist/ A practical Kubernetes ingress operations checklist for DNS, TLS, controller health, routing, observability, and incident response. https://trinidadmarroquin.com/field-notes/on-call-escalation-policy-platform-teams/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/on-call-escalation-policy-platform-teams/ A practical on-call escalation policy template for platform teams operating shared infrastructure, Kubernetes, observability, and deployment systems. https://trinidadmarroquin.com/field-notes/secrets/secrets-rotation-patterns-with-vault/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/secrets/secrets-rotation-patterns-with-vault/ Operational field note for rotating secrets with HashiCorp Vault, including static secrets, dynamic credentials, PKI, transit keys, leases, rollout safety, and evidence. https://trinidadmarroquin.com/field-notes/slo-burn-rate-alerting-prometheus/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/slo-burn-rate-alerting-prometheus/ Field note for turning request-based SLIs into practical Prometheus burn-rate alerts, including error-budget math, multi-window alerting, failure modes, and incident review checks. https://trinidadmarroquin.com/field-notes/secrets/vault-kubernetes-auth-method-deep-dive/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/secrets/vault-kubernetes-auth-method-deep-dive/ Operational field note for Vault Kubernetes auth method design, service account binding, policies, token lifetimes, failure modes, and review checks. https://trinidadmarroquin.com/field-notes/secrets/vault-pki-secrets-engine-internal-certificates/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/secrets/vault-pki-secrets-engine-internal-certificates/ Operational field note for using HashiCorp Vault PKI secrets engine to issue internal certificates with clear roles, TTLs, revocation, and audit boundaries. https://trinidadmarroquin.com/field-notes/secrets/vault-transit-engine-application-encryption/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/secrets/vault-transit-engine-application-encryption/ Operational field note for using Vault transit secrets engine for application encryption, key policy, rotation, auditability, and failure modes. https://trinidadmarroquin.com/field-notes/slo-dashboard-first-response-view/ Tue, 28 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/slo-dashboard-first-response-view/ A practical SLO dashboard checklist for on-call engineers responding to burn-rate alerts and reliability incidents. https://trinidadmarroquin.com/field-notes/longhorn-no-scheduled-replicas-disk-pressure/ Fri, 24 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/longhorn-no-scheduled-replicas-disk-pressure/ Field note for troubleshooting Longhorn replica scheduling failures caused by disk pressure, scheduled-capacity overcommitment, orphaned replica data, and unused PVCs. https://trinidadmarroquin.com/field-notes/temporary-privileged-daemonset-maintenance-access/ Thu, 23 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/temporary-privileged-daemonset-maintenance-access/ A Kubernetes maintenance field note on using temporary privileged DaemonSets for host access, including authorization, scope, cleanup, and negative verification. https://trinidadmarroquin.com/field-notes/downstream-observability-teardown-triage/ Wed, 22 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/downstream-observability-teardown-triage/ A Kubernetes triage pattern for separating customer workload health from observability stack teardown, stuck finalizers, alert delivery failures, and externally managed resources. https://trinidadmarroquin.com/field-notes/kubernetes-maintenance-evidence-bundles/ Wed, 22 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/kubernetes-maintenance-evidence-bundles/ A field note on retaining Kubernetes maintenance evidence without leaking sensitive cluster names, IPs, credentials, workload names, or internal topology. https://trinidadmarroquin.com/posts/rke2-node-reboots-longhorn-degraded-risk/ Tue, 21 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/rke2-node-reboots-longhorn-degraded-risk/ A practical RKE2 maintenance pattern for rebooting control-plane and worker nodes while Longhorn storage is already degraded, including batching, drain rules, boot-ID checks, and stop criteria. https://trinidadmarroquin.com/field-notes/ubuntu-unattended-upgrades-kubernetes-nodes/ Mon, 20 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/ubuntu-unattended-upgrades-kubernetes-nodes/ Field note for auditing, disabling, masking, purging, and verifying Ubuntu unattended upgrades and apt timers on Kubernetes nodes without relying on unsafe process killing. https://trinidadmarroquin.com/posts/ubuntu-unattended-upgrades-kubernetes-node-risk/ Mon, 20 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/ubuntu-unattended-upgrades-kubernetes-node-risk/ A Kubernetes operations article on why Ubuntu unattended upgrades should be disabled on production nodes and replaced with controlled patch windows, especially when systemd, udev, iSCSI, multipath, and CSI storage are involved. https://trinidadmarroquin.com/field-notes/rancher-rke2-upgrade-pods-host-filesystem/ Fri, 17 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/rancher-rke2-upgrade-pods-host-filesystem/ Field note for understanding Rancher-managed RKE2 upgrade pods: how system-upgrade-controller runs pods on nodes, mounts the host filesystem, replaces RKE2 binaries, restarts services, and leaves post-upgrade signals to verify. https://trinidadmarroquin.com/field-notes/packer-bootstrap-placement-vs-runtime-execution/ Thu, 16 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/packer-bootstrap-placement-vs-runtime-execution/ Field note for diagnosing Packer bootstrap anomalies: whether static bootstrap files were placed in the template, whether SSH provisioners ran, and whether Terraform/cloud-init started runtime behavior after clone. https://trinidadmarroquin.com/posts/rancher-rke2-minor-hop-gitops-suc/ Thu, 16 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/rancher-rke2-minor-hop-gitops-suc/ A practical Rancher and RKE2 upgrade article covering supported minor hops, Rancher UI version metadata, GitOps-managed system-upgrade-controller plans, stale runtime shims, and post-upgrade cleanup gates. https://trinidadmarroquin.com/field-notes/terraform-cloud-init-rancher-data-disk-layout/ Thu, 16 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-cloud-init-rancher-data-disk-layout/ Field note for making Terraform and cloud-init own the second-disk layout for RKE2/Rancher workers: attach, partition, mount /var/lib/rancher, bind container logs, and verify after replacement. https://trinidadmarroquin.com/posts/rancher-management-cluster-upgrade-preflight/ Wed, 15 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/rancher-management-cluster-upgrade-preflight/ A practical Rancher and RKE2 upgrade runbook pattern covering stabilization, worker replacement, backups, stale RKE1 artifacts, Helm upgrade recovery, and post-upgrade validation. https://trinidadmarroquin.com/field-notes/rke2-worker-join-calico-wrong-interface/ Wed, 15 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/rke2-worker-join-calico-wrong-interface/ Field note for diagnosing RKE2 worker replacement failures where agent load balancer timeouts, duplicate node identity, and Calico node IP autodetection drift point at different layers of the same problem. https://trinidadmarroquin.com/field-notes/terraform-environment-scaffolding-consistency/ Tue, 14 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-environment-scaffolding-consistency/ Field note for generating consistent Terraform vSphere environment roots with standard files, blank tfvars, smoke tests, and README updates. https://trinidadmarroquin.com/posts/concourse-packer-template-builds-network-secrets/ Tue, 14 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/concourse-packer-template-builds-network-secrets/ A practical SRE article on moving multi-site Packer template builds into Concourse while handling secrets, worker placement, network reachability, ISO behavior, and log hygiene. https://trinidadmarroquin.com/field-notes/containerized-dns-drift-detector-boundaries/ Fri, 10 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/containerized-dns-drift-detector-boundaries/ Field note for packaging an audit-only DNS drift detector as a container while keeping inventories, SSH material, reports, and remediation outside the image. https://trinidadmarroquin.com/posts/practical-data-science-for-devops/using-percentiles-instead-of-averages/ Sun, 05 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/practical-data-science-for-devops/using-percentiles-instead-of-averages/ Part 1 of Practical Data Science For DevOps And SRE: why average latency hides user pain, how p95 and p99 expose tail behavior, and how to validate the idea with a small Prometheus and Grafana SLI lab. https://trinidadmarroquin.com/posts/installing-configuring-calico-rke2-ground-up/ Thu, 02 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/installing-configuring-calico-rke2-ground-up/ A practical Calico installation and configuration guide for RKE2: CNI ownership, Tigera operator setup, IP pools, node address autodetection, validation, and related operations notes. https://trinidadmarroquin.com/field-notes/terraform-targeted-plan-live-cluster-nodes/ Thu, 02 Jul 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-targeted-plan-live-cluster-nodes/ Field note for safely adding new vSphere VMs to a live Kubernetes cluster with Terraform, NetBox records, saved targeted plans, and JSON plan verification. https://trinidadmarroquin.com/field-notes/sli-lab-flask-prometheus-grafana/ Tue, 30 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/sli-lab-flask-prometheus-grafana/ Field note for building a small local SLI lab with Flask, Terraform-managed Docker containers, Prometheus, and Grafana, including availability, latency percentiles, error-rate analysis, and simple trend awareness. https://trinidadmarroquin.com/posts/devops-dirty-dozen/devops-as-a-buzzword/ Mon, 29 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/devops-dirty-dozen/devops-as-a-buzzword/ Part 12 of the DevOps Dirty Dozen series: how adopting DevOps in name only creates false progress, hides unchanged behavior, and what real DevOps practice requires. https://trinidadmarroquin.com/field-notes/sre-agent-kubernetes-log-access-rbac/ Mon, 29 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/sre-agent-kubernetes-log-access-rbac/ Field note for granting an SRE agent read-only access to Kubernetes pod logs and events through least-privilege namespaced RoleBindings instead of broad ClusterRoleBindings. https://trinidadmarroquin.com/posts/devops-dirty-dozen/set-it-and-forget-it/ Sun, 28 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/devops-dirty-dozen/set-it-and-forget-it/ Part 11 of the DevOps Dirty Dozen series: how neglected automation, monitoring, credentials, and platform assumptions create silent operational risk over time. https://trinidadmarroquin.com/field-notes/terraform-module-input-summary-pattern/ Sat, 27 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-module-input-summary-pattern/ Field note on documenting Terraform AWS module inputs using a concise summary table to improve module usability, security review, governance, and reuse across platform teams. https://trinidadmarroquin.com/posts/devops-dirty-dozen/resistance-to-change/ Sat, 27 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/devops-dirty-dozen/resistance-to-change/ Part 10 of the DevOps Dirty Dozen series: how resistance to change preserves outdated processes, increases hidden risk, and what teams can do to evolve safely. https://trinidadmarroquin.com/field-notes/concourse-ingress-dns-tls-cutover/ Fri, 26 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/concourse-ingress-dns-tls-cutover/ Field note for moving Concourse behind Kubernetes ingress, round-robin DNS, and a signed TLS certificate without mixing up DNS, ingress, secret, and application URL ownership. https://trinidadmarroquin.com/posts/devops-dirty-dozen/metrics-misuse/ Fri, 26 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/devops-dirty-dozen/metrics-misuse/ Part 9 of the DevOps Dirty Dozen series: how vanity metrics distort behavior, hide operational risk, and why teams need outcome-focused measurements instead. https://trinidadmarroquin.com/field-notes/remediation-audits-notready-calico-inventory/ Fri, 26 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/remediation-audits-notready-calico-inventory/ Field note for running node remediation safely when inventory generation, DNS cleanup, Calico IP audits, and a NotReady node overlap. https://trinidadmarroquin.com/posts/devops-dirty-dozen/big-bang-deployments/ Thu, 25 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/devops-dirty-dozen/big-bang-deployments/ Part 8 of the DevOps Dirty Dozen series: how big bang deployments concentrate risk, slow recovery, and why smaller incremental releases build safer systems. https://trinidadmarroquin.com/field-notes/dns-drift-detector-calico-overlay-filter/ Wed, 24 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/dns-drift-detector-calico-overlay-filter/ Field note for filtering Calico overlay links from resolvectl domain output and parsing DNS drift detector CSV reports safely. https://trinidadmarroquin.com/field-notes/rancher-system-upgrade-controller-emergency-stop/ Wed, 24 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/rancher-system-upgrade-controller-emergency-stop/ Field note for stopping a Rancher system-upgrade-controller agent Plan that is repeatedly cordoning workers while GitOps keeps restoring the Plan. https://trinidadmarroquin.com/posts/devops-dirty-dozen/hero-culture/ Wed, 24 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/devops-dirty-dozen/hero-culture/ Part 7 of the DevOps Dirty Dozen series: how hero culture burns out the best engineers, hides systemic fragility, and prevents teams from building sustainable operational capability. https://trinidadmarroquin.com/posts/rancher-system-upgrade-controller-latent-worker-risk/ Wed, 24 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/rancher-system-upgrade-controller-latent-worker-risk/ A Rancher and RKE2 incident pattern where a continuously reconciled system-upgrade-controller Plan stayed pending until worker capacity collapsed, then cordoned the last healthy worker. https://trinidadmarroquin.com/field-notes/devops-sre-linux-workstation/ Tue, 23 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/devops-sre-linux-workstation/ Reference for setting up a Linux-based engineering workstation: OS selection, core toolchain, shell hygiene, secret management, session persistence, and bootstrap automation. https://trinidadmarroquin.com/posts/devops-dirty-dozen/ignoring-feedback-loops/ Tue, 23 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/devops-dirty-dozen/ignoring-feedback-loops/ Part 6 of the DevOps Dirty Dozen series: how ignoring monitoring signals, user feedback, and anomaly warnings turns small problems into catastrophic failures — and what it takes to build a culture that listens. https://trinidadmarroquin.com/field-notes/calico-ip-audit-zero-targets/ Mon, 22 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/calico-ip-audit-zero-targets/ Field note for interpreting Calico node IP audit scripts that only print mismatches, and for confirming whether Kubernetes node InternalIP matches projectcalico.org/IPv4Address. https://trinidadmarroquin.com/field-notes/dns-search-remediation-per-cluster-inventory/ Mon, 22 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/dns-search-remediation-per-cluster-inventory/ Field note for hardening a DNS search-domain remediation wrapper so it handles per-cluster inventories, Vault-backed Ansible variables, local credentials, and incomplete final audits. https://trinidadmarroquin.com/field-notes/rke2-per-cluster-inventory-generation/ Mon, 22 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/rke2-per-cluster-inventory-generation/ Field note for generating repo-compatible Ansible inventory from RKE2 kubeconfig contexts, including group names, API load balancers, node readiness, and test fixtures. https://trinidadmarroquin.com/field-notes/dns-search-domain-audit-failure-visibility/ Fri, 19 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/dns-search-domain-audit-failure-visibility/ Field note for making Ansible-based DNS search-domain audits report unreachable hosts, sudo failures, and CSV row-count mismatches instead of silently dropping nodes. https://trinidadmarroquin.com/field-notes/terraform-vsphere-dns-search-suffix-ownership/ Fri, 19 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-vsphere-dns-search-suffix-ownership/ Field note for separating VM identity domain from DNS search suffixes in Terraform vSphere modules and proving which setting reaches guest customization. https://trinidadmarroquin.com/field-notes/netbox-cluster-tag-scope-audit/ Thu, 18 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/netbox-cluster-tag-scope-audit/ Field note for auditing NetBox cluster tags so they can be assigned to virtualization VMs after DCIM-to-VM inventory migration. https://trinidadmarroquin.com/field-notes/netbox-dcim-device-to-vm-migration-dry-run-pattern/ Thu, 18 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/netbox-dcim-device-to-vm-migration-dry-run-pattern/ Field note for running an idempotent NetBox DCIM-device to virtualization-VM migration with dry-run evidence, scoped applies, and tag synchronization. https://trinidadmarroquin.com/posts/netbox-virtualization-migration-operational-pattern/ Thu, 18 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/netbox-virtualization-migration-operational-pattern/ A practical operating pattern for migrating NetBox VM inventory from DCIM devices to virtualization VMs while keeping Terraform state, tags, IPs, and audit boundaries under control. https://trinidadmarroquin.com/field-notes/replacement-node-workflow-after-terraform-import-drift/ Thu, 18 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/replacement-node-workflow-after-terraform-import-drift/ Field note for deciding to replace Kubernetes nodes instead of applying risky vSphere drift after importing legacy VMs into Terraform state. https://trinidadmarroquin.com/field-notes/velero-workload-backup-restore/ Thu, 18 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/velero-workload-backup-restore/ Field note for Velero-based workload backup and restore in Kubernetes: backup schedules, restore validation, restic integration, common failure modes, and recovery patterns. https://trinidadmarroquin.com/field-notes/classifying-vsphere-drift-after-terraform-import/ Wed, 17 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/classifying-vsphere-drift-after-terraform-import/ Field note for reading Terraform audit plans after importing existing vSphere VMs and deciding whether to reconcile drift or replace legacy nodes. https://trinidadmarroquin.com/posts/netbox-terraform-drift-audit-existing-kubernetes-vms/ Wed, 17 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/netbox-terraform-drift-audit-existing-kubernetes-vms/ A drift audit report for converting VM inventory from NetBox DCIM devices to virtualization objects, importing existing vSphere and NetBox resources into Terraform state, and deciding not to apply unsafe legacy VM drift. https://trinidadmarroquin.com/field-notes/netbox-dcim-to-virtualization-vm-migration/ Wed, 17 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/netbox-dcim-to-virtualization-vm-migration/ Field note for recognizing when VMware VMs were modeled as NetBox DCIM devices and migrating them toward virtualization VM objects for Terraform ownership. https://trinidadmarroquin.com/field-notes/terraform-import-existing-vsphere-vms/ Wed, 17 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-import-existing-vsphere-vms/ Field note for importing existing vSphere and NetBox VM resources into Terraform state so a site can be audited before any apply. https://trinidadmarroquin.com/posts/managing-vsphere-vm-lifecycle-state-terraform-netbox/ Tue, 16 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/managing-vsphere-vm-lifecycle-state-terraform-netbox/ A lifecycle runbook for managing vSphere VM CPU, memory, disk sizing, NetBox metadata, idempotency, and teardown hygiene after initial Terraform provisioning. https://trinidadmarroquin.com/field-notes/post-provision-vm-state-verification-netbox/ Tue, 16 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/post-provision-vm-state-verification-netbox/ Field note for verifying Terraform-managed vSphere VM metadata, interface assignment, IPAM state, DNS name, and cleanup behavior in NetBox after provisioning or resizing. https://trinidadmarroquin.com/field-notes/terraform-vsphere-compute-resize-checklist/ Tue, 16 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-vsphere-compute-resize-checklist/ Field note for safely changing vSphere VM CPU, memory, primary disk, and optional data disk sizing through Terraform after provisioning. https://trinidadmarroquin.com/posts/terraform-vsphere-vm-guardrails-netbox/ Mon, 15 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/terraform-vsphere-vm-guardrails-netbox/ A practical walkthrough of using Terraform validation, NetBox ownership, vCenter checks, DNS checks, network liveness tests, and teardown verification around the vSphere VM lifecycle. https://trinidadmarroquin.com/field-notes/netbox-first-vsphere-vm-ownership/ Mon, 15 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/netbox-first-vsphere-vm-ownership/ Field note for making NetBox VM and IPAM records a fail-closed provisioning gate before Terraform creates and destroys vSphere virtual machines. https://trinidadmarroquin.com/field-notes/terraform-vm-guardrail-test-matrix/ Mon, 15 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-vm-guardrail-test-matrix/ A reusable test matrix for validating Terraform VM guardrails across duplicate input, NetBox ownership, vCenter inventory, DNS, active IP detection, fail-closed provider behavior, and teardown hygiene. https://trinidadmarroquin.com/field-notes/terraform-vsphere-vm-preflight-guardrails/ Mon, 15 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-vsphere-vm-preflight-guardrails/ Field note for checking Terraform-planned vSphere VM names and IPs against NetBox, vCenter, DNS, reverse DNS, and live network responses before apply. https://trinidadmarroquin.com/field-notes/ai-agent-guardrails-for-infrastructure-writes/ Fri, 12 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/ai-agent-guardrails-for-infrastructure-writes/ Field note for using AI agents safely during infrastructure updates, especially when the agent has tool access but may speculate or lose context. https://trinidadmarroquin.com/field-notes/netbox-kubernetes-node-bulk-import/ Fri, 12 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/netbox-kubernetes-node-bulk-import/ Field note for importing Kubernetes VM node inventory into NetBox using ordered device, interface, and IP address CSV files. https://trinidadmarroquin.com/field-notes/netbox-primary-ip-after-import/ Fri, 12 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/netbox-primary-ip-after-import/ Field note for setting NetBox device primary IPv4 addresses after bulk importing devices, interfaces, and IP assignments. https://trinidadmarroquin.com/posts/ai-assisted-netbox-inventory-guardrails/ Fri, 12 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/ai-assisted-netbox-inventory-guardrails/ A practical reflection on using AI assistance for NetBox inventory work, where tool access helped but evidence, validation, and import discipline mattered more than confident answers. https://trinidadmarroquin.com/field-notes/network-saturation-evidence-checklist/ Thu, 11 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/network-saturation-evidence-checklist/ Field note for separating real node saturation, healthy-but-noisy control-plane traffic, and external backup or replication traffic during Kubernetes network incidents. https://trinidadmarroquin.com/field-notes/rancher-remotedialer-network-symptoms/ Thu, 11 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/rancher-remotedialer-network-symptoms/ Field note for recognizing Rancher cluster-agent, remotedialer, ingress, and websocket symptoms during network congestion or load balancer instability. https://trinidadmarroquin.com/posts/rancher-network-saturation-symptoms/ Thu, 11 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/rancher-network-saturation-symptoms/ An incident-style walkthrough of a Rancher traffic anomaly where control-plane symptoms pointed at remotedialer instability, but the likely trigger was backup-window network saturation. https://trinidadmarroquin.com/projects/observability-incident-response/actionable-alerts-dashboards/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/observability-incident-response/actionable-alerts-dashboards/ Initial guidance for actionable alerts, useful dashboards, ownership, and SRE-style signal quality. https://trinidadmarroquin.com/projects/cloud-based-platforms/aws-operational-patterns/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cloud-based-platforms/aws-operational-patterns/ AWS-specific operational patterns for EKS, networking, IAM, IoT, and workstation tooling. https://trinidadmarroquin.com/field-notes/azure-aks-terraform-operations/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/azure-aks-terraform-operations/ Field note for provisioning Azure AKS clusters with Terraform, including networking, identity, storage backends, and cross-cloud comparison patterns. https://trinidadmarroquin.com/field-notes/blue-green-deployment-nginx-swap/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/blue-green-deployment-nginx-swap/ Field note for blue-green deployment mechanics using NGINX upstream switching, covering manual and weighted patterns. https://trinidadmarroquin.com/field-notes/canary-deployment-haproxy-weighted-routing/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/canary-deployment-haproxy-weighted-routing/ Field note for canary deployment mechanics using HAProxy weighted backends to control blast radius during rollout. https://trinidadmarroquin.com/projects/cloud-based-platforms/account-environment-organization/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cloud-based-platforms/account-environment-organization/ Initial operating model for cloud account, project, subscription, and environment organization. https://trinidadmarroquin.com/projects/cloud-based-platforms/networking-iam-guardrails/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cloud-based-platforms/networking-iam-guardrails/ Initial guardrails for cloud networking, IAM, logging, and platform controls. https://trinidadmarroquin.com/projects/cloud-based-platforms/provider-operational-patterns/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cloud-based-platforms/provider-operational-patterns/ Initial model for documenting cloud operational patterns by provider and platform discipline. https://trinidadmarroquin.com/projects/cicd-pipeline-design/concourse-windows-deployment/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cicd-pipeline-design/concourse-windows-deployment/ Project notes for deploying Concourse CI/CD on Windows Docker with Terraform, TLS key management, PowerShell provisioners, and production pipeline patterns. https://trinidadmarroquin.com/projects/cicd-pipeline-design/concourse-infrastructure-workflows/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cicd-pipeline-design/concourse-infrastructure-workflows/ Initial Concourse workflow patterns for infrastructure repositories, platform changes, promotion, and failure visibility. https://trinidadmarroquin.com/field-notes/concourse-vault-key-bootstrap/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/concourse-vault-key-bootstrap/ Field note for bootstrapping Concourse CI/CD keys with HashiCorp Vault using Terraform, covering TSA key architecture and runtime secret retrieval. https://trinidadmarroquin.com/projects/cicd-pipeline-design/deployment-strategy-labs/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cicd-pipeline-design/deployment-strategy-labs/ Project notes for using deployment labs to compare blue-green, canary, feature toggle, rollback, and health-check strategies. https://trinidadmarroquin.com/field-notes/dns-search-domain-debugging/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/dns-search-domain-debugging/ Commands for identifying which layer is injecting a DNS search domain — netplan, systemd-resolved global, or per-link — and how to fix each at runtime. https://trinidadmarroquin.com/projects/kubernetes-platform-operations/dns-search-domain-hygiene/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/kubernetes-platform-operations/dns-search-domain-hygiene/ Operating pattern for maintaining consistent DNS search domain state across RKE2 clusters: audit, stage, runtime fix, and drift detection across three resolver layers. https://trinidadmarroquin.com/field-notes/docker-stale-binaries-path/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/docker-stale-binaries-path/ Field note for diagnosing Docker failures caused by stale runc and containerd-shim-runc-v2 binaries in /usr/local/bin shadowing package-managed versions. https://trinidadmarroquin.com/field-notes/etcd-backup-disaster-recovery/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/etcd-backup-disaster-recovery/ Field note for etcd snapshot and restore procedures in Kubernetes clusters: automated backups, restore validation, cluster rebuild from snapshot, and recovery patterns for RKE2. https://trinidadmarroquin.com/field-notes/etcd-member-management/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/etcd-member-management/ Field note for etcd member lifecycle: adding and removing members, quorum safety, endpoint health, alarm management, and common failure modes in RKE2 clusters. https://trinidadmarroquin.com/field-notes/feature-toggles-environment-variables/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/feature-toggles-environment-variables/ Field note for using environment variables as feature toggles, including cross-language patterns and the limits of the approach. https://trinidadmarroquin.com/posts/local-iac-labs-to-production-patterns/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/local-iac-labs-to-production-patterns/ A practical SRE view of how local Terraform, Docker, Helm, Kafka, and observability labs can become production-ready infrastructure patterns without pretending the lab is production. https://trinidadmarroquin.com/projects/cloud-based-platforms/gcp-operational-patterns/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cloud-based-platforms/gcp-operational-patterns/ GCP-specific operational patterns for project structure, GKE, IAM, networking, and SRE discipline. https://trinidadmarroquin.com/projects/cicd-pipeline-design/gitops-infrastructure-teams/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cicd-pipeline-design/gitops-infrastructure-teams/ Project page for GitOps patterns applied to infrastructure operations: pipeline-controlled infrastructure, platform tenant workflows, fleet-wide change orchestration, and the operating model that makes GitOps practical for platform teams. https://trinidadmarroquin.com/field-notes/gitops-pipeline-patterns/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/gitops-pipeline-patterns/ Field note for GitOps pipeline patterns in infrastructure teams: change pipelines, fleet rollouts, tenant onboarding, and the operating model that keeps Git as the single source of truth. https://trinidadmarroquin.com/field-notes/helm-terraform-eks-deployment/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/helm-terraform-eks-deployment/ Field note for the Terraform-managed Helm release pattern on EKS, keeping infrastructure provisioning separate from application deployment configuration. https://trinidadmarroquin.com/projects/cicd-pipeline-design/helm-terraform-validation/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cicd-pipeline-design/helm-terraform-validation/ Project notes for validating Helm-rendered Kubernetes manifests and Terraform-managed Helm releases before deployment. https://trinidadmarroquin.com/projects/packer-image-pipelines/image-factory-workflow/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/packer-image-pipelines/image-factory-workflow/ Project page for the Packer-based image factory workflow: template pipeline, versioning strategy, cross-site distribution, validation gates, and the operating model that keeps node images consistent across the fleet. https://trinidadmarroquin.com/field-notes/iot-docker-terraform-certificates/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/iot-docker-terraform-certificates/ Field note for running an AWS IoT device in a Docker container managed by Terraform, focusing on X.509 certificate injection via volume mounts. https://trinidadmarroquin.com/field-notes/kafka-kraft-docker-compose/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/kafka-kraft-docker-compose/ Field note for running Kafka in KRaft mode (no Zookeeper) with Docker Compose for local development and testing. https://trinidadmarroquin.com/field-notes/kafka-readiness-terraform-docker-labs/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/kafka-readiness-terraform-docker-labs/ Field note for local Kafka labs where Terraform creates Docker infrastructure, waits for broker readiness, and then creates topics or starts stream processors. https://trinidadmarroquin.com/projects/cicd-pipeline-design/kafka-streams-terraform-pipeline/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cicd-pipeline-design/kafka-streams-terraform-pipeline/ Project notes for building a local Kafka Streams data pipeline managed entirely by Terraform, including broker provisioning, topic creation, and stream processor deployment. https://trinidadmarroquin.com/projects/kubernetes-platform-operations/platform-conventions/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/kubernetes-platform-operations/platform-conventions/ Platform conventions for Kubernetes namespaces, ingress, storage, labels, policies, and ownership patterns that reduce operational drift. https://trinidadmarroquin.com/projects/kubernetes-platform-operations/upgrade-sequencing/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/kubernetes-platform-operations/upgrade-sequencing/ Upgrade sequencing model for Rancher-managed Kubernetes clusters, including readiness checks, maintenance windows, node drains, PodDisruptionBudgets, rollback planning, and post-upgrade validation. https://trinidadmarroquin.com/field-notes/local-sli-labs-prometheus-grafana-cadvisor/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/local-sli-labs-prometheus-grafana-cadvisor/ Field note for using a local Docker and Terraform lab to validate service-level indicators with Prometheus, Grafana, and cAdvisor. https://trinidadmarroquin.com/projects/observability-incident-response/log-metric-naming/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/observability-incident-response/log-metric-naming/ Initial conventions for log fields, metric names, labels, cardinality, and operational searchability. https://trinidadmarroquin.com/field-notes/longhorn-enterprise-storage-migration/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/longhorn-enterprise-storage-migration/ Field note for migrating Kubernetes storage from Longhorn to enterprise storage platforms: volume migration strategies, application downtime expectations, PVC rebinding, and validation checks before and after migration. https://trinidadmarroquin.com/posts/multi-site-rke2-lessons/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/multi-site-rke2-lessons/ Operational lessons from running RKE2 clusters across multiple data centers: inventory design, node naming conventions, upgrade sequencing across sites, and the patterns that break first at scale. https://trinidadmarroquin.com/field-notes/observability-before-ai/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/observability-before-ai/ Field note for building observability foundations before introducing AI-assisted operations: structured metrics, actionable dashboards, coherent alert routing, and incident response patterns that make AI useful rather than noisy. https://trinidadmarroquin.com/posts/operating-in-gitops/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/operating-in-gitops/ Opinionated practices for infrastructure teams working in a GitOps model: commit messages, semver for infrastructure, CI-triggered CD tradeoffs, and deployment automation patterns that survive production use. https://trinidadmarroquin.com/projects/packer-image-pipelines/base-image-hardening/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/packer-image-pipelines/base-image-hardening/ Initial model for Packer base image hardening, patch cadence, template ownership, and retirement. https://trinidadmarroquin.com/projects/packer-image-pipelines/image-validation-gates/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/packer-image-pipelines/image-validation-gates/ Initial validation gates for Packer-built images, including boot, access, agents, cloud-init, storage, and baseline configuration. https://trinidadmarroquin.com/projects/packer-image-pipelines/image-versioning/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/packer-image-pipelines/image-versioning/ Initial image versioning model for Packer-built VM templates with rollback, auditability, and change history. https://trinidadmarroquin.com/projects/cicd-pipeline-design/credential-handling-promotion/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cicd-pipeline-design/credential-handling-promotion/ Initial practices for CI/CD credential handling, pipeline resources, environment promotion, and branch-based controls. https://trinidadmarroquin.com/projects/cicd-pipeline-design/validation-planning-apply-stages/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/cicd-pipeline-design/validation-planning-apply-stages/ Initial CI/CD stage model for validation, planning, approval, apply, and post-deploy verification. https://trinidadmarroquin.com/projects/observability-incident-response/post-incident-follow-up/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/observability-incident-response/post-incident-follow-up/ Initial post-incident follow-up model for timelines, contributing factors, corrective actions, and measurable system improvements. https://trinidadmarroquin.com/projects/kubernetes-platform-operations/rancher-fleet-standards/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/kubernetes-platform-operations/rancher-fleet-standards/ Operating standards for Rancher-managed Kubernetes fleets, including Active Directory authentication, break-glass access, RBAC, Fleet GitRepo organization, and cluster ownership. https://trinidadmarroquin.com/posts/dns-search-domain-remediation/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/dns-search-domain-remediation/ A production walkthrough of auditing, diagnosing, and remediating DNS search domain drift across five RKE2 cluster sites, including netplan staging, systemd-resolved link-level debugging, and a Subiquity YAML indentation trap. https://trinidadmarroquin.com/field-notes/rollback-sentinel-package-management/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/rollback-sentinel-package-management/ Field note for automated rollback patterns using sentinel files for failure detection and dpkg package management for version reversal. https://trinidadmarroquin.com/field-notes/terraform-lab-secret-handling/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-lab-secret-handling/ Field note for separating acceptable local lab shortcuts from production secret handling when Terraform manages Docker, Grafana, Concourse, or Vault-backed examples. https://trinidadmarroquin.com/field-notes/sre-mindset/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/sre-mindset/ Field note for the SRE mindset: how operators think about reliability, error budgets, incident response, toil management, and the decisions that determine whether tooling improves or complicates operations. https://trinidadmarroquin.com/field-notes/terraform-azure-backend-bootstrap/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-azure-backend-bootstrap/ Field note for bootstrapping an Azure Storage backend for Terraform state without confusing the first apply with the later remote backend migration. https://trinidadmarroquin.com/projects/terraform-infrastructure-modules/operational-module-boundaries/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/terraform-infrastructure-modules/operational-module-boundaries/ Initial guidance for Terraform module boundaries that match operational ownership and avoid unnecessary abstraction. https://trinidadmarroquin.com/projects/terraform-infrastructure-modules/plan-review-practices/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/terraform-infrastructure-modules/plan-review-practices/ Initial Terraform plan review practices for safer infrastructure changes, state handling, and automation gates. https://trinidadmarroquin.com/posts/sre-dirty-dozen/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/sre-dirty-dozen/ Twelve common anti-patterns in SRE practice: alert fatigue disguised as paging, dashboards without decisions, SLI collection without SLO targets, incident reviews without action items, and other traps that SRE teams fall into. https://trinidadmarroquin.com/posts/kubernetes-vsphere-csi-troubleshooting/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/kubernetes-vsphere-csi-troubleshooting/ A practical incident walkthrough for Kubernetes monitoring PVC failures, stale CSI storage, vSphere CSI attach and mount validation, and the disk.EnableUUID requirement. https://trinidadmarroquin.com/projects/secrets-management-with-vault/deployment-and-unseal-runbooks/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/secrets-management-with-vault/deployment-and-unseal-runbooks/ Initial operating model for Vault deployment, initialization, seal and unseal expectations, and recovery runbooks. https://trinidadmarroquin.com/projects/secrets-management-with-vault/policy-auth-secrets-engines/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/secrets-management-with-vault/policy-auth-secrets-engines/ Initial standards for Vault policy design, authentication methods, identity mapping, and secrets engine organization. https://trinidadmarroquin.com/projects/secrets-management-with-vault/token-lease-audit-recovery/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/secrets-management-with-vault/token-lease-audit-recovery/ Initial operating practices for Vault tokens, leases, audit logs, backup, revocation, and recovery. https://trinidadmarroquin.com/projects/vcenter-platform-administration/automation-integration-points/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/vcenter-platform-administration/automation-integration-points/ Initial model for vCenter integration points with Terraform, Packer, Kubernetes nodes, CSI storage, and backup workflows. https://trinidadmarroquin.com/projects/vcenter-platform-administration/platform-hygiene/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/vcenter-platform-administration/platform-hygiene/ Initial operating standards for vCenter cluster, datastore, network, template, tag, and permission hygiene. https://trinidadmarroquin.com/projects/vcenter-platform-administration/vm-lifecycle-runbooks/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/vcenter-platform-administration/vm-lifecycle-runbooks/ Initial runbook model for vCenter VM lifecycle, capacity review, maintenance, and incident response. https://trinidadmarroquin.com/field-notes/vsphere-csi-attach-mount-checklist/ Wed, 10 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/vsphere-csi-attach-mount-checklist/ Field note for checking Kubernetes PVCs, StorageClasses, VolumeAttachments, worker VM disk UUID settings, and vSphere CSI mount readiness. https://trinidadmarroquin.com/field-notes/bootstrap-logging-idempotency/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/bootstrap-logging-idempotency/ Field note for making first-boot bootstrap scripts easier to debug by logging each stage, preventing concurrent runs, and summarizing failures. https://trinidadmarroquin.com/posts/first-boot-ownership-packer-terraform-cloud-init/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/first-boot-ownership-packer-terraform-cloud-init/ A systems note on assigning clear ownership between Packer templates, Terraform vSphere clones, guest customization, cloud-init, bootstrap scripts, and CSI storage. https://trinidadmarroquin.com/field-notes/govc-vsphere-verification/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/govc-vsphere-verification/ Field note with govc commands for finding VMs, checking NIC backing, guestinfo keys, and comparing working versus broken vSphere clones. https://trinidadmarroquin.com/field-notes/iscsi-bootstrap-kubernetes-nodes/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/iscsi-bootstrap-kubernetes-nodes/ Field note for preparing Kubernetes nodes with iSCSI networking, discovery, sessions, and CSI-ready storage behavior. https://trinidadmarroquin.com/field-notes/netplan-vmware-customization-conflicts/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/netplan-vmware-customization-conflicts/ Field note for diagnosing duplicate netplan ownership, missing default routes, and DNS drift on vSphere Ubuntu VMs. https://trinidadmarroquin.com/projects/terraform-vsphere-refactor/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/projects/terraform-vsphere-refactor/ A Terraform infrastructure project writeup about reorganizing a vSphere repo into environment roots, shared modules, templates, and archived legacy state. https://trinidadmarroquin.com/posts/terraform-refactor-hidden-infrastructure-coupling/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/terraform-refactor-hidden-infrastructure-coupling/ A practical SRE note on how refactoring a vSphere Terraform repo exposed coupling between Terraform, Packer, cloud-init, vSphere customization, netplan, bootstrap scripts, and iSCSI. https://trinidadmarroquin.com/field-notes/terraform-state-move-module-refactor/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-state-move-module-refactor/ Field note for moving Terraform resources into a module without forcing VM replacement. https://trinidadmarroquin.com/field-notes/terraform-variable-file-hygiene/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-variable-file-hygiene/ Field note for separating Terraform inputs, auto-loaded tfvars, govc environment files, and secrets in infrastructure repositories. https://trinidadmarroquin.com/field-notes/terraform-vsphere-clone-customization-failures/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/terraform-vsphere-clone-customization-failures/ Field note for diagnosing Terraform vSphere clone failures caused by VMware guest customization inside the VM. https://trinidadmarroquin.com/posts/llm-assisted-infrastructure-troubleshooting/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/posts/llm-assisted-infrastructure-troubleshooting/ Practical lessons for using LLMs during infrastructure troubleshooting while preserving operator judgment, validation, and evidence-based debugging. https://trinidadmarroquin.com/field-notes/vsphere-cloud-init-guestinfo/ Tue, 09 Jun 2026 00:00:00 -0500 https://trinidadmarroquin.com/field-notes/vsphere-cloud-init-guestinfo/ Field note for verifying Terraform guestinfo userdata, cloud-init state, and first-boot behavior on vSphere Ubuntu clones. https://trinidadmarroquin.com/about/ Mon, 08 Jun 2026 12:36:18 -0500 https://trinidadmarroquin.com/about/ About Trinidad Marroquin, an SRE and DevOps engineer focused on reliable infrastructure and practical automation. https://trinidadmarroquin.com/resume/ Mon, 08 Jun 2026 12:36:18 -0500 https://trinidadmarroquin.com/resume/ Resume summary for Trinidad Marroquin, SRE and DevOps engineer. https://trinidadmarroquin.com/field-notes/rke2-kube-proxy-crashloop-ufw-after-upgrade/ Tue, 03 Feb 2026 00:00:00 -0600 https://trinidadmarroquin.com/field-notes/rke2-kube-proxy-crashloop-ufw-after-upgrade/ Field note for diagnosing kube-proxy CrashLoopBackOff after an RKE2/Rancher upgrade, separating probe semantics from dataplane failures, and identifying UFW interference with kube-proxy iptables programming. https://trinidadmarroquin.com/posts/devops-dirty-dozen/over-reliance-on-tools/ Thu, 30 Jan 2025 00:00:00 -0600 https://trinidadmarroquin.com/posts/devops-dirty-dozen/over-reliance-on-tools/ Part 5 of the DevOps Dirty Dozen series: how believing tools alone can solve DevOps challenges neglects culture, process, and collaboration — and what to do about it. https://trinidadmarroquin.com/posts/devops-dirty-dozen/transforming-blame-culture/ Tue, 28 Jan 2025 00:00:00 -0600 https://trinidadmarroquin.com/posts/devops-dirty-dozen/transforming-blame-culture/ Part 4 of the DevOps Dirty Dozen series: how blame culture erodes trust, stalls innovation, and what it takes to build psychological safety instead. https://trinidadmarroquin.com/posts/devops-dirty-dozen/closing-pandoras-box-automating-chaos/ Mon, 27 Jan 2025 00:00:00 -0600 https://trinidadmarroquin.com/posts/devops-dirty-dozen/closing-pandoras-box-automating-chaos/ Part 3 of the DevOps Dirty Dozen series: how automating flawed processes amplifies dysfunction — and why process clarity must come before automation. https://trinidadmarroquin.com/posts/devops-dirty-dozen/drowning-in-choices-tool-overload/ Mon, 20 Jan 2025 00:00:00 -0600 https://trinidadmarroquin.com/posts/devops-dirty-dozen/drowning-in-choices-tool-overload/ Part 2 of the DevOps Dirty Dozen series: how tool overload creates cognitive load, integration debt, and analysis paralysis — and what teams can do about it. https://trinidadmarroquin.com/posts/devops-dirty-dozen/breaking-barriers-devops-silos/ Thu, 16 Jan 2025 00:00:00 -0600 https://trinidadmarroquin.com/posts/devops-dirty-dozen/breaking-barriers-devops-silos/ Part 1 of the DevOps Dirty Dozen series: how organizational silos undermine DevOps collaboration and what teams can do about it.