1_r/devopsish

1_r/devopsish

54497 bookmarks
Custom sorting
When Kubernetes and Go don't work well together with Emin Laletović
When Kubernetes and Go don't work well together with Emin Laletović

When Kubernetes and Go don't work well together, with Emin Laletović

https://kube.fm/kubernetes-go-emin

Discover how a seemingly simple 502 error in Kubernetes can uncover complex interactions between Go and containerized environments.

Emin Laletović, a solution architect at Hybird Technologies, shares his experience debugging a production issue in which a specific API endpoint failed due to out-of-memory errors.

He walks through the systematic investigation process, from initial log checks to uncovering the root cause in Go's memory management within Kubernetes.

You will learn:

How Go's garbage collector interacts with Kubernetes resource limits, potentially leading to unexpected OOMKilled errors.

The importance of the GOMEMLIMIT environment variable in Go 1.19+ for managing memory usage in containerized environments.

Debugging techniques for memory-related issues in Kubernetes, including GODEBUG for garbage collector tracing.

Considerations for optimizing Go applications in Kubernetes, balancing performance and resource utilization.

Sponsor

This episode is sponsored by StormForge – Double your Kubernetes resource utilization and unburden developers from sizing complexity with the first HPA-compatible vertical pod rightsizing solution. Try it for free.

More info

Find all the links and info for this episode here: https://kube.fm/kubernetes-go-emin

Interested in sponsoring an episode? Learn more.

via KubeFM https://kube.fm

October 22, 2024 at 06:00AM

·kube.fm·
When Kubernetes and Go don't work well together with Emin Laletović
Phucking with Phishers
Phucking with Phishers
Phishers tried to steal my Instagram credentials. They also forget to properly secure their database…
·obrhubr.org·
Phucking with Phishers
DevOps Toolkit - Day 2 Operations Solved for Internal Developer Platforms with Kubernetes and Crossplane - https://www.youtube.com/watch?v=KLHNrLWmBfw
DevOps Toolkit - Day 2 Operations Solved for Internal Developer Platforms with Kubernetes and Crossplane - https://www.youtube.com/watch?v=KLHNrLWmBfw

Day 2 Operations Solved for Internal Developer Platforms with Kubernetes and Crossplane

In this video we tackle a major challenge in Internal Developer Platforms built on top of Kubernetes: enabling developers to not only manage their applications and infrastructure but also to observe and troubleshoot them effectively. We demonstrate how to propagate meaningful status information to top-level resources using Crossplane and the Status Transformer Function. Watch as we solve real-world issues, making day 2 operations easier for developers without overwhelming them with low-level details. Learn how to create custom resource definitions (CRDs) and controllers that simplify the developer experience.

IDP #Kubernetes #Crossplane #DeveloperPlatform

Consider joining the channel: https://www.youtube.com/c/devopstoolkit/join

▬▬▬▬▬▬ 🔗 Additional Info 🔗 ▬▬▬▬▬▬ ➡ Transcript and commands: https://devopstoolkit.live/internal-developer-platforms/internal-developer-platform-day-2-operations-solved-with-kubernetes-and-crossplane 🔗 Crossplane: https://crossplane.io 🎬 Status Transformer Crossplane Function: https://github.com/crossplane-contrib/function-status-transformer 🎬 Kubernetes Events Are Broken (If You Are Building a Developer Portal): https://youtu.be/xAl3TAfFE_M

▬▬▬▬▬▬ 💰 Sponsorships 💰 ▬▬▬▬▬▬ If you are interested in sponsoring this channel, please visit https://devopstoolkit.live/sponsor for more information. Alternatively, feel free to contact me over Twitter or LinkedIn (see below).

▬▬▬▬▬▬ 👋 Contact me 👋 ▬▬▬▬▬▬ ➡ Twitter: https://twitter.com/vfarcic ➡ LinkedIn: https://www.linkedin.com/in/viktorfarcic/

▬▬▬▬▬▬ 🚀 Other Channels 🚀 ▬▬▬▬▬▬ 🎤 Podcast: https://www.devopsparadox.com/ 💬 Live streams: https://www.youtube.com/c/DevOpsParadox

▬▬▬▬▬▬ ⏱ Timecodes ⏱ ▬▬▬▬▬▬ 00:00 Introduction 02:!3 The Problem In Kubernetes 08:25 The Problem With Custom Resources 12:16 Status Propagation 18:31 How It's Done

via YouTube https://www.youtube.com/watch?v=KLHNrLWmBfw

·youtube.com·
DevOps Toolkit - Day 2 Operations Solved for Internal Developer Platforms with Kubernetes and Crossplane - https://www.youtube.com/watch?v=KLHNrLWmBfw
Introducing Netflixs TimeSeries Data Abstraction Layer
Introducing Netflixs TimeSeries Data Abstraction Layer

Introducing Netflix’s TimeSeries Data Abstraction Layer

Written by Netflix Technology Blog 427K Followers ·Editor for Netflix TechBlog Learn more about how Netflix designs, builds, and operates our systems and…

October 21, 2024 at 09:26AM

via Instapaper

·medium.com·
Introducing Netflixs TimeSeries Data Abstraction Layer
Products on average retain 30% of customers after 3 months: Product benchmark findings
Products on average retain 30% of customers after 3 months: Product benchmark findings
User retention is an important metric for determining a product's success. Our recent benchmarking report has shed some light on patterns in user retention across various industries and company sizes. Let’s dive right into what our data says.
·mindtheproduct.com·
Products on average retain 30% of customers after 3 months: Product benchmark findings
Whitney Lee: From Wedding Photographer to Cloud-Native DevRel
Whitney Lee: From Wedding Photographer to Cloud-Native DevRel
This episode is from the reboot of Software Defined Interviews. Whitney Lee joins Coté to discuss her varied career path, from artist and wedding photographer to her current role in DevRel within the cloud-native world. They kick off this revamped series with an engaging conversation. Expect new interviews every two weeks! Subscribe at softwaredefinedinterviews.com.
·softwaredefinedtalk.com·
Whitney Lee: From Wedding Photographer to Cloud-Native DevRel
DevOps Toolkit - Cloud Cost - Feat. OpenCost StormForge and CAST AI (You Choose! Ch. 04 Ep. 07) - https://www.youtube.com/watch?v=5P_6vlmjQm4
DevOps Toolkit - Cloud Cost - Feat. OpenCost StormForge and CAST AI (You Choose! Ch. 04 Ep. 07) - https://www.youtube.com/watch?v=5P_6vlmjQm4

Cloud Cost - Feat. OpenCost, StormForge, and CAST AI (You Choose!, Ch. 04, Ep. 07)

Cloud Cost - Choose Your Own Adventure: The Observability Odyssey

In this episode, we'll go through cloud cost and resource optimization. The contestants are OpenCost, StormForge, and CAST AI.

Vote for your choice of a tool for signing artifacts at https://cloud-native.slack.com/archives/C05M2NFNVRN. If you have not already joined CNCF Slack, you can do so from https://slack.cncf.io.

This and all other episodes are available at https://www.youtube.com/playlist?list=PLyicRj904Z9-FzCPvGpVHgRQVYJpVmx3Z.

More information about the "Choose Your Own Adventure" project including the source code and links to all the videos can be found at https://github.com/vfarcic/cncf-demo.

٩( ᐛ )و Whitney's YouTube Channel → https://www.youtube.com/@wiggitywhitney

opencost #stormforge #castai

▬▬▬▬▬▬ 🔗 Additional Info 🔗 ▬▬▬▬▬▬ 🔗 Progressive Delivery: https://github.com/vfarcic/cncf-demo/tree/main/manuscript/cost/README.md

via YouTube https://www.youtube.com/watch?v=5P_6vlmjQm4

·youtube.com·
DevOps Toolkit - Cloud Cost - Feat. OpenCost StormForge and CAST AI (You Choose! Ch. 04 Ep. 07) - https://www.youtube.com/watch?v=5P_6vlmjQm4
eza-ls
eza-ls
eza-ls. GitHub Gist: instantly share code, notes, and snippets.
·gist.github.com·
eza-ls
Microsoft and OpenAI’s Close Partnership Shows Signs of Fraying
Microsoft and OpenAI’s Close Partnership Shows Signs of Fraying
The “best bromance in tech” has had a reality check as OpenAI has tried to change its deal with Microsoft and the software maker has tried to hedge its bet on the start-up.
·nytimes.com·
Microsoft and OpenAI’s Close Partnership Shows Signs of Fraying
Open Source AI Models with Kusari's Ben Cotton - Techstrong TV
Open Source AI Models with Kusari's Ben Cotton - Techstrong TV
Ben Cotton, head of community for Kusari, delves into the ongoing debate surrounding the definition of "open AI models." The discussion highlights challenges in applying the traditional open source concept to AI, particularly due to the inclusion of data and model weights. Cotton emphasizes that while efforts are underway to create an open source AI definition, the complexity of AI systems means that new terminologies and frameworks — such as different degrees of openness — may be necessary for the community to address biases, licensing, and transparency issues effectively.
·techstrong.tv·
Open Source AI Models with Kusari's Ben Cotton - Techstrong TV
Homelab automated with Ansible and FluxCD
Homelab automated with Ansible and FluxCD
This is an educational project to build a hybrid x86/ARM Kubernetes cluster, using Raspberry Pi and refurbished mini PCs, and to automate its deployment and configuration applying IaC (infrastructure as a code) and GitOps methodologies with tools like Ansible and Flux CD. How to automatically deploy K3s baesed kubernetes cluster, Longhorn as distributed block storage for PODs’ persistent volumes, Prometheus as monitoring solution, EFK+Loki stack as centralized log management solution, Velero and Restic as backup solution and Istio as service mesh architecture.
·picluster.ricsanfre.com·
Homelab automated with Ansible and FluxCD
LF Charities Welcomes Project Jupyter Expanding Role in Data Science and Furthering Community Innovation
LF Charities Welcomes Project Jupyter Expanding Role in Data Science and Furthering Community Innovation

LF Charities Welcomes Project Jupyter, Expanding Role in Data Science and Furthering Community Innovation

2 MIN READ LF Charities Welcomes Project Jupyter, Expanding Role in Data Science and Furthering Community Innovation The Linux Foundation | 17 October 2024 SAN…

October 17, 2024 at 03:53PM

via Instapaper

·linuxfoundation.org·
LF Charities Welcomes Project Jupyter Expanding Role in Data Science and Furthering Community Innovation
Last Week in Kubernetes Development - Week Ending October 13 2024
Last Week in Kubernetes Development - Week Ending October 13 2024

Week Ending October 13, 2024

https://lwkd.info/2024/20241017

Developer News

VM images built with Kubernetes Image Builder older than v0.1.37 have a security hole that may allow remote login. This includes Proxmox, Nutanix, OVA, QEMU, and raw providers. Upgrade to v0.1.38 or later, and rebuild your VM images.

SIG-Release is planning to phase out artifacts for some architectures by 1.33. In 1.32, the updated cross-build images for ppc64le and s390x will not be released, because of broken dependencies.

Release Schedule

Next Deadline: Docs placeholder PRs deadline, October 24

The enhancements freeze was last week and we have a total of 60 KEPs tracked for v1.32. 9 enhancements did not make the cut for the enhancements freeze and 9 were deferred. Coming up next is the deadline for getting your docs placeholder PRs open, on 24th of October. If your KEP is tracked for v1.32 and if you have updates to the docs, don’t forget to open your PRs in time!

The patch releases planned for October have been moved to Tuesday, October 22, 2024.

Featured PRs

127878 [scheduler] calculate pod requests resources with sidecar containers

This PR updates the scheduler scoring process to consider the resource requests of existing sidecar containers when scheduling Pods. As per the sidecar containers KEP, resources calculations for scheduling pods with sidecars is supposed to be: Max(Max( each InitContainerUse ), Sum(Sidecar Containers) + Sum(Containers)), but existing scheduler logic was using Max(RegularContainers, InitContainers) to calculate resources instead. This PR updates this logic.

KEP of the Week

KEP 3104: Introduce kuberc

This KEP proposes to introduce a new kuberc file that can be used to separate cluster credentials and server configuration from user preferences. This new and entirely opt-in kuberc file would allow users to configure aliases and default flags and also aims to deprecate the kubeconfig Preferences field. While in alpha, this feature can be enabled by setting the KUBECTL_KUBERC environment variable to true. The file will default to being located in ~/.kube/kuberc. A flag will allow overriding this default location with a path i.e. kubectl –kuberc /var/kube/rc.

This KEP is tracked for alpha release in the ongoing v1.32 cycle.

Other Merges

Fix for misleading kubeadm init output

NestedNumberAsFloat64 accuracy test is now architecture-neutral

Fix for spacing in kubectl –validate flag description

Version transition information in kube_features.go removed

kube-apiserver --tracing-config-file file is now validated strictly

kubelet: the --image-credential-provider-config file is now loaded with strict deserialization

CRI client to use default timeout for ImageFsInfo RPC

scheduler_perf test case for AssignedPodAdd event handling added

hcsshim library replaced with new hnslib library

Strict validation enabled for ResourceQuotaConfiguration

e2e node tests to use shared context in regular container tests

Getters for the field name and typeDescription of the Reflector struct renamed

EgressSelectorConfiguration now uses strict validation

etcd3 store decode functions extracted into an interface

Integration tests for TaintToleration in requeueing scenarios

Fix for data race in kubelet/volumemanager

Scheduler to start considering the resource requests of sidecar containers

Shorthand for kubectl explain –output

WaitForJobComplete and WaitForJobFailed functions to fail fast in e2e tests

CRI proxy for node e2e tests added

More e2e tests for sidecar containers

Fix for bug where kubelet restarts from missing cpuset cgroup

In-place Pod resize feature now adds extended Resources field to ContainerStatuses struct

Behavior of per request read/write handler with net/http server documented

Promotions

WatchList to beta

LoadBalancerIPMode to GA

Deprecated

kube-proxy command line flags --healthz-port and --metrics-port removed

Version Updates

Kubernetes is now built with go 1.23.2

vendor: system-validators to v1.9.0

Bump to several golang.org/x packages

via Last Week in Kubernetes Development https://lwkd.info/

October 17, 2024 at 12:30PM

·lwkd.info·
Last Week in Kubernetes Development - Week Ending October 13 2024
GitOps: How Many GitOps (ArgoCD) Instances Are Recommended for Multiple Environments?
GitOps: How Many GitOps (ArgoCD) Instances Are Recommended for Multiple Environments?

GitOps: How Many GitOps (ArgoCD) Instances Are Recommended for Multiple Environments?

In this Q&A session, we dive into managing GitOps instances with ArgoCD. Learn about the optimal number of ArgoCD instances for multiple environments, the difference between ephemeral and permanent environments, and the importance of cluster-based GitOps management. Discover best practices for separating production and non-production clusters, and how to utilize Argo Workflows and Argo Rollouts effectively.

ArgoCD #GitOps #DevOps

Consider joining the channel: https://www.youtube.com/c/devopstoolkit/join

▬▬▬▬▬▬ 💰 Sponsorships 💰 ▬▬▬▬▬▬ If you are interested in sponsoring this channel, please visit https://devopstoolkit.live/sponsor for more information. Alternatively, feel free to contact me over Twitter or LinkedIn (see below).

▬▬▬▬▬▬ 👋 Contact me 👋 ▬▬▬▬▬▬ ➡ Twitter: https://twitter.com/vfarcic ➡ LinkedIn: https://www.linkedin.com/in/viktorfarcic/

▬▬▬▬▬▬ 🚀 Other Channels 🚀 ▬▬▬▬▬▬ 🎤 Podcast: https://www.devopsparadox.com/ 💬 Live streams: https://www.youtube.com/c/DevOpsParadox

via YouTube https://www.youtube.com/watch?v=Tuba7LpoUVM

·youtube.com·
GitOps: How Many GitOps (ArgoCD) Instances Are Recommended for Multiple Environments?
Releasing WinAmp source goes badly for its owners anyway
Releasing WinAmp source goes badly for its owners anyway

Releasing WinAmp source goes badly – for its owners, anyway

The owners of WinAmp have just deleted their entire repo one month after uploading the source code to GitHub. Lots of source code, and quite possibly, not all…

October 17, 2024 at 10:05AM

via Instapaper

·theregister.com·
Releasing WinAmp source goes badly for its owners anyway
Microsoft's Azure Linux 3.0 Adds Valkey Enables Other New Features - Phoronix
Microsoft's Azure Linux 3.0 Adds Valkey Enables Other New Features - Phoronix

Microsoft's Azure Linux 3.0 Adds Valkey, Enables Other New Features - Phoronix

Microsoft has released Azure Linux 3.0.20241005 as the "October 2024" update to the company's in-house Linux distribution. Azure Linux 3.0 reached GA status…

October 17, 2024 at 09:41AM

via Instapaper

·phoronix.com·
Microsoft's Azure Linux 3.0 Adds Valkey Enables Other New Features - Phoronix
Amazon invests $500M to go nuclear after Microsoft and Google
Amazon invests $500M to go nuclear after Microsoft and Google

Amazon invests $500M to go nuclear after Microsoft and Google

Amazon (AMZN) is the latest Big Tech company to invest in nuclear energy to power artificial intelligence (AI) data centers. Amazon Web Service (AWS), the…

October 17, 2024 at 09:18AM

via Instapaper

·finance.yahoo.com·
Amazon invests $500M to go nuclear after Microsoft and Google
Introduction | Eraser Docs
Introduction | Eraser Docs

Introduction | Eraser Docs

When deploying to Kubernetes, it's common for pipelines to build and push images to a cluster, but it's much less common for these images to be cleaned up. This…

October 16, 2024 at 12:27PM

via Instapaper

·eraser-dev.github.io·
Introduction | Eraser Docs