pythonofftopic | Unsorted

Telegram-канал pythonofftopic - Offtopic

12466

Offtopic group for casual talking about anything. @rules_for_python still apply (except for the ontopic rule)

Subscribe to a channel

Offtopic

Efficient token usage maybe

Читать полностью…

Offtopic

Hi everyone, how are you effectively using AI models in cursor to maintain the request quota

Читать полностью…

Offtopic

How can I land avg IT job as ai engineer please enlighten me

Читать полностью…

Offtopic

I found the start wasn't so good, but I like it now. Into it an hour.

Читать полностью…

Offtopic

Think about this: If they paid you for one VPS and you would rent it, they would not have root access on that node, but you could grant them secure access to all nodes inside Kubernetes using RBAC and limit what they can do per namespace: CPU requests and limits, memory requests and limits, number of pods, services, PVCs and storage capacity. With CNI like Calico (that would replace the in-built Flannel from k3s) you could also make sure that cross-namespace communication is restricted and bandwitdh is (partially) limited as well. Cilium might be a better fit for limiting bandwidth even, but it's a bit more complex.

From a security point of view, that'd optimal.

Читать полностью…

Offtopic

The workloads that are supposed to run on the cluster need to be considered now to be able to make a good decision about the storage requirements.

Читать полностью…

Offtopic

For the scale you are planning for, S3 is a good fit but you need to say goodbye to distributed storage that runs on those nodes and rely on the applications running on those nodes to replicate and create and upload backups. It's not fully self-healing when a node goes down.

Читать полностью…

Offtopic

Well, that's a task to think about. I will design it when there are volunteers

Читать полностью…

Offtopic

Might be good enough.

Читать полностью…

Offtopic

Longhorn integrates with k8s. Its could be a nice solution

Читать полностью…

Offtopic

What won't give you PVCs but a way to distribute static content for applications or backups.

Читать полностью…

Offtopic

So....
On the topic of trust. There are heuristic distributed trust systems. They can also be backed by some kind of solution... like Vault

Читать полностью…

Offtopic

Also, owner need to be trusted. Even if you limit what the contributors of those nodes have limited access to inside cluster, they will have full access to whatever runs on their nodes anyway.

Читать полностью…

Offtopic

If the node owner were to share storage for distribution.

Читать полностью…

Offtopic

I didn't think about it. I would probably try to link it to a cluster

Читать полностью…

Offtopic

What are you talking about?

Читать полностью…

Offtopic

Hello sir. I know several people in india. What's your skill stack? Tensorflow? Pandas? etc. What do you know right now to land a job. Market is very competitive right now sir.

Читать полностью…

Offtopic

I listened til 20 min then got into meetings. That’s good to hear

Читать полностью…

Offtopic

However, if this is not about hosting but secure communication, let them provide the VPS and setup a Matrix network.

Читать полностью…

Offtopic

Blobs, media, backups: Garage S3
Databases needing HA: App-native replication or accept node-loss risk
Databases tolerating downtime: Local storage + S3 backup + restore on failure
Stateless workloads: Anything, freely schedulable

Читать полностью…

Offtopic

Still talking about stateful applications. Stateless is trivial.

Читать полностью…

Offtopic

I did a three nodes k3s cluster with gluster as backing storage for PVCs, across three different data centers that were "near" each other. I didn't run much on it though.

Читать полностью…

Offtopic

Vault controls how secrets are distributed and who is authorized to request them — but once a secret lands on a node, the node operator can see it.

Читать полностью…

Offtopic

Longhorn is slow and synchronous. Garage is a good fit for distribution data over nodes that are not near to each other.

Читать полностью…

Offtopic

Stateful applications would need to sync with other instances still, but could send backups to Garage.

Читать полностью…

Offtopic

Garage + Vault...
Yeah...

Читать полностью…

Offtopic

Yes. There is a latency issue. But I remember there's an open-source solution specifically for these kinds of 'garage distributed systems'. It's called Garage, I believe — named exactly that

Читать полностью…

Offtopic

Other than local storage.

Читать полностью…

Offtopic

There's a latency concern if the distributed storage is distributed to nodes around different parts of the world. Asynchronous replication would have a tolerable latency, but there's a risk of data loss.

Читать полностью…

Offtopic

Outside of (external to) the cluster?

Читать полностью…
Subscribe to a channel