Scaling Effectively: when #kubernetes met Celery
▻https://hackernoon.com/https-medium-com-talperetz24-scaling-effectively-when-kubernetes-met-cel
This is a story about software architecture, about a personal itch, and about scalability. And like any good tech story, it begins with a shaky architecture.At Panorays, we help large enterprises to measure the security posture of their suppliers. But I’m not going to get into the whole 3rd party security management extravaganza with you. we came to talk about our architecture and process.In the beginning, there was bash. and scripts to manage VMs. a lot of scripts.There was a VM instance for each company we assessed.Every VM executed sequential batch jobs that imitate the whole reconnaissance phase of the hacker’s lifecycle.Company level parallelism is achieved by firing up more VMs.We built an internal orchestration system via Cron & Bash (imagine how fun was that…).Problems:The (...)