Zezo forum:

Post by Inicio | 2020-11-19 | 18:28:24

VR server problems cause Zezo server overload when VR is fixed.

I have donated a little bit.
We need a better computer!
We have the best men.
They deserve a better instrument!

And we will enjoy it!

15 Comments

Post by Ultimate Victory | 2020-11-19 | 18:40:13

Why not hosting it in the cloud instead and size the machine when needed based on the races ? This will be a rent instead of a fix price and no electricity bill and networking troubles. I can help technically if needed.

Post by zezo | 2020-11-19 | 19:07:56

Cost, obviously.

I've used cloud instances before, when the weather changed 2 times/day and everybody went online in the first 10 minutes after the update. It made sense because the instances were active for only about a hour or two per day.

Now the load is more evenly spread, so that kind of optimization is impossible, or at least less efficient. Which does not mean I could not use cloud instances for cases like the one today.

My reasoning goes like this: 8-core Google instance runs about $150/month. I can buy refurbished 4-core 8-thread(vCPU) i7-3770/E3-1270 box for that amount, and still have it at the end of the month, and the next month too.

Electricity used by such box is $5/month or so.

The operating cost in the cloud would be close to $1000/month right now. Not prohibitive, but why spend it if possible to avoid it? When there are no big races it may not break even.

Post by Ultimate Victory | 2020-11-19 | 22:36:50

Sure, cost is driving everything at the end. What is exactly the kind of hardware do you need to run your site in term of CPU, Memory, Network ?

Post by zezo | 2020-11-19 | 23:07:13

Currently it's 16 cores/32 threads (4 CPUs, 4 boxes). Gigabit switch. Could do it with two mid-level Xeons, of course, but the main load (routing calculation itself) balances well between many machines.

RAM is not an issue. Main box that's serving you right now is 16G and could probably use a bit more, the others are less.

Network is 75 MBit peak, 25 average.

google cloud cost estimate is around $600 for the compute instances and $200 for bandwidth, depending on location and instance details.

Now everything is mid-level desktop hardware. Like

root@zezo:/home/zezo# dmidecode | grep -A2 Gigab
Vendor: Gigabyte Technology Co., Ltd.
Product: H67A-USB3-B3

But it's pretty stable:

uptime
12:56am up 845 days 12:09, 9 users, load average: 3.17, 4.26, 5.49

Numbers above are valid for the Vendee right now. It's only 10-15% of that during regular races around the year.

Post by zezo | 2020-11-20 | 12:59:55

Ooops. Network traffic would be more. 6-8 TB at $0.10/Gig

Post by zezo | 2020-11-20 | 14:39:35

The load should decrease a bit as we approach the ice limit as it will also limit the solution space. Additionally, the router then can be limited to certain latitude too.

That should keep it running smoothly up to Cape Horn.

Post by Inicio | 2020-11-20 | 17:06:26

How many users are now enjoying Zezo, or waking up when it takes time to respond?

How much money do you need to be able to be in good condition and avoid ourselves the impatience of waiting ... and the possible downfall?

Post by zezo | 2020-11-20 | 17:22:03

It's not about the money. I think it's fine as it is. When the game goes down for one hour during the weather update having to wait the router for another 5 minutes is not your biggest issue.

I just can't guarantee it will be smooth during such events, even if I double the capacity. Taking care it's fine the other 99% of the time, adding resources if/when needed.

Post by Inicio | 2020-11-20 | 17:23:33

Post by Ultimate Victory | 2020-11-20 | 20:50:35

Thanks cvetan for all these details.

Post by Eliric | 2020-11-21 | 14:11:03

Thanks,cvetan for all this info...I think people using your router should contribute financially .I will be happy to contribute like many of our friends from now.

Post by zezo | 2020-11-25 | 22:56:56

Here is most of it. Big black box on the left is zezo.org itself, web/db/front end server. The Dell desktop and the bare Asrock P67 Pro3 above it do the actual routing.

Post by Hardtack | 2020-11-25 | 23:04:28

*like*

Post by toxcct | 2020-11-25 | 23:06:43

Ah ah, you need to invest in a rack before a new server ! ^^

Post by zezo | 2020-11-25 | 23:27:50

Those slim desktops don't take much more space than the blade versions. Just don't have the space for 8 hard drives in them. But those run off 8G USB sticks anyway - you can see them around the Ethernet cables.