# Co-operatively owned server hardware

**URL:** https://community.coops.tech/t/co-operatively-owned-server-hardware/980
**Category:** Technology
**Tags:** hardware
**Created:** [21 August 2018 09:22 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980 "2018-08-21T09:22:29Z")
**Posts on this page:** 10
**Page:** 2

<div class="post-metadata">

### Author: ![Blockinfo](https://community.coops.tech/letter_avatar/blockinfo/32/5_5575768a8748004e209b776fc1b2916d.png) [@Blockinfo](https://community.coops.tech/u/Blockinfo)
#### Post date: [30 May 2020 12:24 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/21 "2020-05-30T12:24:01Z")

</div>

Slighted off key and on key. There is a fundamental mistake in the operation and attraction of capital for this kind of service. Coops can not be built in the current way they are funded. I will come up with solutions and ideas. Presently the global economic outlook for the future is not bright so investments are scare from the public individuals as we head towards a great depression. I see data centres value be diminished very quickly. Since large operators like Cisco try to compete. There will be alot of competition eroding alot of smaller data centres or making them be purchased from largers giants. Though coops have a huge advstange in this arena I simply need to develop my cooperative model and its article to file at a regulator that wont swipe us away from the fold of commercialisation and is good to attract capital from so anyone no of any jurisdictions that have good laws but fewer regulations some but flexi. I welcome feedback

---

<div class="post-metadata">

### Author: ![chris](https://community.coops.tech/user_avatar/community.coops.tech/chris/32/2_2.png) [@chris](https://community.coops.tech/u/chris)
#### Post date: [30 May 2020 12:27 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/22 "2020-05-30T12:27:18Z")

</div>

> [@alex](#):
>
> How much does a real co-located piece of hardware cost in 2020?

We recently brought a new file server, it isn’t racked yet, due to the lack of capital we opted for the cheapest, minimal options for a machine that could replace our existing server and also give us a serious increase in disk io, reduce the electricity demand and also some additional space, it is a 2U server with 20 2.5" disk bays, 8 populated with 1.9TB SSDs (so there is room for more when we have the funds) and this cost about £7.5k.

---

<div class="post-metadata">

### Author: ![alex](https://community.coops.tech/letter_avatar/alex/32/5_5575768a8748004e209b776fc1b2916d.png) [@alex](https://community.coops.tech/u/alex)
#### Post date: [30 May 2020 12:30 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/23 "2020-05-30T12:30:02Z")

</div>

Great - I mean not so great the cost, but at least we have a number!

The application servers, what sort of price tag do they come in at? The sort of front facing things like ths very forum is hosted on?

---

<div class="post-metadata">

### Author: ![chris](https://community.coops.tech/user_avatar/community.coops.tech/chris/32/2_2.png) [@chris](https://community.coops.tech/u/chris)
#### Post date: [30 May 2020 12:32 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/24 "2020-05-30T12:32:24Z")

</div>

The next front facing server we are looking at getting is a AMD 2nd generation EPYC 24 core CPU (48 with hyper threading) and 512GB of RAM and from memory this will cost in the region of £4-5k.

---

<div class="post-metadata">

### Author: ![decentral1se](https://community.coops.tech/user_avatar/community.coops.tech/decentral1se/32/3122_2.png) [@decentral1se](https://community.coops.tech/u/decentral1se)
#### Post date: [30 May 2020 14:11 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/25 "2020-05-30T14:11:00Z")

</div>

Wow, thanks for sharing @chrisc.

🤯

---

<div class="post-metadata">

### Author: ![alex](https://community.coops.tech/letter_avatar/alex/32/5_5575768a8748004e209b776fc1b2916d.png) [@alex](https://community.coops.tech/u/alex)
#### Post date: [31 May 2020 10:51 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/26 "2020-05-31T10:51:49Z")

</div>

Sorry for the very basic questions.

I know it depends on their needs, but roughly how many sites would you expect to host on that machine?

Obviously the second rung is complete cost of ownership here, with includes paying for someone to maintain it.

Not asking in the abstract here. I’d genuinely like to consider whether a few coops should do this, pertaining to this other thread on a plausible Heroku alternative.

---

<div class="post-metadata">

### Author: ![chris](https://community.coops.tech/user_avatar/community.coops.tech/chris/32/2_2.png) [@chris](https://community.coops.tech/u/chris)
#### Post date: [31 May 2020 11:34 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/27 "2020-05-31T11:34:21Z")

</div>

> [@alex](#):
>
> I know it depends on their needs, but roughly how many sites would you expect to host on that machine?

I’m guessing that you are asking about the front facing server?

For the VMs that we provide services on we _resource them based on need_, for example to avoid swapping we allocate a lot of RAM we also don’t want them to fall over with the occasional load spikes, we give them CPU cores based on need, the big ones:

- Mailcow, `webarch.email` our main mailserver, has **36G** of RAM (it had 48G last year and looking at the stats it probably needs to go up to that again as it is now swapping) for 275+ domains and 1,200+ mailboxes
- GitLab, `git.coop`, has **20G** of RAM and 830+ projects and 150+ users in 85+ groups, the corresponding GitLab runner Docker server has **16G** of RAM and 8 cores to support 8 concurrent pipelines.
- Shared web hosting, we have 10 shared webservers, these need to have **16G** of RAM each to ensure that all the PHP can be kept compiled in memory with OPCache and the MariaDB InnoDB tables are also held in RAM and also enough resources so that if one or more sites suddenly has a load of traffic the server stays up. These servers have up to 50 users accounts each with a mix of static HTML site and PHP / MariaDB sites.

Client VMs very between 1G and 10G of RAM each (for example `community.coops.tech` has 4G) and as clients pay directly for them they are often somewhat under resourced to save costs, because, like others, we charge based on RAM and disk (we do allocate CPU cores based on need) and although you can’t get away with too little disk space you can often get away with too little RAM and thrash the disks via swap to make up for the lack of RAM — this must be _happening all the time with providers of cheap VMs_.

In terms of disk space, once you have datacentre grade disks, RAID, snapshots, enough spare capacity that the array runs well (once you get to 80% capacity things can start to go wrong), a backup server with 30 days worth of backups and a backup of the backup server in another data centre with 30 days worth of backups then the cost per TB of storage no longer has much correspondance to the cost per 1TB of consumer grade disks…

The reason we allocate CPU cores based on need is to try to get the most usage out of the hardware without under resourcing or over resourcing virtual servers. We never go over two virtual CPU per hyperthreaded core and aim for one-to-one, so a 512G RAM server with a 24 core CPU (48 with hyperthreading) equates to virtual servers with around 10G of RAM per virtual CPU.

We have found that although servers generally only come with a three year warranty that after three years any hardware problems have been solved and they can be used for a further seven or so years, in a variety of different roles.

It is also with noting that the cost of of hardware, rack space, electricity and connectivity is very much related to the quantity purchased.

It is a capital intensive business in which you are trying to compete with capitalists, when you don’t have any capital, within a capitalist system, with clients who are often asking why the prices and the services of the capitalists can’t be matched… as I said at the top of this thread almost two years ago:

> [@chris](#):
>
> it is capital intensive (the servers cost a lot of money) and the competition is basically insane — we are competing against one of the worlds richest corporations which can afford to [make it’s own hardware including chips](https://www.geekwire.com/2017/amazon-web-services-secret-weapon-custom-made-hardware-network/) and which had [sales of $5 billion a quarter in 2017](https://www.zdnet.com/article/all-of-amazons-2017-operating-income-comes-from-aws/) and, so far, has [sales of $6 billion a quarter in 2018](https://www.theregister.co.uk/2018/07/27/amazon_q2_fy2018/)

And [in the third quarter of 2019](https://www.cnbc.com/2019/10/24/aws-earnings-q3-2019.html) _“Amazon Web Services… ended the quarter with $9 billion in revenue”_, and [for the first quarter of 2020](https://www.cnbc.com/2020/04/30/amazon-amzn-q1-2020-earnings.html) _“Amazon Web Services revenue was expected to come in at $10.33 billion”_, so for 2020 AWS revenue is probably going to be over $40,000,000,000 USD.

> [@decentral1se](#):
>
> Inspired by [https://www.org.meet.coop](https://www.org.meet.coop)…

We have _intentionally_ decided to host the first `meet.coop` server with [Koumbit](https://wiki.meet.coop/wiki/Alpha_server_options#Koumbit_offer) because they own their own hardware… a couple of the [key points of co-operatives](https://www.ica.coop/en/cooperatives/cooperative-identity) are _“4. Autonomy and Independence”_ and _“6. Cooperation among Cooperatives”_ … I find it hard to understand how building a co-op on the back of Amazon Web Services or other commercial cloud provider fits in with this…

---

<div class="post-metadata">

### Author: ![alex](https://community.coops.tech/letter_avatar/alex/32/5_5575768a8748004e209b776fc1b2916d.png) [@alex](https://community.coops.tech/u/alex)
#### Post date: [31 May 2020 15:39 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/28 "2020-05-31T15:39:56Z")

</div>

For me the rubrick is not “can we genuinely compete with Amazon” (or Google Cloud or so on) which, we can’t. But can we builld a compelling enough service that encourages cooperatives in the medium term and others in the longer term to make the shift. Which you know because you and I have been talking about this for four years!

Most coops are not using AWS or others because they really want to. They are doing it because they think they have to or do have to, for a variety of financial, operational and organisational reasons. I’d be interested to survey CoTech members as to why, if this has some legs.

For me personally though my task is, I’d like to replace our use of Netlify (useful but expensive for glorified web serving plus continious delivery) and Heroku in the next year, but simply haven’t had the headspace to consider this until now. We don’t use AWS itself, but these do and we’d like to move on, especially as Netlify is ridiculous when you look at it coldly.

---

<div class="post-metadata">

### Author: ![edmaw](https://community.coops.tech/user_avatar/community.coops.tech/edmaw/32/944_2.png) [@edmaw](https://community.coops.tech/u/edmaw)
#### Post date: [1 June 2020 16:51 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/29 "2020-06-01T16:51:48Z")

</div>

We run our own kit.  
We also use Hetzner or similar occasionally, but the vast majority of our stuff is on our own servers.  
I’d ask the sysadmins to provide some more detail but they are busy working on the database server right now 🤣

---

<div class="post-metadata">

### Author: ![decentral1se](https://community.coops.tech/user_avatar/community.coops.tech/decentral1se/32/3122_2.png) [@decentral1se](https://community.coops.tech/u/decentral1se)
#### Post date: [2 June 2020 19:09 UTC](https://community.coops.tech/t/co-operatively-owned-server-hardware/980/30 "2020-06-02T19:09:05Z")

</div>

[Kit and colocation - Systems - The meet.coop Forum](https://forum.meet.coop/t/kit-and-colocation/72) 💣

[Previous page](https://community.coops.tech/t/co-operatively-owned-server-hardware/980.md?page=1)
