Render Pools

Feature requests discussion.
zaren
Posts: 19
Joined: Thu Jan 26, 2017 3:13 pm

Re: Render Pools

Post by zaren » Thu Jan 26, 2017 3:16 pm


lithorus
Posts: 28
Joined: Wed Jan 25, 2017 4:14 pm

Re: Render Pools

Post by lithorus » Fri Jan 27, 2017 9:57 am

timurhai wrote:
Thu Jan 26, 2017 12:58 pm
If create some Pools, lets create a useful Pools!

We can also make use it to split farm between departments and projects.
If we add a some job "Pools" too (along with render pools).
If we add priorities to such pools, we can adjust projects priorities (give some project more hosts).
A project job attribute would definately be good to have and later project attribute for render hosts.

seven11
Posts: 18
Joined: Tue Feb 21, 2017 8:03 pm

Re: Render Pools

Post by seven11 » Mon Mar 06, 2017 4:34 pm

timurhai wrote:
Thu Jan 26, 2017 9:24 am
Hi.
The same i can do with a mask parameter, which already exists:

Code: Select all

"mask":"stationa|stationb|stationc"
or:

Code: Select all

"mask":"station[a|b|c]"
Hi Timur,
I want to try this out. What file should this get placed into?
Thanks,
Scott

User avatar
timurhai
Site Admin
Posts: 504
Joined: Sun Jan 15, 2017 8:40 pm
Location: Russia, Korolev
Contact:

Re: Render Pools

Post by timurhai » Thu Mar 09, 2017 4:23 pm

Hi.
In a farm setup to limit services:
https://github.com/CGRU/cgru/blob/maste ... ample.json
In a job/user hosts mask.
Timur Hairulin
CGRU 2.4.0, Ubuntu 18.04 LTS, MS Windows 10 (clients only).

lithorus
Posts: 28
Joined: Wed Jan 25, 2017 4:14 pm

Re: Render Pools

Post by lithorus » Mon Jun 24, 2019 8:40 pm

After seeing that the render pools have been implemented I wanted to give it a spin.

I would REALLY miss the farm.json setup. Not having the ability to dynamically assign capacity, services through rules is a BIG loss IMHO. Wouldn't it be better to have rules to assign pools? I don't see the benefit of having a GUI based ressource assignments.

Also is there any way to save the state of a render farm? I can clearly see a renderfarm setup messed up by a random user clicking around in GOD mode.

And this is such a huge change that it should go in a 3.0 release.

User avatar
timurhai
Site Admin
Posts: 504
Joined: Sun Jan 15, 2017 8:40 pm
Location: Russia, Korolev
Contact:

Re: Render Pools

Post by timurhai » Mon Jun 24, 2019 9:15 pm

Hi.

For now pools implementation is not finished.
A pool has a "pattern" parameter.
New hosts will be parented to pool matching pattern mask.
So i do not see anything that we losing from a farm.json.
But now you can move some host in any pool manually, it is useful to setup specific servers.

Yes this is a GUI based resource assignment. But any GUI communicates server via json protocol, so you can integrate pools parameters changing in your pipeline.

You can't save pools state like you can just copy farm.json. But any nodes state server stores in its json store.

Also for now there are no service limits. But it is just not implemented. It will be soon.
Timur Hairulin
CGRU 2.4.0, Ubuntu 18.04 LTS, MS Windows 10 (clients only).

lithorus
Posts: 28
Joined: Wed Jan 25, 2017 4:14 pm

Re: Render Pools

Post by lithorus » Mon Jun 24, 2019 9:32 pm

Come to think of it, one could make a farm.json parser which applies the rules on the farm. If this can be run at startup it would still be compatible with the old setup.

I do like the idea that one can add and remove services on-the-fly (which is actually a problem I'm currently facing). Although I would like to be able to lock it down to certain hosts.

I can work on implementing the service assigning in afcmd.py.

Hmm.. is capacity also gone? Or still needs implementation?

Again, this should be a 3.0 release IMHO.

User avatar
timurhai
Site Admin
Posts: 504
Joined: Sun Jan 15, 2017 8:40 pm
Location: Russia, Korolev
Contact:

Re: Render Pools

Post by timurhai » Mon Jun 24, 2019 9:38 pm

lithorus wrote:
Mon Jun 24, 2019 9:32 pm
...
I do like the idea that one can add and remove services on-the-fly (which is actually a problem I'm currently facing). Although I would like to be able to lock it down to certain hosts.
...
- Now we can add/remove service for a permanent purposes and disable/enable for a temporal.
Capacity is implemented. By default it is -1 (no limit), but limited a number of tasks per host (1 per host).
Timur Hairulin
CGRU 2.4.0, Ubuntu 18.04 LTS, MS Windows 10 (clients only).

User avatar
timurhai
Site Admin
Posts: 504
Joined: Sun Jan 15, 2017 8:40 pm
Location: Russia, Korolev
Contact:

Re: Render Pools

Post by timurhai » Mon Jun 24, 2019 9:40 pm

And yes it can be 3.0, i thought about it too.
Timur Hairulin
CGRU 2.4.0, Ubuntu 18.04 LTS, MS Windows 10 (clients only).

lithorus
Posts: 28
Joined: Wed Jan 25, 2017 4:14 pm

Re: Render Pools

Post by lithorus » Mon Jun 24, 2019 10:06 pm

timurhai wrote:
Mon Jun 24, 2019 9:38 pm
Capacity is implemented. By default it is -1 (no limit), but limited a number of tasks per host (1 per host).
Where can I set it? I can't seem to find it in the GUI.

Post Reply

Who is online

Users browsing this forum: No registered users and 0 guests