Author Topic: DR server automatic restart on render start/end  (Read 5417 times)

2017-07-21, 06:52:09

Dan Rodgers

  • Active Users
  • **
  • Posts: 55
    • View Profile
Restart CoronaDR on render end - same as V-Ray default DR option.  We are currently having a few problems with DR where jobs pick up but don't actually start, they load 5-6gb into ram then just stall indefinutly. Restarting CoronaDR fixes it straight away.  This is across multiple scenes, generally when they are quite heavy or if the previous scene was quite heavy.  So would be nice to have a 'fresh' CoronaDR running after each render.

Use localhost option would also be nice, so we can DR but not use the local machine and continue to work/render.
« Last Edit: 2018-10-19, 14:14:38 by maru »

2017-07-21, 09:43:12
Reply #1

denisgo22

  • Active Users
  • **
  • Posts: 700
    • View Profile
Restart CoronaDR on render end - same as V-Ray default DR option.  We are currently having a few problems with DR where jobs pick up but don't actually start, they load 5-6gb into ram then just stall indefinutly. Restarting CoronaDR fixes it straight away.  This is across multiple scenes, generally when they are quite heavy or if the previous scene was quite heavy.  So would be nice to have a 'fresh' CoronaDR running after each render.

Use localhost option would also be nice, so we can DR but not use the local machine and continue to work/render render.

+1

2017-08-17, 11:39:54
Reply #2

Charlie Nicols

  • Active Users
  • **
  • Posts: 88
    • View Profile
+ 2

2018-01-23, 10:49:02
Reply #3

Luis.Goncalves

  • Active Users
  • **
  • Posts: 33
    • View Profile

2018-01-24, 01:53:29
Reply #4

J

  • Active Users
  • **
  • Posts: 14
    • View Profile
having same issue as OP where dr jobs dont actually start and restarting drserver seems to fix it.

A 'restart dr on render end' feature would probably help. i used to have a postrender script that killed the max process on the dr nodes but something changed from 1.5 to 1.6 with the drserver so that method doesnt work anymore. It just kills the process constantly.

2018-01-25, 10:46:18
Reply #5

Jpjapers

  • Active Users
  • **
  • Posts: 1650
    • View Profile
having same issue as OP where dr jobs dont actually start and restarting drserver seems to fix it.

A 'restart dr on render end' feature would probably help. i used to have a postrender script that killed the max process on the dr nodes but something changed from 1.5 to 1.6 with the drserver so that method doesnt work anymore. It just kills the process constantly.

I have the same problem often

2018-01-26, 09:21:55
Reply #6

Ryuu

  • Former Corona Team Member
  • Active Users
  • **
  • Posts: 654
  • Michal
    • View Profile
I don't think that introducing some kind of auto-restart "feature" is the right approach here. It would be infinitely better just to try and fix the underlying issue. Unfortunately we were never able to reproduce this. You can definitely help us by generating minidump from both DR server and 3ds Max on slave (+ DR logs) when this issue happens.

Please see following help page on how to generate minidump without 3ds Max crashing:
https://coronarenderer.freshdesk.com/support/solutions/articles/5000524006-how-to-report-issues-3ds-max

Gathering DR logs:
https://coronarenderer.freshdesk.com/support/solutions/articles/12000002065

2018-03-11, 08:51:06
Reply #7

DPS

  • Active Users
  • **
  • Posts: 118
    • View Profile
I don't think that introducing some kind of auto-restart "feature" is the right approach here. It would be infinitely better just to try and fix the underlying issue. Unfortunately we were never able to reproduce this. You can definitely help us by generating minidump from both DR server and 3ds Max on slave (+ DR logs) when this issue happens.

Please see following help page on how to generate minidump without 3ds Max crashing:
https://coronarenderer.freshdesk.com/support/solutions/articles/5000524006-how-to-report-issues-3ds-max

Gathering DR logs:
https://coronarenderer.freshdesk.com/support/solutions/articles/12000002065

Should I send a minidump if my issue is that the DR machine is still running CPUs at 100% even once the render had completed? When I log into the node I see the CPU drops back down to normal. Sorry if this is hijacking but the OP suggestion would remedy my problem too.
Specs: AMD 1950X, Aorus Gaming 7 x399, 64GB RAM, 1080ti. Win10, Max 2017, Corona 1.7.3

2018-03-13, 04:11:06
Reply #8

iancamarillo

  • Active Users
  • **
  • Posts: 281
    • View Profile
I don't think that introducing some kind of auto-restart "feature" is the right approach here. It would be infinitely better just to try and fix the underlying issue.

This attention to detail is what attracts me to Corona.

2018-03-15, 10:16:07
Reply #9

Ryuu

  • Former Corona Team Member
  • Active Users
  • **
  • Posts: 654
  • Michal
    • View Profile
Should I send a minidump if my issue is that the DR machine is still running CPUs at 100% even once the render had completed? When I log into the node I see the CPU drops back down to normal. Sorry if this is hijacking but the OP suggestion would remedy my problem too.

If you're somehow able to generate minidump in the situation where the CPU utilization still sits at 100%, that might be helpful.

2018-10-24, 11:58:31
Reply #10

maru

  • Corona Team
  • Active Users
  • ****
  • Posts: 12754
  • Marcin
    • View Profile
We have released a new daily build yesterday (V3 RC2) which has various DR bugfixes included, and also a "Restart 3ds Max after render" checkbox in the DR server window.

If you have the time, and if you are able to install the experimental daily builds, please test it, and let me know whether there is an improvement with the "Restart 3ds Max" checkbox enabled and without it. It is very important for us to gather information about the performance of the DR server with this checkbox enabled and disabled.
Please note that the newest daily build has to be installed on all computers taking part in distributed rendering, and the newest DR server has to be launched on the render nodes.

More information:
Dedicated forum thread - https://forum.corona-renderer.com/index.php?topic=22160.0
Daily builds - https://coronarenderer.freshdesk.com/support/solutions/articles/5000570015
Marcin Miodek | chaos-corona.com
3D Support Team Lead - Corona | contact us

2018-11-09, 14:41:19
Reply #11

maru

  • Corona Team
  • Active Users
  • ****
  • Posts: 12754
  • Marcin
    • View Profile
We have just released RC5, which includes yet another DR fix ("Fixed DR server sometimes getting stuck when restarting slave 3ds Max").
If possible, please try it with the "restart 3ds Max" option on and off, and let me know about the results.
The RC5 can be downloaded from https://coronarenderer.freshdesk.com/support/solutions/articles/5000570015
Marcin Miodek | chaos-corona.com
3D Support Team Lead - Corona | contact us