Author Topic: TR clients disconnects - [TR] Frame synchronization failed: Communication Error  (Read 351 times)

2019-01-30, 18:44:16

jojorender

  • Active Users
  • **
  • Posts: 40
    • View Profile
MacOS 10.13.6 / C4D Studio R18.057 / Version: 3 hotfix 1 (core 3) Jan 18 2019 18:43:49

I don’t wanna beat a dead horse here, but I’m still getting random TR client disconnects that makes Team Render highly unreliable.
Not sure how much this is a C4D TR rather than a Corona issue.
I saw on the trello board that “Team render stability improvements” are planned for V.4
Will the “com error” be addressed that causes frame sync to fail?
Once I finish my current job, will install V.4 daily and check if stability has improved.

To recreate this error, almost any scene will do, just setting the render res high enough.
In my case rendering a 6k image will trigger client disconnects.

Some FYI”s
- Network: 1Gb LAN, Jumbo frames enabled in the entire chain.[/li][/list]
- Server/clients all macs
- Random clients at random times disconnects.
- CoronaTR manual settings:
 Tried many different combinations 10s-20s / 50MB, 75MB,100MB, 200MB all combinations had disconnects
- I have the 1WS/3nodes license - disconnects if I use 1 or all 3 nodes.
- Adding clients over time, to possibly not have them all send data at the same time, does not make a difference and shouldn't with just 3 nodes.

I noticed all TR consoles always say “rendering pass 2” no matter what actual pass gets rendered.
Could increasing the time between the 7 retries help?

TR console sample:
Code: [Select]
2019/01/30 08:23:18  [Corona4D] [TR] Sending chunk 0/10 to the server
2019/01/30 08:23:41  [Corona4D] [TR] Sending chunk 1/10 to the server
2019/01/30 08:23:43  [Corona4D] Rendering pass 2
2019/01/30 08:24:05  [Corona4D] Rendering initial pass
2019/01/30 08:24:05  [Corona4D] [TR] Sending chunk 2/10 to the server
2019/01/30 08:24:28  [Corona4D] [TR] Sending chunk 3/10 to the server
2019/01/30 08:24:52  [Corona4D] [TR] Sending chunk 4/10 to the server
2019/01/30 08:25:17  [Corona4D] [TR] Sending chunk 5/10 to the server
2019/01/30 08:25:41  [Corona4D] [TR] Sending chunk 6/10 to the server
2019/01/30 08:26:03  [Corona4D] [TR] Frame synchronization failed: Communication Error
2019/01/30 08:26:06  [Corona4D] [TR] Sending chunk 6/10 to the server
2019/01/30 08:26:07  [Corona4D] [TR] Frame synchronization failed: Communication Error
2019/01/30 08:26:09  [Corona4D] [TR] Sending chunk 6/10 to the server
2019/01/30 08:26:10  [Corona4D] [TR] Frame synchronization failed: Communication Error
2019/01/30 08:26:12  [Corona4D] [TR] Sending chunk 6/10 to the server
2019/01/30 08:26:12  [Corona4D] [TR] Frame synchronization failed: Communication Error
2019/01/30 08:26:14  [Corona4D] [TR] Sending chunk 6/10 to the server
2019/01/30 08:26:15  [Corona4D] [TR] Frame synchronization failed: Communication Error
2019/01/30 08:26:16  [Corona4D] [TR] Sending chunk 6/10 to the server
2019/01/30 08:26:17  [Corona4D] [TR] Frame synchronization failed: Communication Error
2019/01/30 08:26:19  [Corona4D] [TR] Sending chunk 6/10 to the server
2019/01/30 08:26:19  [Corona4D] [TR] Frame synchronization failed: Communication Error
2019/01/30 08:26:19  [Corona4D] CoronaCore::renderFrame: after render
2019/01/30 08:26:19  [Corona4D] Terminating DR slaves
2019/01/30 08:26:19  [Corona4D]  - terminating slave handlers
2019/01/30 08:26:19  [Corona4D]  - waiting for broadcast thread to finish
2019/01/30 08:26:19  [Corona4D]  - clearing slave handlers
2019/01/30 08:26:19  [Corona4D] Terminating DR slaves ended

Let me know if you need more info.

Thanks!
MacOs 10.13.6
C4D Studio R18.057

2019-02-16, 04:17:43
Reply #1

Gnorkie

  • Active Users
  • **
  • Posts: 21
    • View Profile

2019-02-26, 17:04:13
Reply #2

jamieirvin

  • Active Users
  • **
  • Posts: 53
    • View Profile
    • Infinite3D
Getting the same issue here.   Similar setup, all MacOS machines.  5 workstations and 10 slaves.

Would be good to get some insight in to why this is happening.
Core 3 HF2 - C4D R19 - OSX 10.13.2 - 64GB RAM

2019-03-13, 14:47:43
Reply #3

jojorender

  • Active Users
  • **
  • Posts: 40
    • View Profile
It's been a while... Any updates on TR nodes disconnect issue? Any fix in sight?
MacOs 10.13.6
C4D Studio R18.057

2019-03-13, 18:05:24
Reply #4

sirio76

  • Active Users
  • **
  • Posts: 48
    • View Profile
I'm wondering when Corona Team will realize that Team Render is junk(even with native C4D renderer) and will consider a proper dedicated DR system....
10 TR related bug report in the first 3 page, as soon as more pro users will start playing with Corona things will get even worst.

2019-03-18, 12:37:05
Reply #5

robpayne

  • Active Users
  • **
  • Posts: 10
    • View Profile
Team render’s good when it works. Please fix it. I had the same problem and currently can’t render final files locally until fixed.

2019-03-18, 12:53:53
Reply #6

houska

  • Corona Team
  • Active Users
  • ****
  • Posts: 1174
  • Cestmir Houska
    • View Profile
Team render’s good when it works. Please fix it. I had the same problem and currently can’t render final files locally until fixed.

Hi Rob, have you tried the newest daily build? It has a new TR mode that should be less error-prone - an "Arbitrated" TR mode. It has to be enabled in Render Settings/Team Render.
https://corona-renderer.com/forum/index.php?topic=23347.45